-- Logs begin at Tue 2022-03-08 14:08:33 UTC, end at Tue 2022-03-08 15:36:52 UTC. -- Mar 08 14:42:21.168667 dv-cinder-830095-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Mar 08 14:42:21.177250 dv-cinder-830095-2-iscsi devstack@n-api.service[113922]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Mar 08 14:42:21.179262 dv-cinder-830095-2-iscsi devstack@n-api.service[113922]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Mar 8 14:42:21 2022] *** Mar 08 14:42:21.179262 dv-cinder-830095-2-iscsi devstack@n-api.service[113922]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Mar 08 14:42:21.179262 dv-cinder-830095-2-iscsi devstack@n-api.service[113922]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Mar 08 14:42:21.179262 dv-cinder-830095-2-iscsi devstack@n-api.service[113922]: nodename: dv-cinder-830095-2-iscsi Mar 08 14:42:21.179262 dv-cinder-830095-2-iscsi devstack@n-api.service[113922]: machine: x86_64 Mar 08 14:42:21.179262 dv-cinder-830095-2-iscsi devstack@n-api.service[113922]: clock source: unix Mar 08 14:42:21.179262 dv-cinder-830095-2-iscsi devstack@n-api.service[113922]: pcre jit disabled Mar 08 14:42:21.179262 dv-cinder-830095-2-iscsi devstack@n-api.service[113922]: detected number of CPU cores: 4 Mar 08 14:42:21.179262 dv-cinder-830095-2-iscsi devstack@n-api.service[113922]: current working directory: / Mar 08 14:42:21.179262 dv-cinder-830095-2-iscsi devstack@n-api.service[113922]: detected binary path: /usr/bin/uwsgi-core Mar 08 14:42:21.179984 dv-cinder-830095-2-iscsi devstack@n-api.service[113922]: your processes number limit is 47680 Mar 08 14:42:21.179984 dv-cinder-830095-2-iscsi devstack@n-api.service[113922]: your memory page size is 4096 bytes Mar 08 14:42:21.179984 dv-cinder-830095-2-iscsi devstack@n-api.service[113922]: detected max file descriptor number: 2048 Mar 08 14:42:21.179984 dv-cinder-830095-2-iscsi devstack@n-api.service[113922]: lock engine: pthread robust mutexes Mar 08 14:42:21.179984 dv-cinder-830095-2-iscsi devstack@n-api.service[113922]: thunder lock: enabled Mar 08 14:42:21.179984 dv-cinder-830095-2-iscsi devstack@n-api.service[113922]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Mar 08 14:42:21.179984 dv-cinder-830095-2-iscsi devstack@n-api.service[113922]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Mar 08 14:42:21.224935 dv-cinder-830095-2-iscsi devstack@n-api.service[113922]: Python main interpreter initialized at 0x5655062979c0 Mar 08 14:42:21.224935 dv-cinder-830095-2-iscsi devstack@n-api.service[113922]: python threads support enabled Mar 08 14:42:21.224935 dv-cinder-830095-2-iscsi devstack@n-api.service[113922]: your server socket listen backlog is limited to 100 connections Mar 08 14:42:21.224935 dv-cinder-830095-2-iscsi devstack@n-api.service[113922]: your mercy for graceful operations on workers is 90 seconds Mar 08 14:42:21.225265 dv-cinder-830095-2-iscsi devstack@n-api.service[113922]: mapped 403077 bytes (393 KB) for 2 cores Mar 08 14:42:21.225265 dv-cinder-830095-2-iscsi devstack@n-api.service[113922]: *** Operational MODE: preforking *** Mar 08 14:42:21.225550 dv-cinder-830095-2-iscsi devstack@n-api.service[113922]: *** uWSGI is running in multiple interpreter mode *** Mar 08 14:42:21.225550 dv-cinder-830095-2-iscsi devstack@n-api.service[113922]: spawned uWSGI master process (pid: 113922) Mar 08 14:42:21.225741 dv-cinder-830095-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Mar 08 14:42:21.226351 dv-cinder-830095-2-iscsi devstack@n-api.service[113922]: spawned uWSGI worker 1 (pid: 113923, cores: 1) Mar 08 14:42:21.226694 dv-cinder-830095-2-iscsi devstack@n-api.service[113922]: spawned uWSGI worker 2 (pid: 113924, cores: 1) Mar 08 14:42:21.226837 dv-cinder-830095-2-iscsi devstack@n-api.service[113922]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Mar 08 14:42:23.060194 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 14:42:23.060194 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: from cryptography.utils import int_from_bytes Mar 08 14:42:23.060871 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 14:42:23.060871 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: from cryptography.utils import int_from_bytes Mar 08 14:42:23.061516 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 14:42:23.061516 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: from cryptography.utils import int_from_bytes Mar 08 14:42:23.062060 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 14:42:23.062060 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: from cryptography.utils import int_from_bytes Mar 08 14:42:25.596173 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 08 14:42:25.597660 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 08 14:42:25.597758 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 08 14:42:25.597758 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 08 14:42:25.598247 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 08 14:42:25.598347 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 08 14:42:25.598446 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 08 14:42:25.598446 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 08 14:42:25.598599 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 08 14:42:25.598599 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 08 14:42:25.598760 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.598901 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.599035 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.599226 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.599314 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.599546 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.599632 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.599864 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.599960 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.600183 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.600277 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.600496 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.600591 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.600818 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.600911 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.601138 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.601231 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.601400 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.601493 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.601719 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.601805 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.602058 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.602151 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-830095-2-iscsi {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.602387 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-830095-2-iscsi {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.602477 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.602696 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.602803 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.603005 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.603100 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.603315 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.603403 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.603625 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.603712 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.603928 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.604027 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.604250 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.604344 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.604559 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.604751 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.605061 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.605166 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.605375 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.605525 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.605663 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.605800 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.606000 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.606141 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.606322 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.606420 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.606637 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.606725 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.606947 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.607034 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.607268 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.607355 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.607576 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.607670 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.607899 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.607986 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.608205 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.608338 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-830095-2-iscsi {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.608597 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-830095-2-iscsi {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.608686 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.608912 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.609001 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.609227 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.609321 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.609540 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.609669 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.609974 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.610148 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.610286 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.610375 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.610594 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.610690 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.610916 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.611010 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.611227 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.611314 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.611534 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.611629 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.611861 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.612598 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.612987 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.613092 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.613183 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.613275 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.613358 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.613439 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.613639 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.613737 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.613962 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.614065 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.614272 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.614366 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.614583 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.614669 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.614885 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.614973 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.615137 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.615223 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.615423 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.615509 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.615729 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.615824 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.616049 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.616138 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.616369 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.616463 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.616621 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.616710 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.616872 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.616967 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.617164 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.617260 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.617481 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.617569 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.617802 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.617923 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.618133 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.618227 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.618440 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.618535 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.618746 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.618841 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.619053 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.619147 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.619357 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.619452 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.619662 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.619757 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.619964 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.620051 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.620269 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.620362 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.620583 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.620677 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.620891 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.620978 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.621201 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.621294 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.621502 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.621598 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.621822 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.621953 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.622176 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.622264 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.622477 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.622577 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.622784 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.622872 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.623120 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.623219 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.623431 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.623528 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.623735 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.623821 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.624055 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.624143 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.624362 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.624449 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.624665 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.624751 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.624968 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.625055 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.625272 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.625369 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.625589 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.625677 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.625926 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.626015 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.626181 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.626270 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.626471 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.626564 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.626770 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.626858 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.627073 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.627161 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.627382 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.627467 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.627721 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.628139 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.628228 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.628320 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.628320 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.628477 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.628631 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.628728 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.628937 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.629025 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.629241 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.629328 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.629546 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.629641 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.629876 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.629968 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.630172 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.630267 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.630474 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.630571 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.630782 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.630868 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.631086 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.631172 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.631389 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.631485 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.631715 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.631801 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.632026 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.632119 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.632328 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.632414 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.632631 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.632724 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.632932 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.633025 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.633237 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.633339 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.633545 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.633632 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.633846 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.633947 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.634168 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.634269 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.634487 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.634573 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.634792 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.634885 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.635094 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.635261 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.635407 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.635500 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.635709 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.635794 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.636010 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.636105 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.636315 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.636401 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.636611 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.636696 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.636914 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.637008 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.637222 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.637315 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.637523 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.637613 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.637826 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.637972 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.638150 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.638243 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.638451 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.638538 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.638753 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.638841 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.639054 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.639152 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.639355 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.639450 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.639654 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.639740 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.639950 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.640044 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.640266 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.640362 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.640580 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.640666 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.640883 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.640970 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.641188 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.641283 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.641495 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.641581 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.641813 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:42:25.641930 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.642170 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.642303 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.642503 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.642649 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.642845 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.642967 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.643186 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.643654 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.643761 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.643846 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.643927 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.644008 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.644153 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.644318 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.644545 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.644644 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.644781 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.644958 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.645109 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.645275 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.645422 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.645594 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.645737 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.645933 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.646077 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.646258 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.646395 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.646578 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.646706 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.646913 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.647023 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.647233 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.647331 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.647552 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.647640 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.647874 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.647970 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.648189 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.648277 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.648508 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.648595 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.648842 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.648932 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.649159 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.649246 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.649471 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.649566 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.649812 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.649918 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.650178 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.650265 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.650494 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.650581 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.650820 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.650909 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.651140 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.651228 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.651455 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.651554 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.651765 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.651851 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.652076 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.652164 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.652398 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.652493 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.652725 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.652811 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.653038 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.653178 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.653357 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.653452 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.653666 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.653753 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.654004 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.654095 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.654318 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.654418 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.654628 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.654725 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.654938 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.655032 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.655271 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.655367 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.655585 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.655681 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.655898 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.655983 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.656209 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.656362 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.656527 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.656614 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.656837 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.656923 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.657149 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.657237 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.657456 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.657543 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.657760 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.657847 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.658087 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.658175 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.658390 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.658484 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.658700 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.659308 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.659642 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.660083 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.660169 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.660250 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.660331 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.660596 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.660748 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.660935 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.661078 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.661247 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.661428 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.661564 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.661745 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.661902 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.662096 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.662222 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.662416 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.662536 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.662734 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.662855 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.663047 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.663171 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.663363 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.663501 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.663679 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.663794 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.663987 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.664110 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.664315 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.664403 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.664628 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.664716 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.664934 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.665021 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.665257 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.665352 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.665564 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.665652 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.665889 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.665979 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.666211 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.666300 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.666525 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.666614 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.666835 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.666924 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.667148 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.667236 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.667461 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.667549 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.667774 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.667869 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.668088 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.668175 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.668403 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.668490 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.668734 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.668834 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.669062 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.669149 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.669370 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.669457 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.669696 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.669836 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.670032 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.670136 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.670350 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.670437 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.670657 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.670752 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.670964 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.671051 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.671267 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.671354 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.671578 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.671673 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.671885 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.671979 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.672194 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.672281 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.672498 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.672586 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.672805 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.672891 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.673110 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.673196 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.673417 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.673505 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.673726 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.673815 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.674060 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.674156 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.674374 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.675055 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.675588 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.675684 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.675767 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.675859 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.675943 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.676085 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.676174 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.676435 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.676532 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.676777 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.676873 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.677103 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.677191 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.677432 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.677525 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.677748 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.677836 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.678084 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.678182 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.678401 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.678496 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.678712 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.678807 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.679027 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.679122 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.679339 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.679438 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.679653 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.679740 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.679966 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.680054 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.680277 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.680377 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.680594 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.680680 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.680906 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.680992 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.681354 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.681465 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.681616 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.681781 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.681887 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.681982 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.682167 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.682264 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.682488 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.682610 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.682832 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.682931 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.683158 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.683264 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.683475 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.683571 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.683792 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.683894 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.684102 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.684190 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.684415 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.684503 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.684726 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.684821 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.685040 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.685127 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.685351 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.685455 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.685665 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.685754 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.686006 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.686098 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.686318 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.686416 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.686632 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.686720 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.686944 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.687031 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.687266 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.687352 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.687579 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.687680 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.687887 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.687973 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.688194 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.688353 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.688512 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.688677 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.688841 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.688930 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.689156 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.689251 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.689472 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.689568 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.689785 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.689893 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.690213 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.690801 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.690908 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.691003 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.691086 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.691167 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.691248 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.691336 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.691427 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.691593 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.691682 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.691911 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.692000 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.692231 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.692341 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.692548 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.692636 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.692865 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.692953 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.693167 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.693267 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.693489 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.693590 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.693795 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.693937 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.694132 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.694385 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.694476 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.694695 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.694782 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.695010 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.695352 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.695589 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.695678 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.695904 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.695992 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.696229 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.696329 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.696538 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.696625 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.696850 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.696938 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.697155 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.697306 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.697482 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.697569 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.697788 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.697905 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.698119 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.698220 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.698427 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.698515 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.698733 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.698820 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.699080 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.699188 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.699388 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.699475 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.699694 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.699789 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.700014 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.700103 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.700328 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.700415 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.700639 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.700726 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.700952 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.701040 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.701267 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.701356 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.701577 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.701663 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.701919 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.702013 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.702235 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.702326 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.702545 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.702631 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.702856 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.702944 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.703166 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.703254 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.703477 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.703592 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.703787 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.703895 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.704101 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.704198 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.704411 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.704507 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.704723 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.704809 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.705030 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.705116 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.705335 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.705431 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.705665 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.705760 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.706416 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.706512 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.706602 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.706693 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.706878 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.706967 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.707193 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.707281 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.707514 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.707604 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.707832 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.707920 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.708149 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.708250 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.708480 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.708569 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.708810 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.708897 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.709165 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.709252 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.709472 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.709578 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.709785 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.709911 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.710116 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.710212 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.710423 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.710511 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.710730 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.710818 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.711035 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.711128 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.711343 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.711430 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.711646 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.711734 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.711952 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.712038 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.712255 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.712350 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.712559 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.712647 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.712860 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.712954 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.713165 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.713252 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.713473 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.713562 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.713775 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.713882 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.714109 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.714206 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.714411 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.714497 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.714735 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.714823 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.715038 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.715133 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.715341 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.715429 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.715643 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.715731 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.715947 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.716044 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.716280 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.716366 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.716583 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.716675 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.716920 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.717023 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.717248 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.717342 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.717566 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.717656 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.717886 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.717979 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.718201 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.718298 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.718515 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.718609 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.718820 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.718915 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.719124 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.719211 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.719424 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.719518 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.719735 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.719823 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.720042 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.720130 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.720343 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.720437 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.720651 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.720738 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.720962 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.721048 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.721792 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.722296 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.722296 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.722464 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.722464 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.722630 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.722755 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.722856 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.723060 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.723155 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.723374 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.723469 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.723684 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.723781 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.723987 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.724078 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.724295 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.724393 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.724608 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.724706 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.724918 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.725007 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.725223 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.725311 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.725536 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.725623 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.725838 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.725988 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.726176 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.726265 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.726485 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.726582 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.726793 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.726879 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.727096 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.727183 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.727409 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.727498 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.727717 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.727804 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.728021 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.728107 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.728345 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.728440 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.728654 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.728742 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.728958 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.729053 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.729263 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.729351 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.729572 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.729665 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.729893 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.729997 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.730199 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.730287 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.730508 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.730597 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.730829 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.730927 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.731139 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.731227 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.731442 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.731528 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.731747 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.731844 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.732050 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.732143 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.732353 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.732441 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.732657 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.732768 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.732962 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.733048 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.733261 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.733355 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.733562 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.733651 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.733874 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.734000 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.734188 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.734309 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.734491 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.734581 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.734811 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.734900 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.735118 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.735205 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.735422 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.735517 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.735723 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.735811 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.736025 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.736120 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.736360 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.736447 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.736660 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.736772 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.737084 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.737222 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.737399 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.737686 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.737932 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.738025 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.738253 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.738353 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.738570 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.738658 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.738889 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.738984 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.739199 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.739298 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.739524 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.739612 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.739840 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.739927 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.740155 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.740278 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.740461 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.740576 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.740768 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.740856 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.741072 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.741187 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.741395 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.741482 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.741708 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.741796 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.742044 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.742134 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.742370 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.742458 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.742695 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.742782 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.743004 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.743093 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.743314 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.743401 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.743627 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.743722 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.743936 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.744022 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.744249 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.744335 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.744557 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.744695 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.744868 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.744955 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.745179 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.745265 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.745491 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.745587 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.745802 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.745932 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.746140 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.746228 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.746450 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.746549 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.746756 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.746850 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.747070 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.747165 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.747380 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.747475 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.747687 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.747817 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.748010 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.748096 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.748319 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.748408 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.748623 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.748720 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.748931 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.749018 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.749236 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.749324 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.749547 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.749635 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.749868 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.750009 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.750298 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.750387 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.750615 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.750710 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.750924 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.751019 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.751231 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.751318 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.751543 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.751631 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.751859 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.751954 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.752175 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.752261 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.752484 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.753174 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.753600 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.753699 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.753916 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.754022 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.754209 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.754296 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.754526 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.754624 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.754837 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.754924 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.755144 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.755230 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.755451 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.755540 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.755765 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.755853 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.756081 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.756167 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.756389 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.756525 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.756695 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.756784 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.757003 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.757091 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.757318 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.757413 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.757623 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.757717 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.757969 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.758083 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.758390 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.758480 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.758700 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.758795 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.759005 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.759123 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.759423 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.759511 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.759739 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.759826 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.760053 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.760149 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.760380 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.760475 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.760707 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.760794 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.761016 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.761112 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.761326 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.761411 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.761638 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.761737 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.761978 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.762082 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.762305 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.762401 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.762619 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.762713 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.762931 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.763021 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.763240 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.763336 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.763543 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.763637 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.763869 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.763964 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.764188 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.764329 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.764502 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.764632 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.764824 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.764912 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.765239 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.765327 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.765554 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.765642 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.765884 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.765986 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.766205 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.766294 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.766518 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.766605 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.766825 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.766911 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.767133 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.767221 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.767440 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.767535 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.767743 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.767838 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.768049 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.768179 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.768513 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.768877 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.768963 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.769059 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.769144 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.769284 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.769374 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.769598 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.769686 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.769933 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.770026 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.770243 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.770331 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.770551 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.770638 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.770874 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.770963 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.771180 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.771274 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.771504 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.771606 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.771818 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.771905 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.772128 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.772216 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.772456 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.772552 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.772765 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.772861 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.773074 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.773162 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.773384 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.773480 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.773691 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.773784 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.774020 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.774110 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.774328 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.774433 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.774669 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.774757 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.774979 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.775065 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.775304 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.775401 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.775629 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.775718 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.775959 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.776054 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.776273 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.776370 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.776591 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.776678 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.776913 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.777001 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.777229 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.777316 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.777541 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.777628 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.777867 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.777958 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.778185 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.778276 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.778492 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.778580 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.778801 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.778898 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.779104 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.779191 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.779410 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.779498 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.779715 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.779811 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.780024 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.780115 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.780327 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.780423 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.780633 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.780731 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.780937 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.781034 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.781261 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.781348 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.781567 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.781715 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.781888 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.781980 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.782203 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.782301 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.782512 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.782617 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.782816 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.782903 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.783118 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.783207 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.783461 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.783552 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.784271 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.784396 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.784710 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.785106 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.785202 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.785286 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.785367 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.785447 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.785608 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.785761 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.785943 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.786112 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.786274 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.786435 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.786593 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.786758 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.786911 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.787078 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.787228 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.787398 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.787544 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.787719 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.787859 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.788038 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.788174 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.788353 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.788489 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.788674 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.788799 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.788993 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.789114 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.789301 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.789430 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.789745 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.789840 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.790176 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.790294 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.790494 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.790629 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.790815 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.790948 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.791132 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.791269 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.791452 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.791588 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.791770 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.791905 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.792086 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.792221 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.792404 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.792543 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.792721 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.792858 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.793038 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.793173 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.793369 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.793489 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.793696 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.793819 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.794054 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.794166 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.794395 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.794485 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.794714 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.794823 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.795033 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.795126 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.795352 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.795452 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.795670 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.795765 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.796031 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.796136 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.796349 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.796437 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.796660 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.796756 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.796978 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.797075 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.797290 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.797377 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.797608 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.797695 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.797944 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.798048 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.798257 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.798352 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.798568 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.798702 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.798882 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.798978 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.799196 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.799283 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.799582 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.800039 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.800039 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.800211 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.800211 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.800365 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.800510 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.800609 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.800850 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.800939 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.801174 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.801262 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.801491 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.801588 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.801809 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.801951 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.802154 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.802254 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.802479 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.802675 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.802993 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.803089 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.803311 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.803405 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.803643 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.803732 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.803968 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.804055 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.804287 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.804374 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.804603 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.804691 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.804923 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.805067 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.805233 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.805321 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.805543 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.805633 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.805859 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.805947 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.806187 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.806286 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.806499 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.806588 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.806806 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.806894 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.807131 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.807228 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.807442 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.807530 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.807746 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.807833 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.808065 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.808327 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.808438 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.808602 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.808885 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.808974 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.809233 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.809331 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.809550 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.809638 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.809901 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.810006 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.810232 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.810332 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.810545 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.810632 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.810851 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.810938 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.811172 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.811260 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.811478 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.811567 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.811784 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.811921 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.812099 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.812187 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.812408 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.812497 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.812712 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.812799 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.813019 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.813108 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.813330 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.813418 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.813641 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.813736 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.813973 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.814064 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.814282 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.814369 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.814587 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.814686 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.814912 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.815032 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.815308 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.815823 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.815917 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.816082 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.816175 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.816258 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.816350 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.816433 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.816513 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.816651 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.816793 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.816960 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.817102 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.817267 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.817418 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.817576 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.817726 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.817915 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.818068 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.818224 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.818379 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.818536 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.818695 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.818844 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.819003 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.819157 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.819317 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.819464 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.819669 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.819758 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.820003 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.820356 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.820576 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.820673 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.820885 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.820983 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.821202 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.821298 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.821518 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.821615 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.821847 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.821996 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.822187 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.822290 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.822502 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.822598 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.822811 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.822900 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.823160 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.823318 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.823477 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.823696 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.824008 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.824097 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.824345 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.824446 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.824667 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.824755 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.825004 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.825093 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.825311 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.825690 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.825809 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.825932 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.826033 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.826116 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.826266 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.826365 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.826583 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.826672 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.826893 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.826988 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.827205 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.827294 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.827516 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.827616 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.827827 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.827913 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.828139 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.828228 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.828449 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.828536 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.828758 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.828854 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.829067 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.829167 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.829378 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.829467 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.829689 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.829786 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.830023 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.830126 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.830335 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.830423 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.831164 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.831707 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.831803 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.831885 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.831966 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.832091 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.832190 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.832275 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.832425 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.832514 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.832738 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.832825 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.833054 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.833142 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.833367 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.833456 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.833680 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.833769 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.834023 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.834113 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.834362 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.834452 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.834682 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.834771 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.834994 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.835092 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.835301 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.835419 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.835720 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.835816 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.836031 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.836120 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.836352 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.836440 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.836665 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.836761 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.836975 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.837070 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.837298 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.837387 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.837612 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.837713 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.837943 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.838046 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.838266 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.838355 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.838578 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.838669 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.838908 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.838996 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.839245 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.839340 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.839571 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.839660 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.839881 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.839969 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.840192 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.840280 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.840497 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.840586 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.840804 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.840892 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.841114 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.841210 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.841428 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.841563 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.841736 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.841823 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.842064 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.842209 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.842371 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.842460 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.842677 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.842765 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.842987 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.843083 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.843290 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.843377 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.843595 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.843685 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.843900 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.843997 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.844205 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.844299 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.844507 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.844600 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.844812 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.844909 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.845117 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.845205 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.845421 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.845507 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.845724 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.845821 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.846055 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.846145 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.846505 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.846891 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.846995 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.847079 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.847161 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.847241 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.847354 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.847493 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.847662 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.847800 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.848005 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.848094 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.848346 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.848443 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.848667 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.848768 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.848997 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.849086 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.849314 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.849411 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.849641 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.849729 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.849979 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.850072 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.850303 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.850401 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.850628 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.850717 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.850946 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.851033 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.851259 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.851359 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.851571 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.851709 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.851897 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.851985 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.852208 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.852342 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.852521 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.852609 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.852834 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.852923 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.853147 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.853237 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.853457 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.853545 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.853768 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.853886 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.854121 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.854212 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.854431 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.854519 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.854746 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.854842 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.855071 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.855160 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.855388 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.855477 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.855707 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.855808 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.856023 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.856119 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.856334 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.856431 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.856658 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.856759 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.856968 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.857056 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.857280 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.857379 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.857592 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.857685 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.857920 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.858013 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.858236 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.858325 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.858555 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.858645 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.858869 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.858957 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.859198 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.859295 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.859526 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.859624 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.859850 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.859945 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.860176 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.860264 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.860511 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.860607 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.860827 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.860922 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.861172 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.861269 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.861490 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.861578 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.861807 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.862458 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.862694 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.863180 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.863274 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=113924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 08 14:42:25.863369 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:42:25.863369 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=113923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 08 14:42:25.885301 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG oslo_db.sqlalchemy.engines [None req-25ee3436-8815-48d5-a3b3-2d939a0f2d2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113924) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 14:42:25.886363 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG oslo_db.sqlalchemy.engines [None req-c559156a-1c38-49b8-9997-05953c034388 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113923) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 14:42:25.949165 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.context [None req-25ee3436-8815-48d5-a3b3-2d939a0f2d2c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8d394eb1-87fe-4527-b2a1-ae44ca505941(cell1) {{(pid=113924) load_cells /opt/stack/nova/nova/context.py:464}} Mar 08 14:42:25.949353 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.context [None req-c559156a-1c38-49b8-9997-05953c034388 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8d394eb1-87fe-4527-b2a1-ae44ca505941(cell1) {{(pid=113923) load_cells /opt/stack/nova/nova/context.py:464}} Mar 08 14:42:25.953386 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG oslo_concurrency.lockutils [None req-25ee3436-8815-48d5-a3b3-2d939a0f2d2c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:42:25.953518 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG oslo_concurrency.lockutils [None req-c559156a-1c38-49b8-9997-05953c034388 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:42:25.954994 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG oslo_concurrency.lockutils [None req-25ee3436-8815-48d5-a3b3-2d939a0f2d2c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:42:25.955102 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG oslo_concurrency.lockutils [None req-c559156a-1c38-49b8-9997-05953c034388 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:42:25.956349 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG oslo_concurrency.lockutils [None req-c559156a-1c38-49b8-9997-05953c034388 None None] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:42:25.956466 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG oslo_concurrency.lockutils [None req-25ee3436-8815-48d5-a3b3-2d939a0f2d2c None None] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:42:25.958294 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG oslo_concurrency.lockutils [None req-c559156a-1c38-49b8-9997-05953c034388 None None] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:42:25.958532 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG oslo_concurrency.lockutils [None req-25ee3436-8815-48d5-a3b3-2d939a0f2d2c None None] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=113924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:42:25.970435 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG oslo_db.sqlalchemy.engines [None req-c559156a-1c38-49b8-9997-05953c034388 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113923) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 14:42:25.975039 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG oslo_db.sqlalchemy.engines [None req-25ee3436-8815-48d5-a3b3-2d939a0f2d2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113924) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 14:42:25.976618 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG oslo_db.sqlalchemy.engines [None req-c559156a-1c38-49b8-9997-05953c034388 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113923) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 14:42:25.980766 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG oslo_db.sqlalchemy.engines [None req-25ee3436-8815-48d5-a3b3-2d939a0f2d2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113924) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 14:42:26.131210 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG oslo_db.sqlalchemy.engines [None req-c559156a-1c38-49b8-9997-05953c034388 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113923) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 14:42:26.140038 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG oslo_db.sqlalchemy.engines [None req-25ee3436-8815-48d5-a3b3-2d939a0f2d2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113924) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 14:42:26.465383 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: WARNING keystonemiddleware.auth_token [None req-c559156a-1c38-49b8-9997-05953c034388 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 08 14:42:26.470469 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: WARNING keystonemiddleware.auth_token [None req-25ee3436-8815-48d5-a3b3-2d939a0f2d2c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 08 14:42:26.472646 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: WARNING keystonemiddleware.auth_token [None req-c559156a-1c38-49b8-9997-05953c034388 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 08 14:42:26.477803 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: WARNING keystonemiddleware.auth_token [None req-25ee3436-8815-48d5-a3b3-2d939a0f2d2c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 08 14:42:26.818975 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: WARNING keystonemiddleware.auth_token [None req-c559156a-1c38-49b8-9997-05953c034388 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 08 14:42:26.824541 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: WARNING keystonemiddleware.auth_token [None req-c559156a-1c38-49b8-9997-05953c034388 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 08 14:42:26.824903 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: WARNING keystonemiddleware.auth_token [None req-25ee3436-8815-48d5-a3b3-2d939a0f2d2c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 08 14:42:26.829642 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5655062979c0 pid: 113923 (default app) Mar 08 14:42:26.830394 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: WARNING keystonemiddleware.auth_token [None req-25ee3436-8815-48d5-a3b3-2d939a0f2d2c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 08 14:42:26.831906 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi [None req-c559156a-1c38-49b8-9997-05953c034388 None None] Calling method '>' {{(pid=113923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:42:26.833069 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: INFO nova.api.openstack.requestlog [None req-c559156a-1c38-49b8-9997-05953c034388 None None] 10.222.0.30 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001858 Mar 08 14:42:26.833732 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: [pid: 113923|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 788 bytes} [Tue Mar 8 14:42:26 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:42:26.835637 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5655062979c0 pid: 113924 (default app) Mar 08 14:43:48.610893 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi [None req-c559156a-1c38-49b8-9997-05953c034388 None None] Calling method '>' {{(pid=113923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:43:48.611969 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: INFO nova.api.openstack.requestlog [None req-c559156a-1c38-49b8-9997-05953c034388 None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Mar 08 14:43:48.612400 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: [pid: 113923|app: 0|req: 2/2] 10.222.0.30 () {54 vars in 930 bytes} [Tue Mar 8 14:43:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:43:49.044578 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi [None req-5b8f495b-8278-4c86-aca8-30a88fa50a0d admin admin] Calling method '>' {{(pid=113924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:43:49.075548 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: INFO nova.api.openstack.requestlog [None req-5b8f495b-8278-4c86-aca8-30a88fa50a0d admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.456413 Mar 08 14:43:49.076309 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: [pid: 113924|app: 0|req: 1/3] 10.222.0.30 () {60 vars in 1291 bytes} [Tue Mar 8 14:43:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:43:51.452397 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi [None req-c559156a-1c38-49b8-9997-05953c034388 None None] Calling method '>' {{(pid=113923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:43:51.454063 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: INFO nova.api.openstack.requestlog [None req-c559156a-1c38-49b8-9997-05953c034388 None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002101 Mar 08 14:43:51.454433 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: [pid: 113923|app: 0|req: 3/4] 10.222.0.30 () {54 vars in 930 bytes} [Tue Mar 8 14:43:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:43:51.517577 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi [None req-f91cc148-e318-4fcb-a4c9-d81859fc7d89 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "name": "cirros256", "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "id": "c1", "disk": 1}} {{(pid=113924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:43:51.536157 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 14:43:51.536157 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: warnings.warn(msg) Mar 08 14:43:51.565577 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: INFO nova.api.openstack.requestlog [None req-f91cc148-e318-4fcb-a4c9-d81859fc7d89 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.105281 Mar 08 14:43:51.566156 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: [pid: 113924|app: 0|req: 2/5] 10.222.0.30 () {64 vars in 1282 bytes} [Tue Mar 8 14:43:51 2022] POST /compute/v2.1/flavors => generated 407 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:43:51.800529 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi [None req-b0f01710-6cf0-4952-a8cb-6adfd574377a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:43:51.803098 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 14:43:51.803098 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: warnings.warn(msg) Mar 08 14:43:51.852463 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: INFO nova.api.openstack.requestlog [None req-b0f01710-6cf0-4952-a8cb-6adfd574377a admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.278229 Mar 08 14:43:51.863564 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: [pid: 113923|app: 0|req: 4/6] 10.222.0.30 () {64 vars in 1335 bytes} [Tue Mar 8 14:43:51 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:43:54.355606 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi [None req-f91cc148-e318-4fcb-a4c9-d81859fc7d89 admin admin] Calling method '>' {{(pid=113924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:43:54.356663 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: INFO nova.api.openstack.requestlog [None req-f91cc148-e318-4fcb-a4c9-d81859fc7d89 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Mar 08 14:43:54.357091 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: [pid: 113924|app: 0|req: 3/7] 10.222.0.30 () {54 vars in 930 bytes} [Tue Mar 8 14:43:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:43:54.477119 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi [None req-08a1e103-f980-4b3c-8656-f2a9eab2a2d0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "swap": 0, "vcpus": 1, "ram": 512, "disk": 5, "id": "d1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=113923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:43:54.496694 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 14:43:54.496694 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: warnings.warn(msg) Mar 08 14:43:54.517976 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: INFO nova.api.openstack.requestlog [None req-08a1e103-f980-4b3c-8656-f2a9eab2a2d0 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.154676 Mar 08 14:43:54.518748 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: [pid: 113923|app: 0|req: 5/8] 10.222.0.30 () {64 vars in 1282 bytes} [Tue Mar 8 14:43:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:43:54.531407 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi [None req-ad10f010-2774-42e9-a40f-e8307294e4b4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:43:54.533222 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 14:43:54.533222 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: warnings.warn(msg) Mar 08 14:43:54.571849 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: INFO nova.api.openstack.requestlog [None req-ad10f010-2774-42e9-a40f-e8307294e4b4 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044548 Mar 08 14:43:54.572521 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: [pid: 113924|app: 0|req: 4/9] 10.222.0.30 () {64 vars in 1335 bytes} [Tue Mar 8 14:43:54 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:43:56.915623 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi [None req-08a1e103-f980-4b3c-8656-f2a9eab2a2d0 admin admin] Calling method '>' {{(pid=113923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:43:56.916614 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: INFO nova.api.openstack.requestlog [None req-08a1e103-f980-4b3c-8656-f2a9eab2a2d0 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Mar 08 14:43:56.917004 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: [pid: 113923|app: 0|req: 6/10] 10.222.0.30 () {54 vars in 930 bytes} [Tue Mar 8 14:43:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:43:56.977182 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi [None req-974a0dd8-fad0-47b3-801e-894af4568672 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "id": "d2", "ram": 1024, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 10, "vcpus": 1}} {{(pid=113924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:43:56.997361 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: INFO nova.api.openstack.requestlog [None req-974a0dd8-fad0-47b3-801e-894af4568672 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073785 Mar 08 14:43:56.999917 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: [pid: 113924|app: 0|req: 5/11] 10.222.0.30 () {64 vars in 1282 bytes} [Tue Mar 8 14:43:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:43:57.011120 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi [None req-70004219-6931-4187-a12f-642040662ff8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:43:57.038499 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: INFO nova.api.openstack.requestlog [None req-70004219-6931-4187-a12f-642040662ff8 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031128 Mar 08 14:43:57.042669 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: [pid: 113923|app: 0|req: 7/12] 10.222.0.30 () {64 vars in 1335 bytes} [Tue Mar 8 14:43:57 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:43:59.423534 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi [None req-974a0dd8-fad0-47b3-801e-894af4568672 admin admin] Calling method '>' {{(pid=113924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:43:59.424582 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: INFO nova.api.openstack.requestlog [None req-974a0dd8-fad0-47b3-801e-894af4568672 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Mar 08 14:43:59.424985 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: [pid: 113924|app: 0|req: 6/13] 10.222.0.30 () {54 vars in 930 bytes} [Tue Mar 8 14:43:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:43:59.483410 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi [None req-c92a0b7d-e96b-43a5-9624-12ed6c17d561 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d3", "ram": 2048, "rxtx_factor": 1.0, "name": "ds2G", "disk": 10}} {{(pid=113923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:43:59.503482 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: INFO nova.api.openstack.requestlog [None req-c92a0b7d-e96b-43a5-9624-12ed6c17d561 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072485 Mar 08 14:43:59.504092 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: [pid: 113923|app: 0|req: 8/14] 10.222.0.30 () {64 vars in 1282 bytes} [Tue Mar 8 14:43:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:43:59.516629 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi [None req-c109a99c-ebdc-448f-bbd6-4c85b4c8535f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:43:59.538845 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: INFO nova.api.openstack.requestlog [None req-c109a99c-ebdc-448f-bbd6-4c85b4c8535f admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025995 Mar 08 14:43:59.539431 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: [pid: 113924|app: 0|req: 7/15] 10.222.0.30 () {64 vars in 1335 bytes} [Tue Mar 8 14:43:59 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:44:01.929594 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi [None req-c92a0b7d-e96b-43a5-9624-12ed6c17d561 admin admin] Calling method '>' {{(pid=113923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:44:01.930819 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: INFO nova.api.openstack.requestlog [None req-c92a0b7d-e96b-43a5-9624-12ed6c17d561 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001716 Mar 08 14:44:01.931221 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: [pid: 113923|app: 0|req: 9/16] 10.222.0.30 () {54 vars in 930 bytes} [Tue Mar 8 14:44:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:44:01.997046 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi [None req-232863aa-8bfd-4438-9e88-4886c0f3396f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "name": "ds4G", "id": "d4", "vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20}} {{(pid=113924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:44:02.016372 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: INFO nova.api.openstack.requestlog [None req-232863aa-8bfd-4438-9e88-4886c0f3396f admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076719 Mar 08 14:44:02.017085 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: [pid: 113924|app: 0|req: 8/17] 10.222.0.30 () {64 vars in 1282 bytes} [Tue Mar 8 14:44:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:44:02.029005 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi [None req-a982d435-532a-4d4d-be7c-49840b03f0dd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:44:02.054847 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: INFO nova.api.openstack.requestlog [None req-a982d435-532a-4d4d-be7c-49840b03f0dd admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029854 Mar 08 14:44:02.055973 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: [pid: 113923|app: 0|req: 10/18] 10.222.0.30 () {64 vars in 1335 bytes} [Tue Mar 8 14:44:02 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:44:04.492578 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi [None req-232863aa-8bfd-4438-9e88-4886c0f3396f admin admin] Calling method '>' {{(pid=113924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:44:04.493579 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: INFO nova.api.openstack.requestlog [None req-232863aa-8bfd-4438-9e88-4886c0f3396f admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Mar 08 14:44:04.494012 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: [pid: 113924|app: 0|req: 9/19] 10.222.0.30 () {54 vars in 930 bytes} [Tue Mar 8 14:44:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:44:04.557801 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi [None req-aaf06c97-ee23-4d39-9c15-c04c1420a9f1 admin admin] Calling method '>' {{(pid=113923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:44:04.581157 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: INFO nova.api.openstack.requestlog [None req-aaf06c97-ee23-4d39-9c15-c04c1420a9f1 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.080343 Mar 08 14:44:04.581758 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: [pid: 113923|app: 0|req: 11/20] 10.222.0.30 () {60 vars in 1291 bytes} [Tue Mar 8 14:44:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:44:07.034785 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi [None req-232863aa-8bfd-4438-9e88-4886c0f3396f admin admin] Calling method '>' {{(pid=113924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:44:07.036089 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: INFO nova.api.openstack.requestlog [None req-232863aa-8bfd-4438-9e88-4886c0f3396f admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001825 Mar 08 14:44:07.036587 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: [pid: 113924|app: 0|req: 10/21] 10.222.0.30 () {54 vars in 930 bytes} [Tue Mar 8 14:44:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:44:07.106730 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi [None req-e3bc60e3-b3f5-45c2-9f1f-6e9d3157b3c2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "disk": 1, "vcpus": 1, "os-flavor-access:is_public": true, "name": "m1.tiny", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "swap": 0}} {{(pid=113923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:44:07.129013 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: INFO nova.api.openstack.requestlog [None req-e3bc60e3-b3f5-45c2-9f1f-6e9d3157b3c2 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.085169 Mar 08 14:44:07.129641 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: [pid: 113923|app: 0|req: 12/22] 10.222.0.30 () {64 vars in 1282 bytes} [Tue Mar 8 14:44:07 2022] POST /compute/v2.1/flavors => generated 402 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:44:07.143771 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi [None req-51c77114-b809-4426-85f3-fa8b4b8b139e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:44:07.168939 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: INFO nova.api.openstack.requestlog [None req-51c77114-b809-4426-85f3-fa8b4b8b139e admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029732 Mar 08 14:44:07.169509 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: [pid: 113924|app: 0|req: 11/23] 10.222.0.30 () {64 vars in 1332 bytes} [Tue Mar 8 14:44:07 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:44:09.525409 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi [None req-e3bc60e3-b3f5-45c2-9f1f-6e9d3157b3c2 admin admin] Calling method '>' {{(pid=113923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:44:09.526760 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: INFO nova.api.openstack.requestlog [None req-e3bc60e3-b3f5-45c2-9f1f-6e9d3157b3c2 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001922 Mar 08 14:44:09.527340 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: [pid: 113923|app: 0|req: 13/24] 10.222.0.30 () {54 vars in 930 bytes} [Tue Mar 8 14:44:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:44:09.598548 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi [None req-8a8f4c45-cc6c-4b6f-beeb-d96bf9e460cc admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "rxtx_factor": 1.0, "id": "2", "disk": 20, "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "ram": 2048}} {{(pid=113924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:44:09.619277 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: INFO nova.api.openstack.requestlog [None req-8a8f4c45-cc6c-4b6f-beeb-d96bf9e460cc admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.085812 Mar 08 14:44:09.621459 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: [pid: 113924|app: 0|req: 12/25] 10.222.0.30 () {64 vars in 1282 bytes} [Tue Mar 8 14:44:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:44:09.632198 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi [None req-f8c6a6f4-0ba8-4cce-86b8-2b7a84d89baf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:44:09.654442 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: INFO nova.api.openstack.requestlog [None req-f8c6a6f4-0ba8-4cce-86b8-2b7a84d89baf admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025835 Mar 08 14:44:09.654993 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: [pid: 113923|app: 0|req: 14/26] 10.222.0.30 () {64 vars in 1332 bytes} [Tue Mar 8 14:44:09 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:44:12.120774 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi [None req-8a8f4c45-cc6c-4b6f-beeb-d96bf9e460cc admin admin] Calling method '>' {{(pid=113924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:44:12.121797 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: INFO nova.api.openstack.requestlog [None req-8a8f4c45-cc6c-4b6f-beeb-d96bf9e460cc admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Mar 08 14:44:12.122233 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: [pid: 113924|app: 0|req: 13/27] 10.222.0.30 () {54 vars in 930 bytes} [Tue Mar 8 14:44:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:44:12.179364 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi [None req-a0e11e48-cfab-4bf4-b82d-e902937587b1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 40, "name": "m1.medium", "ram": 4096, "swap": 0, "id": "3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=113923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:44:12.198824 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: INFO nova.api.openstack.requestlog [None req-a0e11e48-cfab-4bf4-b82d-e902937587b1 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.070167 Mar 08 14:44:12.199304 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: [pid: 113923|app: 0|req: 15/28] 10.222.0.30 () {64 vars in 1282 bytes} [Tue Mar 8 14:44:12 2022] POST /compute/v2.1/flavors => generated 406 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:44:12.212287 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi [None req-d645287d-9f63-46d4-8372-e86c1b8c7e61 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:44:12.235784 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: INFO nova.api.openstack.requestlog [None req-d645287d-9f63-46d4-8372-e86c1b8c7e61 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027278 Mar 08 14:44:12.236367 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: [pid: 113924|app: 0|req: 14/29] 10.222.0.30 () {64 vars in 1332 bytes} [Tue Mar 8 14:44:12 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:44:14.592317 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi [None req-a0e11e48-cfab-4bf4-b82d-e902937587b1 admin admin] Calling method '>' {{(pid=113923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:44:14.593612 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: INFO nova.api.openstack.requestlog [None req-a0e11e48-cfab-4bf4-b82d-e902937587b1 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001588 Mar 08 14:44:14.594189 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: [pid: 113923|app: 0|req: 16/30] 10.222.0.30 () {54 vars in 930 bytes} [Tue Mar 8 14:44:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:44:14.660321 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi [None req-6f871978-2c1e-4084-8b9e-4f8c253648cc admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "4", "vcpus": 4, "disk": 80, "ram": 8192}} {{(pid=113924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:44:14.680956 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: INFO nova.api.openstack.requestlog [None req-6f871978-2c1e-4084-8b9e-4f8c253648cc admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.080875 Mar 08 14:44:14.681918 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: [pid: 113924|app: 0|req: 15/31] 10.222.0.30 () {64 vars in 1282 bytes} [Tue Mar 8 14:44:14 2022] POST /compute/v2.1/flavors => generated 405 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:44:14.696155 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi [None req-e4c3f3ba-4cc9-471d-b390-fe91a22cdad3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:44:14.721816 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: INFO nova.api.openstack.requestlog [None req-e4c3f3ba-4cc9-471d-b390-fe91a22cdad3 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029925 Mar 08 14:44:14.722438 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: [pid: 113923|app: 0|req: 17/32] 10.222.0.30 () {64 vars in 1332 bytes} [Tue Mar 8 14:44:14 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:44:17.201399 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi [None req-6f871978-2c1e-4084-8b9e-4f8c253648cc admin admin] Calling method '>' {{(pid=113924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:44:17.203199 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: INFO nova.api.openstack.requestlog [None req-6f871978-2c1e-4084-8b9e-4f8c253648cc admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002560 Mar 08 14:44:17.203885 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: [pid: 113924|app: 0|req: 16/33] 10.222.0.30 () {54 vars in 930 bytes} [Tue Mar 8 14:44:17 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:44:17.264073 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi [None req-f981a573-8af7-4fd3-bbdc-d6ee49f67f51 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "vcpus": 8, "name": "m1.xlarge", "disk": 160, "os-flavor-access:is_public": true, "ram": 16384, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=113923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:44:17.281924 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: INFO nova.api.openstack.requestlog [None req-f981a573-8af7-4fd3-bbdc-d6ee49f67f51 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.071869 Mar 08 14:44:17.282468 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: [pid: 113923|app: 0|req: 18/34] 10.222.0.30 () {64 vars in 1282 bytes} [Tue Mar 8 14:44:17 2022] POST /compute/v2.1/flavors => generated 408 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:44:17.293920 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi [None req-a462c290-f71b-4204-bd8d-1ca3bad22b79 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:44:17.319736 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: INFO nova.api.openstack.requestlog [None req-a462c290-f71b-4204-bd8d-1ca3bad22b79 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029330 Mar 08 14:44:17.320317 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: [pid: 113924|app: 0|req: 17/35] 10.222.0.30 () {64 vars in 1332 bytes} [Tue Mar 8 14:44:17 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:44:40.378717 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi [None req-f981a573-8af7-4fd3-bbdc-d6ee49f67f51 admin admin] Calling method '>' {{(pid=113923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:44:40.379710 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: INFO nova.api.openstack.requestlog [None req-f981a573-8af7-4fd3-bbdc-d6ee49f67f51 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Mar 08 14:44:40.380103 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: [pid: 113923|app: 0|req: 19/36] 10.222.0.30 () {54 vars in 930 bytes} [Tue Mar 8 14:44:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:44:40.437998 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi [None req-e73e23de-ccf2-4b74-b9fa-551392d75941 admin admin] Calling method '>' {{(pid=113924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:44:40.455114 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: INFO nova.api.openstack.requestlog [None req-e73e23de-ccf2-4b74-b9fa-551392d75941 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069426 Mar 08 14:44:40.455636 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: [pid: 113924|app: 0|req: 18/37] 10.222.0.30 () {60 vars in 1291 bytes} [Tue Mar 8 14:44:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 14:44:41.827404 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi [None req-f981a573-8af7-4fd3-bbdc-d6ee49f67f51 admin admin] Calling method '>' {{(pid=113923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:44:41.828542 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: INFO nova.api.openstack.requestlog [None req-f981a573-8af7-4fd3-bbdc-d6ee49f67f51 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 Mar 08 14:44:41.828935 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: [pid: 113923|app: 0|req: 20/38] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Mar 8 14:44:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:44:42.042678 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi [None req-0ef60289-2446-41df-a9e2-93b28ae72921 admin admin] Calling method '>' {{(pid=113924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:44:42.048708 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: INFO nova.api.openstack.wsgi [None req-0ef60289-2446-41df-a9e2-93b28ae72921 admin admin] HTTP exception thrown: Flavor 42 could not be found. Mar 08 14:44:42.049288 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi [None req-0ef60289-2446-41df-a9e2-93b28ae72921 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=113924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 14:44:42.050118 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: INFO nova.api.openstack.requestlog [None req-0ef60289-2446-41df-a9e2-93b28ae72921 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.057329 Mar 08 14:44:42.050624 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: [pid: 113924|app: 0|req: 19/39] 10.222.0.30 () {60 vars in 1190 bytes} [Tue Mar 8 14:44:41 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 08 14:44:42.060065 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi [None req-fe3a7b97-8350-4b63-867a-cbcc8dba0350 admin admin] Calling method '>' {{(pid=113923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:44:42.080770 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: INFO nova.api.openstack.requestlog [None req-fe3a7b97-8350-4b63-867a-cbcc8dba0350 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024365 Mar 08 14:44:42.081290 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: [pid: 113923|app: 0|req: 21/40] 10.222.0.30 () {60 vars in 1210 bytes} [Tue Mar 8 14:44:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 14:44:42.090738 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi [None req-c7d1ba22-bd6d-4901-8b3e-e168bf4dffed admin admin] Calling method '>' {{(pid=113924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:44:42.112308 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: INFO nova.api.openstack.requestlog [None req-c7d1ba22-bd6d-4901-8b3e-e168bf4dffed admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025117 Mar 08 14:44:42.112842 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: [pid: 113924|app: 0|req: 20/41] 10.222.0.30 () {60 vars in 1210 bytes} [Tue Mar 8 14:44:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:44:42.121976 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi [None req-52a47f70-be27-4074-a384-41fa2f6ac19c admin admin] Calling method '>' {{(pid=113923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:44:42.127909 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: INFO nova.api.openstack.wsgi [None req-52a47f70-be27-4074-a384-41fa2f6ac19c admin admin] HTTP exception thrown: Flavor 42 could not be found. Mar 08 14:44:42.128480 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi [None req-52a47f70-be27-4074-a384-41fa2f6ac19c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=113923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 14:44:42.129263 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: INFO nova.api.openstack.requestlog [None req-52a47f70-be27-4074-a384-41fa2f6ac19c admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010892 Mar 08 14:44:42.129750 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: [pid: 113923|app: 0|req: 22/42] 10.222.0.30 () {60 vars in 1190 bytes} [Tue Mar 8 14:44:42 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 08 14:44:43.398078 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi [None req-c7d1ba22-bd6d-4901-8b3e-e168bf4dffed admin admin] Calling method '>' {{(pid=113924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:44:43.399103 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: INFO nova.api.openstack.requestlog [None req-c7d1ba22-bd6d-4901-8b3e-e168bf4dffed admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Mar 08 14:44:43.399541 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: [pid: 113924|app: 0|req: 21/43] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Mar 8 14:44:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:44:43.588355 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi [None req-5bfa962e-2484-4bab-95fa-4f3d265c4962 admin admin] Calling method '>' {{(pid=113923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:44:43.594385 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: INFO nova.api.openstack.wsgi [None req-5bfa962e-2484-4bab-95fa-4f3d265c4962 admin admin] HTTP exception thrown: Flavor 84 could not be found. Mar 08 14:44:43.594947 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi [None req-5bfa962e-2484-4bab-95fa-4f3d265c4962 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=113923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 14:44:43.595736 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: INFO nova.api.openstack.requestlog [None req-5bfa962e-2484-4bab-95fa-4f3d265c4962 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.057934 Mar 08 14:44:43.596234 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: [pid: 113923|app: 0|req: 23/44] 10.222.0.30 () {60 vars in 1190 bytes} [Tue Mar 8 14:44:43 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 08 14:44:43.605424 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi [None req-843f1cda-9962-4e8f-ae2f-b01b74ee8046 admin admin] Calling method '>' {{(pid=113924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:44:43.619177 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: INFO nova.api.openstack.requestlog [None req-843f1cda-9962-4e8f-ae2f-b01b74ee8046 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017312 Mar 08 14:44:43.619693 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: [pid: 113924|app: 0|req: 22/45] 10.222.0.30 () {60 vars in 1210 bytes} [Tue Mar 8 14:44:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:44:43.628993 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi [None req-91410bd6-e9e2-4322-ba0e-80cd7b8244bb admin admin] Calling method '>' {{(pid=113923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:44:43.642491 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: INFO nova.api.openstack.requestlog [None req-91410bd6-e9e2-4322-ba0e-80cd7b8244bb admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017105 Mar 08 14:44:43.643012 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: [pid: 113923|app: 0|req: 24/46] 10.222.0.30 () {60 vars in 1210 bytes} [Tue Mar 8 14:44:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 14:44:43.651935 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi [None req-bdc2295c-ef35-42fd-aa18-7ac18013007f admin admin] Calling method '>' {{(pid=113924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:44:43.657477 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: INFO nova.api.openstack.wsgi [None req-bdc2295c-ef35-42fd-aa18-7ac18013007f admin admin] HTTP exception thrown: Flavor 84 could not be found. Mar 08 14:44:43.658143 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi [None req-bdc2295c-ef35-42fd-aa18-7ac18013007f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=113924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 14:44:43.659895 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: INFO nova.api.openstack.requestlog [None req-bdc2295c-ef35-42fd-aa18-7ac18013007f admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010493 Mar 08 14:44:43.660413 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: [pid: 113924|app: 0|req: 23/47] 10.222.0.30 () {60 vars in 1190 bytes} [Tue Mar 8 14:44:43 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 08 14:44:44.960027 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi [None req-91410bd6-e9e2-4322-ba0e-80cd7b8244bb admin admin] Calling method '>' {{(pid=113923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:44:44.961039 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: INFO nova.api.openstack.requestlog [None req-91410bd6-e9e2-4322-ba0e-80cd7b8244bb admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Mar 08 14:44:44.961421 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: [pid: 113923|app: 0|req: 25/48] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Mar 8 14:44:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:44:45.149974 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi [None req-395d5f79-fc1a-43c3-a028-1fccf4941742 admin admin] Calling method '>' {{(pid=113924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:44:45.155861 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: INFO nova.api.openstack.wsgi [None req-395d5f79-fc1a-43c3-a028-1fccf4941742 admin admin] HTTP exception thrown: Flavor 451 could not be found. Mar 08 14:44:45.156858 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi [None req-395d5f79-fc1a-43c3-a028-1fccf4941742 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=113924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 14:44:45.157647 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: INFO nova.api.openstack.requestlog [None req-395d5f79-fc1a-43c3-a028-1fccf4941742 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058378 Mar 08 14:44:45.158180 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: [pid: 113924|app: 0|req: 24/49] 10.222.0.30 () {60 vars in 1193 bytes} [Tue Mar 8 14:44:45 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 08 14:44:45.167473 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi [None req-83392064-1ce7-44a2-88bb-531edcf5cd2c admin admin] Calling method '>' {{(pid=113923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:44:45.181366 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: INFO nova.api.openstack.requestlog [None req-83392064-1ce7-44a2-88bb-531edcf5cd2c admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017412 Mar 08 14:44:45.181897 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: [pid: 113923|app: 0|req: 26/50] 10.222.0.30 () {60 vars in 1210 bytes} [Tue Mar 8 14:44:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:44:45.193077 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi [None req-4f49f3ef-fbd3-4426-9c4a-b4ad2eb425d0 admin admin] Calling method '>' {{(pid=113924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:44:45.206696 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: INFO nova.api.openstack.requestlog [None req-4f49f3ef-fbd3-4426-9c4a-b4ad2eb425d0 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018764 Mar 08 14:44:45.207217 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: [pid: 113924|app: 0|req: 25/51] 10.222.0.30 () {60 vars in 1210 bytes} [Tue Mar 8 14:44:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:44:45.216198 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi [None req-0cfc18b8-6d0d-4b47-a0ad-7eb51ffae73a admin admin] Calling method '>' {{(pid=113923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:44:45.222273 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: INFO nova.api.openstack.wsgi [None req-0cfc18b8-6d0d-4b47-a0ad-7eb51ffae73a admin admin] HTTP exception thrown: Flavor 451 could not be found. Mar 08 14:44:45.222835 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi [None req-0cfc18b8-6d0d-4b47-a0ad-7eb51ffae73a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=113923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 14:44:45.223611 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: INFO nova.api.openstack.requestlog [None req-0cfc18b8-6d0d-4b47-a0ad-7eb51ffae73a admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010937 Mar 08 14:44:45.224093 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: [pid: 113923|app: 0|req: 27/52] 10.222.0.30 () {60 vars in 1193 bytes} [Tue Mar 8 14:44:45 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 08 14:44:46.498033 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi [None req-4f49f3ef-fbd3-4426-9c4a-b4ad2eb425d0 admin admin] Calling method '>' {{(pid=113924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:44:46.499230 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: INFO nova.api.openstack.requestlog [None req-4f49f3ef-fbd3-4426-9c4a-b4ad2eb425d0 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Mar 08 14:44:46.499550 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: [pid: 113924|app: 0|req: 26/53] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Mar 8 14:44:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:44:46.684999 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi [None req-da5b93aa-39ed-49ea-a342-d5752d5fb6d6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=113923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:44:46.708439 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: INFO nova.api.openstack.requestlog [None req-da5b93aa-39ed-49ea-a342-d5752d5fb6d6 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.073302 Mar 08 14:44:46.708900 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: [pid: 113923|app: 0|req: 28/54] 10.222.0.30 () {64 vars in 1235 bytes} [Tue Mar 8 14:44:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:44:47.972106 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi [None req-4f49f3ef-fbd3-4426-9c4a-b4ad2eb425d0 admin admin] Calling method '>' {{(pid=113924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:44:47.973094 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: INFO nova.api.openstack.requestlog [None req-4f49f3ef-fbd3-4426-9c4a-b4ad2eb425d0 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001389 Mar 08 14:44:47.973487 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: [pid: 113924|app: 0|req: 27/55] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Mar 8 14:44:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:44:48.164904 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi [None req-4ff5e78f-67c9-4784-ae43-1e8a804e91df admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=113923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:44:48.181990 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: INFO nova.api.openstack.requestlog [None req-4ff5e78f-67c9-4784-ae43-1e8a804e91df admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.067366 Mar 08 14:44:48.182521 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: [pid: 113923|app: 0|req: 29/56] 10.222.0.30 () {64 vars in 1235 bytes} [Tue Mar 8 14:44:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:44:49.454841 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi [None req-4f49f3ef-fbd3-4426-9c4a-b4ad2eb425d0 admin admin] Calling method '>' {{(pid=113924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:44:49.455862 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: INFO nova.api.openstack.requestlog [None req-4f49f3ef-fbd3-4426-9c4a-b4ad2eb425d0 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Mar 08 14:44:49.456303 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: [pid: 113924|app: 0|req: 28/57] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Mar 8 14:44:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:44:49.644809 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi [None req-328e8c55-7a59-4bc7-9195-9701c5f6c53c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=113923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:44:49.661482 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: INFO nova.api.openstack.requestlog [None req-328e8c55-7a59-4bc7-9195-9701c5f6c53c admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.067031 Mar 08 14:44:49.662031 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: [pid: 113923|app: 0|req: 30/58] 10.222.0.30 () {64 vars in 1235 bytes} [Tue Mar 8 14:44:49 2022] POST /compute/v2.1/flavors => generated 407 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:44:50.932335 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi [None req-4f49f3ef-fbd3-4426-9c4a-b4ad2eb425d0 admin admin] Calling method '>' {{(pid=113924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:44:50.933333 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: INFO nova.api.openstack.requestlog [None req-4f49f3ef-fbd3-4426-9c4a-b4ad2eb425d0 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001399 Mar 08 14:44:50.933727 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: [pid: 113924|app: 0|req: 29/59] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Mar 8 14:44:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:44:51.124420 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi [None req-a3cf0bda-ad8c-4781-8cee-14dfc28745a5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=113923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:44:51.142067 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: INFO nova.api.openstack.requestlog [None req-a3cf0bda-ad8c-4781-8cee-14dfc28745a5 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069738 Mar 08 14:44:51.142611 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: [pid: 113923|app: 0|req: 31/60] 10.222.0.30 () {64 vars in 1235 bytes} [Tue Mar 8 14:44:51 2022] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:44:52.407567 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi [None req-4f49f3ef-fbd3-4426-9c4a-b4ad2eb425d0 admin admin] Calling method '>' {{(pid=113924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:44:52.408562 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: INFO nova.api.openstack.requestlog [None req-4f49f3ef-fbd3-4426-9c4a-b4ad2eb425d0 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Mar 08 14:44:52.408952 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: [pid: 113924|app: 0|req: 30/61] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Mar 8 14:44:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:44:52.601610 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi [None req-7b248c01-ef87-4eb3-bc84-ac77dcd3c3c4 admin admin] Calling method '>' {{(pid=113923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:44:52.621097 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: INFO nova.api.openstack.requestlog [None req-7b248c01-ef87-4eb3-bc84-ac77dcd3c3c4 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069675 Mar 08 14:44:52.621564 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: [pid: 113923|app: 0|req: 32/62] 10.222.0.30 () {60 vars in 1202 bytes} [Tue Mar 8 14:44:52 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:45:43.350662 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi [None req-4f49f3ef-fbd3-4426-9c4a-b4ad2eb425d0 admin admin] Calling method '>' {{(pid=113924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:45:43.351660 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: INFO nova.api.openstack.requestlog [None req-4f49f3ef-fbd3-4426-9c4a-b4ad2eb425d0 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Mar 08 14:45:43.352053 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: [pid: 113924|app: 0|req: 31/63] 10.222.0.30 () {54 vars in 930 bytes} [Tue Mar 8 14:45:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:45:43.408958 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi [None req-77ab8073-6047-4107-9527-120ad5541764 admin admin] Calling method '>' {{(pid=113923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:45:43.428062 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: INFO nova.api.openstack.requestlog [None req-77ab8073-6047-4107-9527-120ad5541764 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.069895 Mar 08 14:45:43.428583 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: [pid: 113923|app: 0|req: 33/64] 10.222.0.30 () {60 vars in 1291 bytes} [Tue Mar 8 14:45:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:45:43.450341 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi [None req-2d037589-5ec1-4335-9c37-023d1c566710 admin admin] Calling method '>' {{(pid=113924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:45:43.457942 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: INFO nova.api.openstack.requestlog [None req-2d037589-5ec1-4335-9c37-023d1c566710 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011122 Mar 08 14:45:43.458454 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: [pid: 113924|app: 0|req: 32/65] 10.222.0.30 () {60 vars in 1282 bytes} [Tue Mar 8 14:45:43 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:45:43.469844 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi [None req-c8c712b5-6d8c-49e2-ad9a-d5b5e86d6bc6 admin admin] Calling method '>' {{(pid=113923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:45:43.477104 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: INFO nova.api.openstack.requestlog [None req-c8c712b5-6d8c-49e2-ad9a-d5b5e86d6bc6 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011289 Mar 08 14:45:43.477603 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: [pid: 113923|app: 0|req: 34/66] 10.222.0.30 () {60 vars in 1285 bytes} [Tue Mar 8 14:45:43 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:45:43.488889 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi [None req-cf8e36ca-f23f-432a-8330-183b0f3a5ae4 admin admin] Calling method '>' {{(pid=113924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:45:43.496192 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: INFO nova.api.openstack.requestlog [None req-cf8e36ca-f23f-432a-8330-183b0f3a5ae4 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010727 Mar 08 14:45:43.496707 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: [pid: 113924|app: 0|req: 33/67] 10.222.0.30 () {60 vars in 1285 bytes} [Tue Mar 8 14:45:43 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:45:43.507397 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi [None req-2eb7c8dd-18bc-430e-b6a5-5def03f73d61 admin admin] Calling method '>' {{(pid=113923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:45:43.515009 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: INFO nova.api.openstack.requestlog [None req-2eb7c8dd-18bc-430e-b6a5-5def03f73d61 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011114 Mar 08 14:45:43.515520 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: [pid: 113923|app: 0|req: 35/68] 10.222.0.30 () {60 vars in 1282 bytes} [Tue Mar 8 14:45:43 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:47:21.763678 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi [None req-011063db-0290-41b1-a4d4-2ad68d76fdff tempest-verify_tempest_config-51451189 tempest-verify_tempest_config-51451189-project] Calling method '>' {{(pid=113924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:47:21.765677 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: INFO nova.api.openstack.requestlog [None req-011063db-0290-41b1-a4d4-2ad68d76fdff tempest-verify_tempest_config-51451189 tempest-verify_tempest_config-51451189-project] 10.222.0.30 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.108599 Mar 08 14:47:21.766235 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: [pid: 113924|app: 0|req: 34/69] 10.222.0.30 () {58 vars in 1133 bytes} [Tue Mar 8 14:47:21 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:48:56.721262 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi [None req-2eb7c8dd-18bc-430e-b6a5-5def03f73d61 admin admin] Calling method '>' {{(pid=113923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:48:56.722307 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: INFO nova.api.openstack.requestlog [None req-2eb7c8dd-18bc-430e-b6a5-5def03f73d61 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Mar 08 14:48:56.722701 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: [pid: 113923|app: 0|req: 36/70] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Mar 8 14:48:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:48:56.985433 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi [None req-1619f8e2-a138-463f-a800-3350cec64fde admin admin] Calling method '>' {{(pid=113924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:48:56.986685 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 14:48:56.986685 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: warnings.warn(msg) Mar 08 14:48:56.987905 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG oslo_concurrency.lockutils [None req-1619f8e2-a138-463f-a800-3350cec64fde admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:48:56.988360 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG oslo_concurrency.lockutils [None req-1619f8e2-a138-463f-a800-3350cec64fde admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:48:56.989171 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG oslo_concurrency.lockutils [None req-1619f8e2-a138-463f-a800-3350cec64fde admin admin] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:48:56.989598 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG oslo_concurrency.lockutils [None req-1619f8e2-a138-463f-a800-3350cec64fde admin admin] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:48:57.026275 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: INFO nova.api.openstack.requestlog [None req-1619f8e2-a138-463f-a800-3350cec64fde admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.158950 Mar 08 14:48:57.026834 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: [pid: 113924|app: 0|req: 35/71] 10.222.0.30 () {60 vars in 1193 bytes} [Tue Mar 8 14:48:56 2022] GET /compute/v2.1/os-services => generated 791 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:48:58.344800 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi [None req-2eb7c8dd-18bc-430e-b6a5-5def03f73d61 admin admin] Calling method '>' {{(pid=113923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:48:58.345793 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: INFO nova.api.openstack.requestlog [None req-2eb7c8dd-18bc-430e-b6a5-5def03f73d61 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Mar 08 14:48:58.346220 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: [pid: 113923|app: 0|req: 37/72] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Mar 8 14:48:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:48:58.537383 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi [None req-09b417c8-5756-403f-b260-ea58b493f784 admin admin] Calling method '>' {{(pid=113924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:48:58.538583 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 14:48:58.538583 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: warnings.warn(msg) Mar 08 14:48:58.540507 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG oslo_concurrency.lockutils [None req-09b417c8-5756-403f-b260-ea58b493f784 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:48:58.541038 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG oslo_concurrency.lockutils [None req-09b417c8-5756-403f-b260-ea58b493f784 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:48:58.541829 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG oslo_concurrency.lockutils [None req-09b417c8-5756-403f-b260-ea58b493f784 admin admin] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:48:58.542287 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG oslo_concurrency.lockutils [None req-09b417c8-5756-403f-b260-ea58b493f784 admin admin] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:48:58.561216 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: INFO nova.api.openstack.requestlog [None req-09b417c8-5756-403f-b260-ea58b493f784 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074978 Mar 08 14:48:58.561696 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: [pid: 113924|app: 0|req: 36/73] 10.222.0.30 () {60 vars in 1193 bytes} [Tue Mar 8 14:48:58 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:49:10.231863 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi [None req-2eb7c8dd-18bc-430e-b6a5-5def03f73d61 admin admin] Calling method '>' {{(pid=113923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:49:10.232851 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: INFO nova.api.openstack.requestlog [None req-2eb7c8dd-18bc-430e-b6a5-5def03f73d61 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Mar 08 14:49:10.233246 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: [pid: 113923|app: 0|req: 38/74] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Mar 8 14:49:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:49:10.422693 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi [None req-4001ca13-e42d-42b0-9046-7e8b030dbeb7 admin admin] Calling method '>' {{(pid=113924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:49:10.423851 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 14:49:10.423851 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: warnings.warn(msg) Mar 08 14:49:10.425033 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG oslo_concurrency.lockutils [None req-4001ca13-e42d-42b0-9046-7e8b030dbeb7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:49:10.425476 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG oslo_concurrency.lockutils [None req-4001ca13-e42d-42b0-9046-7e8b030dbeb7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:49:10.426293 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG oslo_concurrency.lockutils [None req-4001ca13-e42d-42b0-9046-7e8b030dbeb7 admin admin] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:49:10.426719 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG oslo_concurrency.lockutils [None req-4001ca13-e42d-42b0-9046-7e8b030dbeb7 admin admin] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:49:10.451938 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: INFO nova.api.openstack.requestlog [None req-4001ca13-e42d-42b0-9046-7e8b030dbeb7 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079863 Mar 08 14:49:10.452410 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: [pid: 113924|app: 0|req: 37/75] 10.222.0.30 () {60 vars in 1193 bytes} [Tue Mar 8 14:49:10 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:49:11.719407 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: DEBUG nova.api.openstack.wsgi [None req-2eb7c8dd-18bc-430e-b6a5-5def03f73d61 admin admin] Calling method '>' {{(pid=113923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:49:11.720400 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: INFO nova.api.openstack.requestlog [None req-2eb7c8dd-18bc-430e-b6a5-5def03f73d61 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Mar 08 14:49:11.720795 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: [pid: 113923|app: 0|req: 39/76] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Mar 8 14:49:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:49:11.912098 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG nova.api.openstack.wsgi [None req-2679afb1-7b9f-4668-aecd-021d0da10175 admin admin] Calling method '>' {{(pid=113924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:49:11.913265 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 14:49:11.913265 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: warnings.warn(msg) Mar 08 14:49:11.915083 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG oslo_concurrency.lockutils [None req-2679afb1-7b9f-4668-aecd-021d0da10175 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:49:11.915523 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG oslo_concurrency.lockutils [None req-2679afb1-7b9f-4668-aecd-021d0da10175 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:49:11.916306 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG oslo_concurrency.lockutils [None req-2679afb1-7b9f-4668-aecd-021d0da10175 admin admin] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:49:11.916756 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: DEBUG oslo_concurrency.lockutils [None req-2679afb1-7b9f-4668-aecd-021d0da10175 admin admin] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:49:11.937510 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: INFO nova.api.openstack.requestlog [None req-2679afb1-7b9f-4668-aecd-021d0da10175 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.075536 Mar 08 14:49:11.938011 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: [pid: 113924|app: 0|req: 38/77] 10.222.0.30 () {60 vars in 1193 bytes} [Tue Mar 8 14:49:11 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:50:12.674105 dv-cinder-830095-2-iscsi devstack@n-api.service[113922]: Tue Mar 8 14:50:12 2022 - graceful shutdown triggered... Mar 08 14:50:12.674340 dv-cinder-830095-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Mar 08 14:50:12.675104 dv-cinder-830095-2-iscsi devstack@n-api.service[113924]: Gracefully killing worker 2 (pid: 113924)... Mar 08 14:50:12.675935 dv-cinder-830095-2-iscsi devstack@n-api.service[113923]: Gracefully killing worker 1 (pid: 113923)... Mar 08 14:50:13.675325 dv-cinder-830095-2-iscsi devstack@n-api.service[113922]: worker 1 buried after 1 seconds Mar 08 14:50:13.675325 dv-cinder-830095-2-iscsi devstack@n-api.service[113922]: worker 2 buried after 1 seconds Mar 08 14:50:13.675325 dv-cinder-830095-2-iscsi devstack@n-api.service[113922]: goodbye to uWSGI. Mar 08 14:50:13.676896 dv-cinder-830095-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Mar 08 14:50:13.677472 dv-cinder-830095-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Mar 08 14:50:13.680850 dv-cinder-830095-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Mar 08 14:50:13.698472 dv-cinder-830095-2-iscsi devstack@n-api.service[128339]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Mar 08 14:50:13.719240 dv-cinder-830095-2-iscsi devstack@n-api.service[128339]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Mar 8 14:50:13 2022] *** Mar 08 14:50:13.719240 dv-cinder-830095-2-iscsi devstack@n-api.service[128339]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Mar 08 14:50:13.719240 dv-cinder-830095-2-iscsi devstack@n-api.service[128339]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Mar 08 14:50:13.719240 dv-cinder-830095-2-iscsi devstack@n-api.service[128339]: nodename: dv-cinder-830095-2-iscsi Mar 08 14:50:13.719240 dv-cinder-830095-2-iscsi devstack@n-api.service[128339]: machine: x86_64 Mar 08 14:50:13.719240 dv-cinder-830095-2-iscsi devstack@n-api.service[128339]: clock source: unix Mar 08 14:50:13.719240 dv-cinder-830095-2-iscsi devstack@n-api.service[128339]: pcre jit disabled Mar 08 14:50:13.719240 dv-cinder-830095-2-iscsi devstack@n-api.service[128339]: detected number of CPU cores: 4 Mar 08 14:50:13.719240 dv-cinder-830095-2-iscsi devstack@n-api.service[128339]: current working directory: / Mar 08 14:50:13.719240 dv-cinder-830095-2-iscsi devstack@n-api.service[128339]: detected binary path: /usr/bin/uwsgi-core Mar 08 14:50:13.719240 dv-cinder-830095-2-iscsi devstack@n-api.service[128339]: your processes number limit is 47680 Mar 08 14:50:13.719240 dv-cinder-830095-2-iscsi devstack@n-api.service[128339]: your memory page size is 4096 bytes Mar 08 14:50:13.719240 dv-cinder-830095-2-iscsi devstack@n-api.service[128339]: detected max file descriptor number: 2048 Mar 08 14:50:13.719240 dv-cinder-830095-2-iscsi devstack@n-api.service[128339]: lock engine: pthread robust mutexes Mar 08 14:50:13.720439 dv-cinder-830095-2-iscsi devstack@n-api.service[128339]: thunder lock: enabled Mar 08 14:50:13.720439 dv-cinder-830095-2-iscsi devstack@n-api.service[128339]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Mar 08 14:50:13.720439 dv-cinder-830095-2-iscsi devstack@n-api.service[128339]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Mar 08 14:50:13.765575 dv-cinder-830095-2-iscsi devstack@n-api.service[128339]: Python main interpreter initialized at 0x5634e0a169c0 Mar 08 14:50:13.765575 dv-cinder-830095-2-iscsi devstack@n-api.service[128339]: python threads support enabled Mar 08 14:50:13.765575 dv-cinder-830095-2-iscsi devstack@n-api.service[128339]: your server socket listen backlog is limited to 100 connections Mar 08 14:50:13.765575 dv-cinder-830095-2-iscsi devstack@n-api.service[128339]: your mercy for graceful operations on workers is 90 seconds Mar 08 14:50:13.765982 dv-cinder-830095-2-iscsi devstack@n-api.service[128339]: mapped 403077 bytes (393 KB) for 2 cores Mar 08 14:50:13.766062 dv-cinder-830095-2-iscsi devstack@n-api.service[128339]: *** Operational MODE: preforking *** Mar 08 14:50:13.766269 dv-cinder-830095-2-iscsi devstack@n-api.service[128339]: *** uWSGI is running in multiple interpreter mode *** Mar 08 14:50:13.766269 dv-cinder-830095-2-iscsi devstack@n-api.service[128339]: spawned uWSGI master process (pid: 128339) Mar 08 14:50:13.766450 dv-cinder-830095-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Mar 08 14:50:13.767601 dv-cinder-830095-2-iscsi devstack@n-api.service[128339]: spawned uWSGI worker 1 (pid: 128351, cores: 1) Mar 08 14:50:13.767601 dv-cinder-830095-2-iscsi devstack@n-api.service[128339]: spawned uWSGI worker 2 (pid: 128352, cores: 1) Mar 08 14:50:13.767601 dv-cinder-830095-2-iscsi devstack@n-api.service[128339]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Mar 08 14:50:15.687877 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 14:50:15.687877 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: from cryptography.utils import int_from_bytes Mar 08 14:50:15.688610 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 14:50:15.688610 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: from cryptography.utils import int_from_bytes Mar 08 14:50:15.696520 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 14:50:15.696520 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: from cryptography.utils import int_from_bytes Mar 08 14:50:15.697032 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 14:50:15.697032 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: from cryptography.utils import int_from_bytes Mar 08 14:50:18.110963 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 08 14:50:18.111522 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 08 14:50:18.111742 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 08 14:50:18.112112 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 08 14:50:18.112372 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 08 14:50:18.112765 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.113394 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.113504 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.113741 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.114105 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.114422 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.114749 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.115076 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.115946 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.116212 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.116539 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.116861 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-830095-2-iscsi {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.117192 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.117512 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.117831 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.118187 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.118498 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.118826 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.119138 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.119645 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.120098 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.120413 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.120729 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.121073 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.121394 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.121709 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.122063 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.122381 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.122710 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.123024 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.123428 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-830095-2-iscsi {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.123753 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.124063 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.124385 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.124806 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.125123 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.125435 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.125758 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.126114 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.126429 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.126760 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.127086 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.127414 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.127739 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.128046 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.128360 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.128672 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.128998 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.129306 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.129615 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.129887 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.130205 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.130534 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.131447 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.131809 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.132077 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.132333 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.132658 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.132987 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.133314 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.133585 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 08 14:50:18.134061 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.134180 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 08 14:50:18.134311 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.134311 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.134578 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 08 14:50:18.134696 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.134857 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.134989 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 08 14:50:18.135105 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 08 14:50:18.135230 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.135471 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.135602 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.135794 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.135923 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.136114 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.136253 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.136441 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.136573 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.136753 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.136871 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.137075 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.137205 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.137406 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.137532 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.137730 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.137881 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.138072 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.138201 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.138364 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.138483 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.138690 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.138833 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.139024 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-830095-2-iscsi {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.139145 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.139345 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.139480 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.139660 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.139809 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.139982 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.140131 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.140294 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.140434 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.140599 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.140758 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.140906 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.141086 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.141255 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.141407 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.141566 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.141821 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.142015 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.142162 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.142268 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.142475 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.142583 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.142818 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.142923 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.143120 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.143252 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.143430 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.143578 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.143738 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.143946 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.144050 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.144280 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.144388 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.144607 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.144701 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.144949 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.145053 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.145271 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.145375 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.145583 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.145758 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-830095-2-iscsi {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.146065 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.146165 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.146278 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.146396 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.146626 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.146942 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.147038 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.147360 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.147469 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.147692 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.147795 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.148005 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.148116 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.148317 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.148420 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.148629 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.148733 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.148940 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.149034 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.149265 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.149359 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.149577 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.149684 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.149908 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.150065 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.150240 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.150346 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.150550 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.150659 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.150862 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.150965 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.151184 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.151278 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.151493 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.151666 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.151805 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.151962 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.152123 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.152215 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.152384 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.152496 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.152702 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.152797 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.153030 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.153129 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.153341 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.153443 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.153650 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.153750 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.153949 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.154055 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.154212 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.154307 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.154541 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.154645 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.154878 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.154987 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.155183 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.155286 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.155493 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.155611 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.155796 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.155899 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.156115 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.156245 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.156429 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.156536 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.156742 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.156835 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.157052 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.157154 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.157364 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.157464 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.157685 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.157784 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.158034 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.158140 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.158368 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.158469 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.158685 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.158778 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.159015 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.159115 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.159352 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.159567 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.159719 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.159865 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.160027 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.160189 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.160415 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.160564 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.160657 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.160742 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.160924 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.161067 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.161238 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.161341 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.161556 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.161657 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.161883 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.161990 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.162232 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.162344 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.162550 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.162828 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.162923 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.163182 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.163290 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.163508 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.163608 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.163765 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.163858 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.164074 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.164182 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.164391 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.164494 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.164723 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.164818 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.165038 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.165145 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.165351 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.165455 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.165700 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.165791 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.166040 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.166151 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.166356 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.166535 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.166721 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.166843 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.167038 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.167159 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.167359 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.167574 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.167699 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.167820 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.167973 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.168103 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.168288 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.168415 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.168600 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.168729 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.168914 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.169036 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.169241 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.169361 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.169564 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.169684 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.169902 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.170038 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.170210 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.170339 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.170522 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.170811 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.170946 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.171138 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.171257 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.171452 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.171579 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.171766 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.171892 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.172093 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.172227 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.172465 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.172595 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.173799 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.173984 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.174147 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.174322 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.174470 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.174616 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.174713 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.174810 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.174907 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.175009 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.175107 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.175257 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.175358 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.175447 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.175539 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.175633 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.175729 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.175811 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.175883 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.175962 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.176034 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.176104 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.176182 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.176298 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.176458 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.176687 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.176795 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.176946 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.177052 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.177267 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.177361 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.177576 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.178452 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.178774 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.178937 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.179094 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.179242 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.179433 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.179537 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.179751 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.179855 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.180076 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.180174 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 14:50:18.180399 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.180494 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.180717 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.180855 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.181049 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.181186 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.181369 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.181463 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.181684 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.181820 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.182045 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.182181 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.182359 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.182520 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.182736 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.182837 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.182980 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.183146 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.183292 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.183484 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.183591 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.183806 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.183907 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.184127 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.184222 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.184449 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.184544 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.184777 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.184879 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.185110 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.185216 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.185449 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.185544 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.185778 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.185910 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.186133 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.186245 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.186464 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.186567 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.186829 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.186944 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.187107 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.187212 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.187444 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.187539 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.187777 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.187870 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.188086 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.188240 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.188398 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.188492 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.188710 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.188812 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.189027 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.189133 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.189336 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.189429 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.189646 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.189741 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.190246 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.190350 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.190560 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.190653 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.190869 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.190974 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.191200 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.191302 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.191515 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.191609 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.191827 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.191921 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.192137 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.192231 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.192446 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.192546 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.192794 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.192894 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.193105 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.193206 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.194080 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.194267 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.194430 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.194543 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.194759 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.194862 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.195091 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.195188 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.195410 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.195561 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.195736 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.195879 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.196058 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.196312 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.196464 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.196605 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.196698 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.196792 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.196995 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.197126 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.197322 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.197438 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.197640 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.197740 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.197990 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.198087 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.198309 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.198403 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.198622 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.198716 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.198945 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.199039 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.199272 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.199366 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.199586 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.199694 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.199907 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.200001 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.200228 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.200323 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.200552 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.200646 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.200876 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.200971 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.201196 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.201292 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.201511 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.201604 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.201831 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.201986 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.202169 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.202261 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.202483 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.202576 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.202798 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.202899 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.203114 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.203207 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.203429 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.203571 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.203744 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.203848 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.204063 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.204163 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.204377 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.204473 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.204705 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.204884 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.205019 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.205147 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.205355 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.205456 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.205667 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.205844 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.206017 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.206131 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.206335 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.206456 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.206685 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.206806 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.207151 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.207295 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.207419 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.207532 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.207652 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.207772 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.207936 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.208055 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.208252 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.208371 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.208570 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.208690 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.208880 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.209032 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.209298 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.209494 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.209806 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.209976 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.210092 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.210232 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.210447 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.210584 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.210697 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.210854 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.210983 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.211164 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.211290 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.211477 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.211597 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.211790 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.211916 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.212103 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.212227 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.212442 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.212624 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.212732 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.212821 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.213060 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.213220 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.213380 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.213527 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.213703 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.213802 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.214092 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.214211 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.214379 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.214482 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.214691 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.214844 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.215050 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.215201 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.215352 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.215547 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.215657 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.215875 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.215970 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.216211 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.216314 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.216533 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.216636 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.216861 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.216957 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.217182 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.217345 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.217504 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.217594 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.217881 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.218004 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.218226 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.218414 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.218558 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.218661 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.218876 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.218979 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.219193 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.219287 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.219533 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.219888 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.220013 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.220211 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.220406 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.220712 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.220859 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.221034 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.221138 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.221358 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.221471 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.221676 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.221784 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.222036 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.222223 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.222389 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.222657 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.222947 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.223111 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.223286 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.223440 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.223592 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.223745 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.223960 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.224122 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.224412 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.224609 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.224827 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.225060 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.225208 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.225364 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.225533 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.225685 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.225830 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.226026 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.226172 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.226332 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.226488 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.226623 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.226793 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.226888 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.227173 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.227269 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.227507 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.227601 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.227825 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.227927 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.228135 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.228229 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.228444 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.228538 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.228761 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.228855 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.229071 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.229173 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.229383 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.229477 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.229694 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.229802 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.230036 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.230141 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.230347 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.230448 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.230657 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.230764 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.230967 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.231074 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.231276 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.231370 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.231597 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.231701 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.231907 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.232001 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.232224 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.232317 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.232535 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.232638 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.232855 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.232956 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.233168 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.233314 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.233477 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.233579 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.233787 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.233980 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.234129 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.234235 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.234449 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.234544 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.234765 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.234860 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.235088 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.235193 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.235424 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.235531 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.235743 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.235847 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.236068 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.236168 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.236381 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.236475 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.236699 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.236792 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.237008 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.237113 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.237320 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.237414 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.237627 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.237721 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.237967 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.238078 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.238286 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.238381 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.238592 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.238694 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.238908 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.239021 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.239224 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.239318 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.239540 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.239633 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.239856 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.239958 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.240178 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.240762 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.241005 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.241175 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.241330 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.241551 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.241652 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.241896 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.242005 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.242219 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.242321 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.242531 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.242625 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.242842 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.243025 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.243160 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.243268 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.243475 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.243572 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.243785 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.243929 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.244103 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.244209 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.244412 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.244506 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.244732 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.244824 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.245043 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.245181 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.245354 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.245454 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.245662 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.245755 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.246002 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.246110 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.246319 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.246413 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.246627 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.246893 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.246996 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.247233 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.247328 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.247557 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.247655 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.247887 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.248016 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.248785 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.248964 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.249136 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.249284 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.249442 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.249597 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.249744 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.249937 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.250090 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.250236 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.250395 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.250543 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.250714 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.250871 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.251026 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.251183 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.251336 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.251491 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.251639 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.251794 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.251947 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.252100 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.252246 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.252398 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.252552 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.252552 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.252839 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.252985 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.253140 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.253285 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.253438 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.253594 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.253699 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.253846 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.254017 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.254174 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.254327 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.254437 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.254437 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.254599 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.254878 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.255009 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.255194 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.255326 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.255569 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.255680 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.256469 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.256764 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.256881 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.257109 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.257207 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.257426 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.257518 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.257747 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.257911 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.258093 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.258193 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.258404 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.258511 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.258729 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.258833 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.259045 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.259146 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.259364 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.259456 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.259672 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.259766 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.259983 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.260075 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.260308 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.260418 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.260625 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.260767 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.260942 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.261081 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.261270 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.261402 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.261598 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.261738 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.261951 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.262086 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.262263 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.262395 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.262577 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.262718 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.262889 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.263030 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.263202 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.263356 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.263512 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.263641 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.263892 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.264035 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.264320 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.264523 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.264656 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.264785 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.264913 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.265048 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.265179 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.265371 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.265502 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.265740 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.265949 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.266083 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.266214 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.266356 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.266487 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.266623 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.266753 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.266880 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.267021 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.267159 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.267289 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.267423 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.267552 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.267680 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.267821 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.267957 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.268086 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.268215 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.268381 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.268527 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.268691 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.268823 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.269024 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.269155 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.269345 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.269476 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.270095 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.270260 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.270394 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.270531 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.270660 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.270803 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.270932 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.271068 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.271198 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.271325 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.271525 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.271673 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.271810 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.271939 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.272075 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.272212 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.272348 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.272487 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.272624 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.272783 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.272924 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.273109 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.273242 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.273423 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.273564 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.273744 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.273948 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.274152 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.274441 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.274648 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.274782 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.274917 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.275054 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.275183 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.275407 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.275547 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.275677 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.275677 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.276036 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.276166 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.276303 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.276440 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.276575 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.276704 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.276831 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.277002 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.277127 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.277314 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.277439 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.277651 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.277769 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.277997 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.278132 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.278310 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.278438 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.278668 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.278787 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.278984 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.279101 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.279334 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.279450 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.279648 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.279774 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.279967 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.280092 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.280283 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.280408 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.280606 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.280723 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.280927 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.281044 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.281241 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.281456 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.281595 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.281898 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.282213 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.282547 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.282868 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.283194 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.283616 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.283938 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.284244 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.284576 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.284905 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.285216 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.285525 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.285842 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.286174 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.286302 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.286486 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.286640 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.286814 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.287003 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.287854 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.287980 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.288150 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.288277 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.288552 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.288670 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.288910 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.289029 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.289250 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.289374 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.289565 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.289690 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.290026 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.290183 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.290329 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.290482 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.290640 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.290784 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.290924 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.291064 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.291204 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.291355 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.291583 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.291750 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.291901 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.292085 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.292235 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.292424 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.292582 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.292755 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.292912 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.293087 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.293248 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.293410 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.293556 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.294173 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.294438 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.294772 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.294987 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.295153 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.295298 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.295447 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.295602 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.295829 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.295829 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.296140 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.296140 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.296508 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.296720 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.296894 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.296894 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.297166 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.297308 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.297457 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.297601 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.297752 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.297936 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.298085 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.298227 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.298368 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.298509 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.298669 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.298812 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.298812 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.299087 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.299239 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.299395 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.299538 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.299680 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.299834 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.299976 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.300123 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.300279 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.300429 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.300582 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.300725 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.300874 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.301025 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.301182 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.301324 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.301466 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.301606 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.301748 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.301909 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.301909 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.302197 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.302353 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.302494 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.302635 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.303483 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.303640 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.303797 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.303960 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.304187 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.304338 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.304574 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.304862 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.305040 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.305261 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.305432 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.305583 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.305740 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.305928 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.306080 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.306222 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.306392 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.306626 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.306786 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.306930 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.307084 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.307226 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.307375 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.307545 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.307688 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.307838 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.307987 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.308138 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.308281 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.308431 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.308575 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.308715 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.308862 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.309004 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.309164 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.309747 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.309931 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.310082 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.310227 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.310368 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.310526 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.310683 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.310827 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.310969 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.311120 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.311263 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.311414 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.311556 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.311708 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.311849 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.311991 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.312133 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.312294 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.312449 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.312707 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.312856 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.312998 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.313139 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.313292 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.313437 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.313579 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.313749 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.313956 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.314124 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.314409 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.314575 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.315195 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.315444 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.315598 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.315598 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.315888 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.315888 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.316166 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.316166 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.316469 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.316639 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.316895 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.317126 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.317312 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.317457 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.317647 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.317799 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.317976 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.318121 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.318264 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.318445 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.318600 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.318744 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.318886 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.319035 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.319189 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.319189 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.319470 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.319614 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.319763 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.319906 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.320048 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.320198 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.320363 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.320506 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.320649 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.320791 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.320941 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.321098 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.321242 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.321383 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.321524 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.321666 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.321808 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.322013 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.322168 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.322365 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.322515 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.322715 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.322874 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.323025 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.323168 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.323366 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.323550 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.323741 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.323899 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.324051 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.324191 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.324351 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.324629 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.324869 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.325191 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.325419 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.325577 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.325577 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.325879 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.326043 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.326200 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.326345 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.326498 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.326641 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.326793 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.327053 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.327211 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.327355 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.327497 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.327638 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.327779 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.327930 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.328074 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.328224 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.328374 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.328572 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.328738 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.328899 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.329045 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.329216 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.329365 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.329521 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.329664 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.329847 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.330017 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.330194 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.330343 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.330516 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.330675 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.330829 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.330970 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.331115 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.331265 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.331430 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.331592 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.331737 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.331892 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.332042 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.332194 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.332338 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.332640 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.332957 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.333113 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.333257 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.333399 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.333548 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.333785 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.334130 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.334471 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.334699 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.334849 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.335100 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.335318 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.335551 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.335551 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.336438 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.336595 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.336748 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.336901 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.337071 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.337315 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.337315 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.337603 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.337756 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.337919 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.338077 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.338228 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.338389 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.338535 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.338723 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.338869 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.339011 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.339152 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.339302 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.339459 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.339611 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.339753 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.339895 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.340045 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.340188 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.340348 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.340502 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.340646 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.340795 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.340946 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.341100 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.341257 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.341402 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.341402 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.341671 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.341813 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.341997 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.342152 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.342306 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.342461 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.342604 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.342746 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.342746 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.343031 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.343031 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.343316 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.343458 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.343615 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.343774 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.343925 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.344093 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.344237 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.344388 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.344530 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.344704 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.344916 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.345127 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.345367 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.345657 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.345823 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.346007 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.346152 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.346308 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.346308 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.346589 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.346741 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.346885 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.347028 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.347169 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.347329 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.347562 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.347722 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.347722 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.347994 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.348135 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.348288 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.348439 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.348583 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.348732 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.348875 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.349027 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.349177 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.349366 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.349524 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.350999 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.351288 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.351288 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.351288 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.351736 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.351881 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.352031 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.352185 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.352328 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.352479 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.352622 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.352770 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.352912 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.353054 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.353196 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.353346 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.353505 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.354182 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.354354 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.354511 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.354657 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.354810 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.354810 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.355182 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.355345 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.355556 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.355875 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.356021 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.356183 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.356337 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.356488 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.356631 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.356788 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.356788 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.357067 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.357219 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.357372 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.357515 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.357671 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.358502 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.358682 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.358837 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.358985 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.359138 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.359283 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.359427 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.359577 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.359720 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.359862 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.360018 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.360018 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.360289 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.360449 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.360611 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.360762 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.360915 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.361067 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.361209 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.361351 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.361501 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.361645 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.361645 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.361963 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.362109 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.362260 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.362420 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.362572 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.362724 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.362875 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.363026 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.363026 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.363026 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.363439 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.363589 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.363589 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.363859 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.364002 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.364150 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.364314 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.364457 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.364600 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.364749 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.364892 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.365060 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.366019 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.366019 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.366019 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.366626 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.366626 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.366911 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.367064 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.367219 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.367370 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.367514 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.367514 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.367800 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.367945 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.368088 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.368230 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.368372 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.368540 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.368790 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.368940 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.369093 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.369235 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.369377 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.369533 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.369684 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.369838 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.370007 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.370161 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.370312 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.370464 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.370607 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.370749 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.370891 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.371050 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.371194 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.371350 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.371506 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.371649 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.371790 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.371932 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.372082 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.372235 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.372378 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.372520 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.372662 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.372804 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.372964 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.373116 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.373284 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.373550 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.373708 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.373878 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.373878 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.374176 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.374324 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.374472 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.374615 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.374758 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.374924 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.375068 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.375211 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.375211 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.375577 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.375720 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.375872 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.376101 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.376336 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.376486 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.376639 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.376793 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.376936 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.377095 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.377246 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.377398 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.377541 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.377692 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.377836 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.378026 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.378179 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.378331 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.378474 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.378625 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.378786 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.379034 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.379196 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.379338 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.379482 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.379633 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.379777 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.379919 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.380060 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.380202 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.380352 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.380496 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.380638 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.380780 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.380977 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.381315 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.381478 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.381733 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.381901 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 08 14:50:18.382069 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.382274 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.382624 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.382973 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.383325 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.383645 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.383965 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.384303 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.384627 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.385107 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.385488 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.385756 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.386222 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.386458 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.386784 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.387108 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.387433 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.387791 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.388081 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.388405 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.388796 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.389159 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.389491 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.389823 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.390200 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.390532 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.390856 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.391180 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.391502 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.391826 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.392156 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.392501 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.392828 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.393207 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.393653 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.394011 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.394345 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.394679 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.395123 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.395459 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.395795 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.396119 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.396554 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.396901 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.397353 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.397774 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.398166 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.398509 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.398830 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.399250 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.399469 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.400435 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.400435 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.400435 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.400786 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.401064 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.401403 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.401708 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.402053 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.402375 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.402694 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.403044 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.403332 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.403648 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.403966 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.404281 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.404599 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.404916 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.405395 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.405720 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.406079 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.406398 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.406722 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.407042 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.407397 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.407746 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.408011 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_db.sqlalchemy.engines [None req-44cfa6b4-8ecc-4ca7-b54b-b4f04896b2b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128351) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 14:50:18.408143 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.408396 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.409483 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.409692 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.410058 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.410399 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.410737 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.411073 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.411399 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.411745 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.412644 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.413185 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.413574 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.413953 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.414286 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.414614 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.414962 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.415336 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.415670 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.415995 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.416329 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.416748 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.416986 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.417312 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.417656 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.418007 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.418335 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.418665 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.418993 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.419320 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.419651 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.419980 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.420319 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.420663 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.421002 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.421335 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.421707 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.422051 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.422414 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.422755 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.423083 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.423412 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.423729 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 14:50:18.423982 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 08 14:50:18.447641 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_db.sqlalchemy.engines [None req-ebad6c10-4a69-4ab8-90bb-9d570133687b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128352) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 14:50:18.482485 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.context [None req-44cfa6b4-8ecc-4ca7-b54b-b4f04896b2b8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8d394eb1-87fe-4527-b2a1-ae44ca505941(cell1) {{(pid=128351) load_cells /opt/stack/nova/nova/context.py:464}} Mar 08 14:50:18.487989 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-44cfa6b4-8ecc-4ca7-b54b-b4f04896b2b8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:50:18.489938 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-44cfa6b4-8ecc-4ca7-b54b-b4f04896b2b8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:50:18.491138 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-44cfa6b4-8ecc-4ca7-b54b-b4f04896b2b8 None None] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:50:18.493305 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-44cfa6b4-8ecc-4ca7-b54b-b4f04896b2b8 None None] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:50:18.506486 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_db.sqlalchemy.engines [None req-44cfa6b4-8ecc-4ca7-b54b-b4f04896b2b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128351) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 14:50:18.507863 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_db.sqlalchemy.engines [None req-44cfa6b4-8ecc-4ca7-b54b-b4f04896b2b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128351) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 14:50:18.513027 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.context [None req-ebad6c10-4a69-4ab8-90bb-9d570133687b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8d394eb1-87fe-4527-b2a1-ae44ca505941(cell1) {{(pid=128352) load_cells /opt/stack/nova/nova/context.py:464}} Mar 08 14:50:18.517297 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ebad6c10-4a69-4ab8-90bb-9d570133687b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:50:18.518939 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ebad6c10-4a69-4ab8-90bb-9d570133687b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:50:18.519773 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ebad6c10-4a69-4ab8-90bb-9d570133687b None None] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:50:18.522391 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ebad6c10-4a69-4ab8-90bb-9d570133687b None None] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:50:18.533991 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_db.sqlalchemy.engines [None req-ebad6c10-4a69-4ab8-90bb-9d570133687b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128352) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 14:50:18.536494 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_db.sqlalchemy.engines [None req-ebad6c10-4a69-4ab8-90bb-9d570133687b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128352) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 14:50:18.667186 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_db.sqlalchemy.engines [None req-44cfa6b4-8ecc-4ca7-b54b-b4f04896b2b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128351) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 14:50:18.695791 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_db.sqlalchemy.engines [None req-ebad6c10-4a69-4ab8-90bb-9d570133687b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128352) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 14:50:18.986249 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: WARNING keystonemiddleware.auth_token [None req-44cfa6b4-8ecc-4ca7-b54b-b4f04896b2b8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 08 14:50:19.114332 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: WARNING keystonemiddleware.auth_token [None req-44cfa6b4-8ecc-4ca7-b54b-b4f04896b2b8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 08 14:50:19.128628 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: WARNING keystonemiddleware.auth_token [None req-ebad6c10-4a69-4ab8-90bb-9d570133687b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 08 14:50:19.135346 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: WARNING keystonemiddleware.auth_token [None req-ebad6c10-4a69-4ab8-90bb-9d570133687b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 08 14:50:19.341712 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: WARNING keystonemiddleware.auth_token [None req-44cfa6b4-8ecc-4ca7-b54b-b4f04896b2b8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 08 14:50:19.346941 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: WARNING keystonemiddleware.auth_token [None req-44cfa6b4-8ecc-4ca7-b54b-b4f04896b2b8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 08 14:50:19.352495 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5634e0a169c0 pid: 128351 (default app) Mar 08 14:50:19.364971 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: WARNING keystonemiddleware.auth_token [None req-ebad6c10-4a69-4ab8-90bb-9d570133687b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 08 14:50:19.370502 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: WARNING keystonemiddleware.auth_token [None req-ebad6c10-4a69-4ab8-90bb-9d570133687b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 08 14:50:19.376075 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5634e0a169c0 pid: 128352 (default app) Mar 08 14:50:58.848119 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-34a2f706-8af3-49dc-b0fa-610ddff5d891 tempest-VolumesNegativeTest-1642490079 tempest-VolumesNegativeTest-1642490079-project] Action: 'create', calling method: .version_select at 0x7ff35ef11160>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1024880654", "metadata": {"Type": "work"}}} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:50:58.850631 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-34a2f706-8af3-49dc-b0fa-610ddff5d891 tempest-VolumesNegativeTest-1642490079 tempest-VolumesNegativeTest-1642490079-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=128351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 14:50:58.851546 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-34a2f706-8af3-49dc-b0fa-610ddff5d891 tempest-VolumesNegativeTest-1642490079 tempest-VolumesNegativeTest-1642490079-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.878761 Mar 08 14:50:58.852095 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1/1] 10.222.0.30 () {60 vars in 1155 bytes} [Tue Mar 8 14:50:57 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 881 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 08 14:50:59.095676 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b2e3cca0-892b-46f1-8ee3-db788527e418 tempest-VolumesNegativeTest-1642490079 tempest-VolumesNegativeTest-1642490079-project] Action: 'create', calling method: .version_select at 0x7ff35f044940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-571072962", "metadata": {"Type": "work"}}} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:50:59.099452 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b2e3cca0-892b-46f1-8ee3-db788527e418 tempest-VolumesNegativeTest-1642490079 tempest-VolumesNegativeTest-1642490079-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 14:50:59.101035 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b2e3cca0-892b-46f1-8ee3-db788527e418 tempest-VolumesNegativeTest-1642490079 tempest-VolumesNegativeTest-1642490079-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.242065 Mar 08 14:50:59.101527 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1/2] 10.222.0.30 () {60 vars in 1155 bytes} [Tue Mar 8 14:50:58 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 245 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 08 14:50:59.112176 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-f155c4d9-207e-4a9a-b4ea-0fcd6cb98596 tempest-VolumesNegativeTest-1642490079 tempest-VolumesNegativeTest-1642490079-project] Action: 'create', calling method: .version_select at 0x7ff35ef11f70>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-478862471", "metadata": {"Type": "work"}}} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:50:59.113617 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-f155c4d9-207e-4a9a-b4ea-0fcd6cb98596 tempest-VolumesNegativeTest-1642490079 tempest-VolumesNegativeTest-1642490079-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=128351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 14:50:59.115858 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-f155c4d9-207e-4a9a-b4ea-0fcd6cb98596 tempest-VolumesNegativeTest-1642490079 tempest-VolumesNegativeTest-1642490079-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007676 Mar 08 14:50:59.116381 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 2/3] 10.222.0.30 () {60 vars in 1155 bytes} [Tue Mar 8 14:50:59 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 08 14:50:59.127520 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-9a83fec3-447e-4203-918e-2f36e4da9819 tempest-VolumesNegativeTest-1642490079 tempest-VolumesNegativeTest-1642490079-project] Calling method '.version_select at 0x7ff35eeb2670>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:00.292087 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-9a83fec3-447e-4203-918e-2f36e4da9819 tempest-VolumesNegativeTest-1642490079 tempest-VolumesNegativeTest-1642490079-project] HTTP exception thrown: Volume tempest-invalid-1866980853 could not be found. Mar 08 14:51:00.293800 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-9a83fec3-447e-4203-918e-2f36e4da9819 tempest-VolumesNegativeTest-1642490079 tempest-VolumesNegativeTest-1642490079-project] Returning 404 to user: Volume tempest-invalid-1866980853 could not be found. {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 14:51:00.296071 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-9a83fec3-447e-4203-918e-2f36e4da9819 tempest-VolumesNegativeTest-1642490079 tempest-VolumesNegativeTest-1642490079-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1866980853" status: 404 len: 99 microversion: 2.1 time: 1.172639 Mar 08 14:51:00.297120 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 2/4] 10.222.0.30 () {58 vars in 1217 bytes} [Tue Mar 8 14:50:59 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1866980853 => generated 99 bytes in 1174 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 08 14:51:00.309717 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-e1289b84-ca60-42bb-80bb-555c25a5ea86 tempest-VolumesNegativeTest-1642490079 tempest-VolumesNegativeTest-1642490079-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005574 Mar 08 14:51:00.310301 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 3/5] 10.222.0.30 () {58 vars in 1139 bytes} [Tue Mar 8 14:51:00 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Mar 08 14:51:00.324113 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-1af7e0bd-616c-4ccf-b271-ae94ad5fcbd5 tempest-VolumesNegativeTest-1642490079 tempest-VolumesNegativeTest-1642490079-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006819 Mar 08 14:51:00.325030 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 3/6] 10.222.0.30 () {58 vars in 1136 bytes} [Tue Mar 8 14:51:00 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Mar 08 14:51:00.336916 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b3335daf-4200-42e6-8af0-5612fe0825b4 tempest-VolumesNegativeTest-1642490079 tempest-VolumesNegativeTest-1642490079-project] Calling method '.version_select at 0x7ff35ef11670>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:00.635767 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.wsgi [None req-b3335daf-4200-42e6-8af0-5612fe0825b4 tempest-VolumesNegativeTest-1642490079 tempest-VolumesNegativeTest-1642490079-project] HTTP exception thrown: Volume 1efd7bfe-7dac-4cd2-9a5c-54bf44524e05 could not be found. Mar 08 14:51:00.636517 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b3335daf-4200-42e6-8af0-5612fe0825b4 tempest-VolumesNegativeTest-1642490079 tempest-VolumesNegativeTest-1642490079-project] Returning 404 to user: Volume 1efd7bfe-7dac-4cd2-9a5c-54bf44524e05 could not be found. {{(pid=128351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 14:51:00.637416 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-b3335daf-4200-42e6-8af0-5612fe0825b4 tempest-VolumesNegativeTest-1642490079 tempest-VolumesNegativeTest-1642490079-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/1efd7bfe-7dac-4cd2-9a5c-54bf44524e05" status: 404 len: 109 microversion: 2.1 time: 0.305054 Mar 08 14:51:00.648564 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-6c38d3c3-6b07-4b73-b59c-9b40b75ed489 tempest-VolumesNegativeTest-1642490079 tempest-VolumesNegativeTest-1642490079-project] Calling method '.version_select at 0x7ff35ede7310>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:00.649166 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 4/7] 10.222.0.30 () {58 vars in 1247 bytes} [Tue Mar 8 14:51:00 2022] DELETE /compute/v2.1/os-volumes/1efd7bfe-7dac-4cd2-9a5c-54bf44524e05 => generated 109 bytes in 318 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 14:51:00.694352 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-6c38d3c3-6b07-4b73-b59c-9b40b75ed489 tempest-VolumesNegativeTest-1642490079 tempest-VolumesNegativeTest-1642490079-project] HTTP exception thrown: Volume 64205948-b631-44c9-a96b-533690f18462 could not be found. Mar 08 14:51:00.694352 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-6c38d3c3-6b07-4b73-b59c-9b40b75ed489 tempest-VolumesNegativeTest-1642490079 tempest-VolumesNegativeTest-1642490079-project] Returning 404 to user: Volume 64205948-b631-44c9-a96b-533690f18462 could not be found. {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 14:51:00.694909 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-6c38d3c3-6b07-4b73-b59c-9b40b75ed489 tempest-VolumesNegativeTest-1642490079 tempest-VolumesNegativeTest-1642490079-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/64205948-b631-44c9-a96b-533690f18462" status: 404 len: 109 microversion: 2.1 time: 0.051234 Mar 08 14:51:00.695451 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 4/8] 10.222.0.30 () {58 vars in 1244 bytes} [Tue Mar 8 14:51:00 2022] GET /compute/v2.1/os-volumes/64205948-b631-44c9-a96b-533690f18462 => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 14:51:01.492628 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-c616d2be-5f22-492a-b0a9-7895e75f0cfb tempest-VolumesTestJSON-1318402068 tempest-VolumesTestJSON-1318402068-project] Calling method '.version_select at 0x7ff3609b2d30>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:01.576155 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-c616d2be-5f22-492a-b0a9-7895e75f0cfb tempest-VolumesTestJSON-1318402068 tempest-VolumesTestJSON-1318402068-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/36e2ca4f-8bba-4fcf-95e2-e94d7573df9f" status: 200 len: 350 microversion: 2.1 time: 0.089947 Mar 08 14:51:01.576732 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 5/9] 10.222.0.30 () {58 vars in 1244 bytes} [Tue Mar 8 14:51:01 2022] GET /compute/v2.1/os-volumes/36e2ca4f-8bba-4fcf-95e2-e94d7573df9f => generated 350 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:51:02.531096 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c78f17c0-8ab0-49bc-b42d-422723725f2e tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1729061710", "imageRef": "7541d53b-003d-4f1a-8d76-fc5f4bd8dabf", "flavorRef": "452", "networks": [{"uuid": "05d859be-c973-4434-afc5-025bcb898491"}]}} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:51:02.682186 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.network.neutron [None req-c78f17c0-8ab0-49bc-b42d-422723725f2e tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] validate_networks() for [('05d859be-c973-4434-afc5-025bcb898491', None, None, None, None, None)] {{(pid=128352) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 14:51:03.089011 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b6e149db-8ba7-4bb6-a326-235fc16f1487 tempest-VolumesTestJSON-1318402068 tempest-VolumesTestJSON-1318402068-project] Calling method '.version_select at 0x7ff35edff310>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:03.177453 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-b6e149db-8ba7-4bb6-a326-235fc16f1487 tempest-VolumesTestJSON-1318402068 tempest-VolumesTestJSON-1318402068-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/a980ca7c-f362-4c97-92e8-932f201d81f3" status: 200 len: 351 microversion: 2.1 time: 0.092435 Mar 08 14:51:03.184961 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 6/10] 10.222.0.30 () {58 vars in 1244 bytes} [Tue Mar 8 14:51:03 2022] GET /compute/v2.1/os-volumes/a980ca7c-f362-4c97-92e8-932f201d81f3 => generated 351 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:51:04.737790 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-2b055691-fd03-494f-a9cd-0621de3eeb80 tempest-VolumesTestJSON-1318402068 tempest-VolumesTestJSON-1318402068-project] Calling method '.version_select at 0x7ff35edffa60>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:04.797545 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-2b055691-fd03-494f-a9cd-0621de3eeb80 tempest-VolumesTestJSON-1318402068 tempest-VolumesTestJSON-1318402068-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/78374d64-af65-4035-a9eb-aa14ee13c6e3" status: 200 len: 351 microversion: 2.1 time: 0.064606 Mar 08 14:51:04.805526 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 7/11] 10.222.0.30 () {58 vars in 1244 bytes} [Tue Mar 8 14:51:04 2022] GET /compute/v2.1/os-volumes/78374d64-af65-4035-a9eb-aa14ee13c6e3 => generated 351 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:51:04.810484 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-7293b78c-c62a-4b18-b1d5-3d7a1b87710f tempest-VolumesTestJSON-1318402068 tempest-VolumesTestJSON-1318402068-project] Calling method '.version_select at 0x7ff35ee04160>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:05.005282 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-7293b78c-c62a-4b18-b1d5-3d7a1b87710f tempest-VolumesTestJSON-1318402068 tempest-VolumesTestJSON-1318402068-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.197159 Mar 08 14:51:05.006137 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 8/12] 10.222.0.30 () {58 vars in 1133 bytes} [Tue Mar 8 14:51:04 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:05.021497 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-8af6a0f8-356e-46f0-99bc-540e8e431503 tempest-VolumesTestJSON-1318402068 tempest-VolumesTestJSON-1318402068-project] Calling method '.version_select at 0x7ff35edff8b0>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:05.153450 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.virt.hardware [None req-c78f17c0-8ab0-49bc-b42d-422723725f2e tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Flavor limits 0:0:0 {{(pid=128352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 14:51:05.154014 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.virt.hardware [None req-c78f17c0-8ab0-49bc-b42d-422723725f2e tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Image limits 0:0:0 {{(pid=128352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 14:51:05.154379 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.virt.hardware [None req-c78f17c0-8ab0-49bc-b42d-422723725f2e tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Flavor pref 0:0:0 {{(pid=128352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 14:51:05.155918 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.virt.hardware [None req-c78f17c0-8ab0-49bc-b42d-422723725f2e tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Image pref 0:0:0 {{(pid=128352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 14:51:05.156456 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.virt.hardware [None req-c78f17c0-8ab0-49bc-b42d-422723725f2e tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 14:51:05.197653 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c78f17c0-8ab0-49bc-b42d-422723725f2e tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:05.198130 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c78f17c0-8ab0-49bc-b42d-422723725f2e tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:05.198979 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c78f17c0-8ab0-49bc-b42d-422723725f2e tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:05.199348 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c78f17c0-8ab0-49bc-b42d-422723725f2e tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:05.234472 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-8af6a0f8-356e-46f0-99bc-540e8e431503 tempest-VolumesTestJSON-1318402068 tempest-VolumesTestJSON-1318402068-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.217632 Mar 08 14:51:05.236648 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 9/13] 10.222.0.30 () {58 vars in 1148 bytes} [Tue Mar 8 14:51:05 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:51:05.251395 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-6d42c4d6-f5e8-4a8c-b072-0aeb83547f21 tempest-VolumesTestJSON-1318402068 tempest-VolumesTestJSON-1318402068-project] Calling method '.version_select at 0x7ff35ede9ee0>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:05.276075 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.quota [None req-c78f17c0-8ab0-49bc-b42d-422723725f2e tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Getting quotas for project 46dce7630acc4cbc80b4cb3ba27c7dd9. Resources: {'instances', 'ram', 'cores'} {{(pid=128352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 14:51:05.292952 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.quota [None req-c78f17c0-8ab0-49bc-b42d-422723725f2e tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Getting quotas for user 3a343c19dc5f4ca1bcf659d05ffa92c7 and project 46dce7630acc4cbc80b4cb3ba27c7dd9. Resources: {'instances', 'ram', 'cores'} {{(pid=128352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 14:51:05.306660 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-c78f17c0-8ab0-49bc-b42d-422723725f2e tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Going to run 1 instances... {{(pid=128352) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 14:51:05.309735 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-c78f17c0-8ab0-49bc-b42d-422723725f2e tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] [instance: ac35fcd8-53a0-4e7b-93f2-a49b20549362] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7541d53b-003d-4f1a-8d76-fc5f4bd8dabf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 14:51:05.457059 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-c78f17c0-8ab0-49bc-b42d-422723725f2e tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.141229 Mar 08 14:51:05.458313 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 5/14] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Mar 8 14:51:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 3143 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 14:51:05.470408 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-59dc8f6c-cd5f-422b-a664-5292653a5fa4 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:05.470842 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-59dc8f6c-cd5f-422b-a664-5292653a5fa4 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] [instance: ac35fcd8-53a0-4e7b-93f2-a49b20549362] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:05.480054 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-6d42c4d6-f5e8-4a8c-b072-0aeb83547f21 tempest-VolumesTestJSON-1318402068 tempest-VolumesTestJSON-1318402068-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.234135 Mar 08 14:51:05.491051 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 10/15] 10.222.0.30 () {58 vars in 1133 bytes} [Tue Mar 8 14:51:05 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:51:05.496193 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-46b9d953-4df5-4af1-8f60-98fd63eca52b tempest-VolumesTestJSON-1318402068 tempest-VolumesTestJSON-1318402068-project] Calling method '.version_select at 0x7ff35ee045e0>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:05.740048 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-46b9d953-4df5-4af1-8f60-98fd63eca52b tempest-VolumesTestJSON-1318402068 tempest-VolumesTestJSON-1318402068-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.247694 Mar 08 14:51:05.740920 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 11/16] 10.222.0.30 () {58 vars in 1166 bytes} [Tue Mar 8 14:51:05 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:51:05.759857 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-59dc8f6c-cd5f-422b-a664-5292653a5fa4 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a343c19dc5f4ca1bcf659d05ffa92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dce7630acc4cbc80b4cb3ba27c7dd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:05.760274 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-f3f6966c-888c-49ca-a843-88ad22293975 tempest-VolumesTestJSON-1318402068 tempest-VolumesTestJSON-1318402068-project] Calling method '.version_select at 0x7ff35ede9b80>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:05.787592 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-59dc8f6c-cd5f-422b-a664-5292653a5fa4 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] 10.222.0.30 "GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362" status: 200 len: 1215 microversion: 2.1 time: 0.322534 Mar 08 14:51:05.790152 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 6/17] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:05 2022] GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362 => generated 1215 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:51:05.987466 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-f3f6966c-888c-49ca-a843-88ad22293975 tempest-VolumesTestJSON-1318402068 tempest-VolumesTestJSON-1318402068-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.235909 Mar 08 14:51:05.987975 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 12/18] 10.222.0.30 () {58 vars in 1169 bytes} [Tue Mar 8 14:51:05 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:51:06.000133 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d0d3c36f-9377-4d08-bb29-2afb7fdf3a44 tempest-VolumesTestJSON-1318402068 tempest-VolumesTestJSON-1318402068-project] Calling method '.version_select at 0x7ff35e4ee280>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:06.277622 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d0d3c36f-9377-4d08-bb29-2afb7fdf3a44 tempest-VolumesTestJSON-1318402068 tempest-VolumesTestJSON-1318402068-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.281023 Mar 08 14:51:06.278828 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 7/19] 10.222.0.30 () {58 vars in 1154 bytes} [Tue Mar 8 14:51:05 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:06.291240 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-0f93abf5-8048-43d9-a30b-d77dbe08eea7 tempest-VolumesTestJSON-1318402068 tempest-VolumesTestJSON-1318402068-project] Calling method '.version_select at 0x7ff35edff430>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:06.576832 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-0f93abf5-8048-43d9-a30b-d77dbe08eea7 tempest-VolumesTestJSON-1318402068 tempest-VolumesTestJSON-1318402068-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.289760 Mar 08 14:51:06.577822 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 13/20] 10.222.0.30 () {58 vars in 1187 bytes} [Tue Mar 8 14:51:06 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:51:06.590574 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-95d8c66a-05bc-4676-81be-9819db507961 tempest-VolumesTestJSON-1318402068 tempest-VolumesTestJSON-1318402068-project] Calling method '.version_select at 0x7ff35dcab160>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:06.795949 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-95d8c66a-05bc-4676-81be-9819db507961 tempest-VolumesTestJSON-1318402068 tempest-VolumesTestJSON-1318402068-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.209216 Mar 08 14:51:06.796659 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 8/21] 10.222.0.30 () {58 vars in 1154 bytes} [Tue Mar 8 14:51:06 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:06.813790 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-4c06ffef-0f3e-447f-ada7-a1f840a7db9c tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:06.815236 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-4c06ffef-0f3e-447f-ada7-a1f840a7db9c tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] [instance: ac35fcd8-53a0-4e7b-93f2-a49b20549362] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:07.768825 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-4c06ffef-0f3e-447f-ada7-a1f840a7db9c tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a343c19dc5f4ca1bcf659d05ffa92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dce7630acc4cbc80b4cb3ba27c7dd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:07.800970 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-4c06ffef-0f3e-447f-ada7-a1f840a7db9c tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] 10.222.0.30 "GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362" status: 200 len: 1215 microversion: 2.1 time: 0.990754 Mar 08 14:51:07.811043 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 14/22] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:06 2022] GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362 => generated 1215 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:08.820323 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-287c227b-9058-49c9-818e-0d86c22cc137 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:08.821054 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-287c227b-9058-49c9-818e-0d86c22cc137 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] [instance: ac35fcd8-53a0-4e7b-93f2-a49b20549362] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:08.830971 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-287c227b-9058-49c9-818e-0d86c22cc137 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:08.833615 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-287c227b-9058-49c9-818e-0d86c22cc137 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:08.836055 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-287c227b-9058-49c9-818e-0d86c22cc137 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:08.837654 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-287c227b-9058-49c9-818e-0d86c22cc137 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:09.276249 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-287c227b-9058-49c9-818e-0d86c22cc137 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a343c19dc5f4ca1bcf659d05ffa92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dce7630acc4cbc80b4cb3ba27c7dd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:09.305360 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-287c227b-9058-49c9-818e-0d86c22cc137 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] 10.222.0.30 "GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362" status: 200 len: 1267 microversion: 2.1 time: 0.486996 Mar 08 14:51:09.307732 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 9/23] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:08 2022] GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362 => generated 1267 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:51:10.324374 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-10e4d8e3-e650-4f0b-ac9b-c1e851d40f7d tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:10.325240 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-10e4d8e3-e650-4f0b-ac9b-c1e851d40f7d tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] [instance: ac35fcd8-53a0-4e7b-93f2-a49b20549362] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:10.336351 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-10e4d8e3-e650-4f0b-ac9b-c1e851d40f7d tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:10.336873 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-10e4d8e3-e650-4f0b-ac9b-c1e851d40f7d tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:10.337696 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-10e4d8e3-e650-4f0b-ac9b-c1e851d40f7d tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:10.338332 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-10e4d8e3-e650-4f0b-ac9b-c1e851d40f7d tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:10.730133 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-10e4d8e3-e650-4f0b-ac9b-c1e851d40f7d tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a343c19dc5f4ca1bcf659d05ffa92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dce7630acc4cbc80b4cb3ba27c7dd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:10.770001 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-10e4d8e3-e650-4f0b-ac9b-c1e851d40f7d tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] 10.222.0.30 "GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362" status: 200 len: 1273 microversion: 2.1 time: 0.440017 Mar 08 14:51:10.770682 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 15/24] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:10 2022] GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362 => generated 1273 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:11.793334 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f80b411d-a788-4903-a4e0-0c86712b9fe1 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:11.794052 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f80b411d-a788-4903-a4e0-0c86712b9fe1 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] [instance: ac35fcd8-53a0-4e7b-93f2-a49b20549362] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:11.808355 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f80b411d-a788-4903-a4e0-0c86712b9fe1 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:11.822055 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f80b411d-a788-4903-a4e0-0c86712b9fe1 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:11.822914 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f80b411d-a788-4903-a4e0-0c86712b9fe1 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:11.823365 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f80b411d-a788-4903-a4e0-0c86712b9fe1 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:12.240471 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f80b411d-a788-4903-a4e0-0c86712b9fe1 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a343c19dc5f4ca1bcf659d05ffa92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dce7630acc4cbc80b4cb3ba27c7dd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:12.250298 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f80b411d-a788-4903-a4e0-0c86712b9fe1 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] 10.222.0.30 "GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362" status: 200 len: 1273 microversion: 2.1 time: 0.462835 Mar 08 14:51:12.273374 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 10/25] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:11 2022] GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362 => generated 1273 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:13.292862 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-6d0cb790-3e6e-4ec6-b4f8-2dec93c44149 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:13.293540 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-6d0cb790-3e6e-4ec6-b4f8-2dec93c44149 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] [instance: ac35fcd8-53a0-4e7b-93f2-a49b20549362] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:13.310051 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6d0cb790-3e6e-4ec6-b4f8-2dec93c44149 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:13.313822 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6d0cb790-3e6e-4ec6-b4f8-2dec93c44149 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:13.317657 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6d0cb790-3e6e-4ec6-b4f8-2dec93c44149 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:13.318771 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6d0cb790-3e6e-4ec6-b4f8-2dec93c44149 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:14.998631 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-6d0cb790-3e6e-4ec6-b4f8-2dec93c44149 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a343c19dc5f4ca1bcf659d05ffa92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dce7630acc4cbc80b4cb3ba27c7dd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:15.028684 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-6d0cb790-3e6e-4ec6-b4f8-2dec93c44149 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] 10.222.0.30 "GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362" status: 200 len: 1315 microversion: 2.1 time: 1.743621 Mar 08 14:51:15.036326 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 16/26] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:13 2022] GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362 => generated 1315 bytes in 1752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:16.056218 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-bb45b84a-df34-4e9b-b9cb-8abf25160189 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:16.057527 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-bb45b84a-df34-4e9b-b9cb-8abf25160189 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] [instance: ac35fcd8-53a0-4e7b-93f2-a49b20549362] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:16.074235 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bb45b84a-df34-4e9b-b9cb-8abf25160189 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:16.075229 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bb45b84a-df34-4e9b-b9cb-8abf25160189 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:16.076810 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bb45b84a-df34-4e9b-b9cb-8abf25160189 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:16.077543 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bb45b84a-df34-4e9b-b9cb-8abf25160189 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:17.528229 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-bb45b84a-df34-4e9b-b9cb-8abf25160189 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a343c19dc5f4ca1bcf659d05ffa92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dce7630acc4cbc80b4cb3ba27c7dd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:17.541703 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-bb45b84a-df34-4e9b-b9cb-8abf25160189 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] 10.222.0.30 "GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362" status: 200 len: 1315 microversion: 2.1 time: 1.490190 Mar 08 14:51:17.554728 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 11/27] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:16 2022] GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362 => generated 1315 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:18.437004 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-c3beafd4-0728-4c39-a3ce-5d1ee98bc66f tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2014237507", "imageRef": "7541d53b-003d-4f1a-8d76-fc5f4bd8dabf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:51:18.564208 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-56db59e9-4b88-4d73-91a8-67e2e8e31157 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:18.565069 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-56db59e9-4b88-4d73-91a8-67e2e8e31157 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] [instance: ac35fcd8-53a0-4e7b-93f2-a49b20549362] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:18.584597 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-56db59e9-4b88-4d73-91a8-67e2e8e31157 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:18.588287 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-56db59e9-4b88-4d73-91a8-67e2e8e31157 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:18.590720 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-56db59e9-4b88-4d73-91a8-67e2e8e31157 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:18.591175 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-56db59e9-4b88-4d73-91a8-67e2e8e31157 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:18.698479 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.network.neutron [None req-c3beafd4-0728-4c39-a3ce-5d1ee98bc66f tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] validate_networks() for [('8e441ce5-4964-4547-92bb-d88a63f27fe3', None, None, None, None, None)] {{(pid=128351) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 14:51:19.339932 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-56db59e9-4b88-4d73-91a8-67e2e8e31157 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a343c19dc5f4ca1bcf659d05ffa92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dce7630acc4cbc80b4cb3ba27c7dd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:19.353562 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-56db59e9-4b88-4d73-91a8-67e2e8e31157 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] 10.222.0.30 "GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362" status: 200 len: 1315 microversion: 2.1 time: 0.796374 Mar 08 14:51:19.358145 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 12/28] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:18 2022] GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362 => generated 1315 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:20.058670 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [req-e8cbfe37-431b-4e38-8a7f-6da5665fd010 req-e7c00faa-c57a-4eca-9c24-5b1c03765980 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac35fcd8-53a0-4e7b-93f2-a49b20549362", "tag": "528f8832-4152-4513-9a7f-8d551b1fbad3"}]} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:51:20.076060 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-e8cbfe37-431b-4e38-8a7f-6da5665fd010 req-e7c00faa-c57a-4eca-9c24-5b1c03765980 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:20.080190 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-e8cbfe37-431b-4e38-8a7f-6da5665fd010 req-e7c00faa-c57a-4eca-9c24-5b1c03765980 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:20.140219 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.compute.server_external_events [req-e8cbfe37-431b-4e38-8a7f-6da5665fd010 req-e7c00faa-c57a-4eca-9c24-5b1c03765980 service nova] Creating event network-changed:528f8832-4152-4513-9a7f-8d551b1fbad3 for instance ac35fcd8-53a0-4e7b-93f2-a49b20549362 on hv-cinder-83009 Mar 08 14:51:20.141105 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-e8cbfe37-431b-4e38-8a7f-6da5665fd010 req-e7c00faa-c57a-4eca-9c24-5b1c03765980 service nova] Acquired lock "compute-rpcapi-router" {{(pid=128352) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 08 14:51:20.142802 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dd820ceb-2777-40d8-9eaa-3dc146c54ace None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:20.150632 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dd820ceb-2777-40d8-9eaa-3dc146c54ace None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:20.151946 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dd820ceb-2777-40d8-9eaa-3dc146c54ace None None] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:20.153262 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dd820ceb-2777-40d8-9eaa-3dc146c54ace None None] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:20.168851 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.compute.rpcapi [None req-dd820ceb-2777-40d8-9eaa-3dc146c54ace None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Mar 08 14:51:20.173525 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dd820ceb-2777-40d8-9eaa-3dc146c54ace None None] Releasing lock "compute-rpcapi-router" {{(pid=128352) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 08 14:51:20.209402 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-dd820ceb-2777-40d8-9eaa-3dc146c54ace None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.775512 Mar 08 14:51:20.210702 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 13/29] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 14:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:51:20.784041 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-a8ae38af-32c7-4431-8b10-ec4f422dd6b4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Action: 'create', calling method: .version_select at 0x7ff35dc40310>, body: {"keypair": {"name": "tempest-keypair-292580592"}} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:51:20.848231 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.quota [None req-a8ae38af-32c7-4431-8b10-ec4f422dd6b4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Getting quotas for project 0cdd8e70c5dc4d1a8f531591dbd9216f. Resources: {'key_pairs'} {{(pid=128352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 14:51:20.857685 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.quota [None req-a8ae38af-32c7-4431-8b10-ec4f422dd6b4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Getting quotas for user 1775260bd3f947ea85d14b3a1aa80b38 and project 0cdd8e70c5dc4d1a8f531591dbd9216f. Resources: {'key_pairs'} {{(pid=128352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 14:51:21.100400 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.quota [None req-a8ae38af-32c7-4431-8b10-ec4f422dd6b4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Getting quotas for project 0cdd8e70c5dc4d1a8f531591dbd9216f. Resources: {'key_pairs'} {{(pid=128352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 14:51:21.108541 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.quota [None req-a8ae38af-32c7-4431-8b10-ec4f422dd6b4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Getting quotas for user 1775260bd3f947ea85d14b3a1aa80b38 and project 0cdd8e70c5dc4d1a8f531591dbd9216f. Resources: {'key_pairs'} {{(pid=128352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 14:51:21.134435 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-a8ae38af-32c7-4431-8b10-ec4f422dd6b4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.834572 Mar 08 14:51:21.135492 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 14/30] 10.222.0.30 () {62 vars in 1198 bytes} [Tue Mar 8 14:51:20 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 837 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Mar 08 14:51:21.144542 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-9601d428-4858-499d-a85a-09b3de36ac38 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:21.145818 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-9601d428-4858-499d-a85a-09b3de36ac38 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] [instance: ac35fcd8-53a0-4e7b-93f2-a49b20549362] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:21.154299 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9601d428-4858-499d-a85a-09b3de36ac38 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:21.155142 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9601d428-4858-499d-a85a-09b3de36ac38 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:21.156361 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9601d428-4858-499d-a85a-09b3de36ac38 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:21.156996 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9601d428-4858-499d-a85a-09b3de36ac38 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:22.003321 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-9601d428-4858-499d-a85a-09b3de36ac38 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a343c19dc5f4ca1bcf659d05ffa92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dce7630acc4cbc80b4cb3ba27c7dd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:22.015551 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-9601d428-4858-499d-a85a-09b3de36ac38 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] 10.222.0.30 "GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362" status: 200 len: 1315 microversion: 2.1 time: 0.875622 Mar 08 14:51:22.016094 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 15/31] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:21 2022] GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362 => generated 1315 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:23.097100 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d7870f4b-8cae-4480-9209-dc53d0af31bb tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Action: 'create', calling method: .version_select at 0x7ff35dc03310>, body: {"keypair": {"name": "tempest-keypair-1050794834"}} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:51:23.131505 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.quota [None req-d7870f4b-8cae-4480-9209-dc53d0af31bb tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Getting quotas for project 3f98f6f0a9d945e88b01a9da19044aa1. Resources: {'key_pairs'} {{(pid=128352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 14:51:23.148825 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.quota [None req-d7870f4b-8cae-4480-9209-dc53d0af31bb tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Getting quotas for user 51ed61d0a16d465889c0474a4d2b7dee and project 3f98f6f0a9d945e88b01a9da19044aa1. Resources: {'key_pairs'} {{(pid=128352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 14:51:23.400091 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.quota [None req-d7870f4b-8cae-4480-9209-dc53d0af31bb tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Getting quotas for project 3f98f6f0a9d945e88b01a9da19044aa1. Resources: {'key_pairs'} {{(pid=128352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 14:51:23.420568 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.quota [None req-d7870f4b-8cae-4480-9209-dc53d0af31bb tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Getting quotas for user 51ed61d0a16d465889c0474a4d2b7dee and project 3f98f6f0a9d945e88b01a9da19044aa1. Resources: {'key_pairs'} {{(pid=128352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 14:51:23.461250 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d7870f4b-8cae-4480-9209-dc53d0af31bb tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 1.410478 Mar 08 14:51:23.463507 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 16/32] 10.222.0.30 () {60 vars in 1157 bytes} [Tue Mar 8 14:51:22 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:23.477187 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-33beb9aa-7e13-4e03-be46-0d1b3668d8cd tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:23.480392 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-33beb9aa-7e13-4e03-be46-0d1b3668d8cd tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] [instance: ac35fcd8-53a0-4e7b-93f2-a49b20549362] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:23.510723 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-33beb9aa-7e13-4e03-be46-0d1b3668d8cd tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:23.511706 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-33beb9aa-7e13-4e03-be46-0d1b3668d8cd tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:23.514454 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-33beb9aa-7e13-4e03-be46-0d1b3668d8cd tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:23.518028 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-33beb9aa-7e13-4e03-be46-0d1b3668d8cd tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:24.094529 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-33beb9aa-7e13-4e03-be46-0d1b3668d8cd tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a343c19dc5f4ca1bcf659d05ffa92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dce7630acc4cbc80b4cb3ba27c7dd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:24.107065 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-33beb9aa-7e13-4e03-be46-0d1b3668d8cd tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] 10.222.0.30 "GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362" status: 200 len: 1315 microversion: 2.1 time: 0.639382 Mar 08 14:51:24.108958 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 17/33] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:23 2022] GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362 => generated 1315 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:24.530178 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-c3beafd4-0728-4c39-a3ce-5d1ee98bc66f tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Flavor limits 0:0:0 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 14:51:24.531310 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-c3beafd4-0728-4c39-a3ce-5d1ee98bc66f tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Image limits 0:0:0 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 14:51:24.532145 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-c3beafd4-0728-4c39-a3ce-5d1ee98bc66f tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Flavor pref 0:0:0 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 14:51:24.533298 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-c3beafd4-0728-4c39-a3ce-5d1ee98bc66f tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Image pref 0:0:0 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 14:51:24.534009 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-c3beafd4-0728-4c39-a3ce-5d1ee98bc66f tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 14:51:24.561891 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c3beafd4-0728-4c39-a3ce-5d1ee98bc66f tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:24.562450 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c3beafd4-0728-4c39-a3ce-5d1ee98bc66f tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:24.566628 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c3beafd4-0728-4c39-a3ce-5d1ee98bc66f tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:24.570115 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c3beafd4-0728-4c39-a3ce-5d1ee98bc66f tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:24.648072 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.quota [None req-c3beafd4-0728-4c39-a3ce-5d1ee98bc66f tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Getting quotas for project 7ac3fd6058904fbabe43c68e8d7c7654. Resources: {'instances', 'ram', 'cores'} {{(pid=128351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 14:51:24.683771 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.quota [None req-c3beafd4-0728-4c39-a3ce-5d1ee98bc66f tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Getting quotas for user 00aa26c0dc804f949002193e1919183d and project 7ac3fd6058904fbabe43c68e8d7c7654. Resources: {'instances', 'ram', 'cores'} {{(pid=128351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 14:51:24.731246 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-c3beafd4-0728-4c39-a3ce-5d1ee98bc66f tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Going to run 1 instances... {{(pid=128351) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 14:51:24.734555 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-c3beafd4-0728-4c39-a3ce-5d1ee98bc66f tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7541d53b-003d-4f1a-8d76-fc5f4bd8dabf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 14:51:24.954252 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-c3beafd4-0728-4c39-a3ce-5d1ee98bc66f tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 7.435376 Mar 08 14:51:24.962243 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 17/34] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Mar 8 14:51:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 7444 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 08 14:51:24.967538 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-68881bf1-7fda-4d05-9762-bad9a69d4ecf tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:24.968203 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-68881bf1-7fda-4d05-9762-bad9a69d4ecf tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:25.126244 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-c8cc1589-4961-4d39-8d71-886bcadf8f85 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:25.133094 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-c8cc1589-4961-4d39-8d71-886bcadf8f85 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] [instance: ac35fcd8-53a0-4e7b-93f2-a49b20549362] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:25.146986 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c8cc1589-4961-4d39-8d71-886bcadf8f85 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:25.150793 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c8cc1589-4961-4d39-8d71-886bcadf8f85 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:25.152759 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c8cc1589-4961-4d39-8d71-886bcadf8f85 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:25.153476 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c8cc1589-4961-4d39-8d71-886bcadf8f85 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:25.303312 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-68881bf1-7fda-4d05-9762-bad9a69d4ecf tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:25.310603 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-68881bf1-7fda-4d05-9762-bad9a69d4ecf tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1222 microversion: 2.1 time: 0.347227 Mar 08 14:51:25.315293 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 18/35] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:24 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1222 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:25.646747 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-0af638bb-170e-4b1f-85ae-59b68aa39d91 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1891535613", "imageRef": "7541d53b-003d-4f1a-8d76-fc5f4bd8dabf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:51:25.811006 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-c8cc1589-4961-4d39-8d71-886bcadf8f85 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a343c19dc5f4ca1bcf659d05ffa92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dce7630acc4cbc80b4cb3ba27c7dd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:25.827617 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-c8cc1589-4961-4d39-8d71-886bcadf8f85 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] 10.222.0.30 "GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362" status: 200 len: 1315 microversion: 2.1 time: 0.705788 Mar 08 14:51:25.839955 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 18/36] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:25 2022] GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362 => generated 1315 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:25.900886 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.network.neutron [None req-0af638bb-170e-4b1f-85ae-59b68aa39d91 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] validate_networks() for [('8e441ce5-4964-4547-92bb-d88a63f27fe3', None, None, None, None, None)] {{(pid=128352) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 14:51:26.859446 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-c9ffa36b-ae02-4c12-b9fa-afa17761a47a tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:26.859953 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-c9ffa36b-ae02-4c12-b9fa-afa17761a47a tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] [instance: ac35fcd8-53a0-4e7b-93f2-a49b20549362] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:26.869687 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c9ffa36b-ae02-4c12-b9fa-afa17761a47a tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:26.870260 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c9ffa36b-ae02-4c12-b9fa-afa17761a47a tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:26.871071 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c9ffa36b-ae02-4c12-b9fa-afa17761a47a tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:26.871517 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c9ffa36b-ae02-4c12-b9fa-afa17761a47a tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:27.520282 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.virt.hardware [None req-0af638bb-170e-4b1f-85ae-59b68aa39d91 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Flavor limits 0:0:0 {{(pid=128352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 14:51:27.521041 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.virt.hardware [None req-0af638bb-170e-4b1f-85ae-59b68aa39d91 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Image limits 0:0:0 {{(pid=128352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 14:51:27.521687 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.virt.hardware [None req-0af638bb-170e-4b1f-85ae-59b68aa39d91 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Flavor pref 0:0:0 {{(pid=128352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 14:51:27.522337 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.virt.hardware [None req-0af638bb-170e-4b1f-85ae-59b68aa39d91 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Image pref 0:0:0 {{(pid=128352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 14:51:27.522920 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.virt.hardware [None req-0af638bb-170e-4b1f-85ae-59b68aa39d91 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 14:51:27.582194 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0af638bb-170e-4b1f-85ae-59b68aa39d91 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:27.597805 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0af638bb-170e-4b1f-85ae-59b68aa39d91 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:27.598747 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0af638bb-170e-4b1f-85ae-59b68aa39d91 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:27.610877 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0af638bb-170e-4b1f-85ae-59b68aa39d91 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:27.683192 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.quota [None req-0af638bb-170e-4b1f-85ae-59b68aa39d91 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Getting quotas for project 7ac3fd6058904fbabe43c68e8d7c7654. Resources: {'instances', 'ram', 'cores'} {{(pid=128352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 14:51:27.699307 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.quota [None req-0af638bb-170e-4b1f-85ae-59b68aa39d91 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Getting quotas for user 00aa26c0dc804f949002193e1919183d and project 7ac3fd6058904fbabe43c68e8d7c7654. Resources: {'instances', 'ram', 'cores'} {{(pid=128352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 14:51:27.731389 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-0af638bb-170e-4b1f-85ae-59b68aa39d91 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Going to run 1 instances... {{(pid=128352) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 14:51:27.733597 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-0af638bb-170e-4b1f-85ae-59b68aa39d91 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7541d53b-003d-4f1a-8d76-fc5f4bd8dabf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 14:51:27.762120 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-c9ffa36b-ae02-4c12-b9fa-afa17761a47a tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a343c19dc5f4ca1bcf659d05ffa92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dce7630acc4cbc80b4cb3ba27c7dd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:27.773657 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-c9ffa36b-ae02-4c12-b9fa-afa17761a47a tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] 10.222.0.30 "GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362" status: 200 len: 1315 microversion: 2.1 time: 0.919619 Mar 08 14:51:27.774287 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 19/37] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:26 2022] GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362 => generated 1315 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:51:27.864051 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-0af638bb-170e-4b1f-85ae-59b68aa39d91 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.222948 Mar 08 14:51:27.867690 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 19/38] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Mar 8 14:51:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 2227 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 14:51:27.877654 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-bd11e5b5-72e7-4c71-b277-29b37bc9d329 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:27.878321 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-bd11e5b5-72e7-4c71-b277-29b37bc9d329 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:28.079632 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-bd11e5b5-72e7-4c71-b277-29b37bc9d329 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:28.087401 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-bd11e5b5-72e7-4c71-b277-29b37bc9d329 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1222 microversion: 2.1 time: 0.213548 Mar 08 14:51:28.096984 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 20/39] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:27 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1222 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:28.468904 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-2be73972-0963-4272-a58b-4a2c219627b2 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1463126683", "imageRef": "7541d53b-003d-4f1a-8d76-fc5f4bd8dabf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aaa227f6-cd71-48f7-9973-9ac995e5340d"}], "security_groups": [{"name": "tempest-securitygroup--32365346"}], "key_name": "tempest-keypair-1050794834", "user_data": "}} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:51:28.706429 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.network.neutron [None req-2be73972-0963-4272-a58b-4a2c219627b2 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] validate_networks() for [('aaa227f6-cd71-48f7-9973-9ac995e5340d', None, None, None, None, None)] {{(pid=128352) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 14:51:28.801062 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-a174b8d5-2283-4fe7-b87d-649d47202d5c tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:28.801808 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-a174b8d5-2283-4fe7-b87d-649d47202d5c tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] [instance: ac35fcd8-53a0-4e7b-93f2-a49b20549362] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:28.819780 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a174b8d5-2283-4fe7-b87d-649d47202d5c tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:28.820248 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a174b8d5-2283-4fe7-b87d-649d47202d5c tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:28.821058 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a174b8d5-2283-4fe7-b87d-649d47202d5c tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:28.821504 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a174b8d5-2283-4fe7-b87d-649d47202d5c tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:29.472981 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-a174b8d5-2283-4fe7-b87d-649d47202d5c tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a343c19dc5f4ca1bcf659d05ffa92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dce7630acc4cbc80b4cb3ba27c7dd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:29.480247 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-a174b8d5-2283-4fe7-b87d-649d47202d5c tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] 10.222.0.30 "GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362" status: 200 len: 1315 microversion: 2.1 time: 0.692638 Mar 08 14:51:29.486593 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 21/40] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:28 2022] GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362 => generated 1315 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:29.491299 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-48dcfa4e-1c59-4000-8b54-6d7bdb567adc tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:29.491921 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-48dcfa4e-1c59-4000-8b54-6d7bdb567adc tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:29.516782 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-48dcfa4e-1c59-4000-8b54-6d7bdb567adc tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:29.517254 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-48dcfa4e-1c59-4000-8b54-6d7bdb567adc tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:29.518085 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-48dcfa4e-1c59-4000-8b54-6d7bdb567adc tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:29.524372 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-48dcfa4e-1c59-4000-8b54-6d7bdb567adc tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:29.777039 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-48dcfa4e-1c59-4000-8b54-6d7bdb567adc tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:29.802530 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-48dcfa4e-1c59-4000-8b54-6d7bdb567adc tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1274 microversion: 2.1 time: 0.314758 Mar 08 14:51:29.805286 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 22/41] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:29 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1274 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:29.822527 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-724fad68-ca1e-468c-9447-427de7210744 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1692863154", "imageRef": "7541d53b-003d-4f1a-8d76-fc5f4bd8dabf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "749a78f8-dda5-4328-9019-a09684ba93ee"}], "security_groups": [{"name": "tempest-securitygroup--1184228068"}], "key_name": "tempest-keypair-292580592", "user_data": "}} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:51:30.070779 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.virt.hardware [None req-2be73972-0963-4272-a58b-4a2c219627b2 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Flavor limits 0:0:0 {{(pid=128352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 14:51:30.071287 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.virt.hardware [None req-2be73972-0963-4272-a58b-4a2c219627b2 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Image limits 0:0:0 {{(pid=128352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 14:51:30.071702 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.virt.hardware [None req-2be73972-0963-4272-a58b-4a2c219627b2 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Flavor pref 0:0:0 {{(pid=128352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 14:51:30.072136 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.virt.hardware [None req-2be73972-0963-4272-a58b-4a2c219627b2 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Image pref 0:0:0 {{(pid=128352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 14:51:30.072536 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.virt.hardware [None req-2be73972-0963-4272-a58b-4a2c219627b2 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 14:51:30.090947 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2be73972-0963-4272-a58b-4a2c219627b2 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:30.091417 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2be73972-0963-4272-a58b-4a2c219627b2 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:30.092234 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2be73972-0963-4272-a58b-4a2c219627b2 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:30.092684 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2be73972-0963-4272-a58b-4a2c219627b2 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:30.137049 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.quota [None req-2be73972-0963-4272-a58b-4a2c219627b2 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Getting quotas for project 3f98f6f0a9d945e88b01a9da19044aa1. Resources: {'instances', 'ram', 'cores'} {{(pid=128352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 14:51:30.142746 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.quota [None req-2be73972-0963-4272-a58b-4a2c219627b2 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Getting quotas for user 51ed61d0a16d465889c0474a4d2b7dee and project 3f98f6f0a9d945e88b01a9da19044aa1. Resources: {'instances', 'ram', 'cores'} {{(pid=128352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 14:51:30.174433 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-2be73972-0963-4272-a58b-4a2c219627b2 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Going to run 1 instances... {{(pid=128352) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 14:51:30.177937 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-2be73972-0963-4272-a58b-4a2c219627b2 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7541d53b-003d-4f1a-8d76-fc5f4bd8dabf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 14:51:30.185168 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.network.neutron [None req-724fad68-ca1e-468c-9447-427de7210744 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] validate_networks() for [('749a78f8-dda5-4328-9019-a09684ba93ee', None, None, None, None, None)] {{(pid=128351) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 14:51:30.262965 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-2be73972-0963-4272-a58b-4a2c219627b2 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.799724 Mar 08 14:51:30.263770 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 20/42] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Mar 8 14:51:28 2022] POST /compute/v2.1/servers => generated 400 bytes in 1802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 14:51:30.284128 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-e7ba367f-5ea2-46f8-86f5-b58985f6b999 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:30.286783 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-e7ba367f-5ea2-46f8-86f5-b58985f6b999 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:30.468223 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-e7ba367f-5ea2-46f8-86f5-b58985f6b999 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:30.476259 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-e7ba367f-5ea2-46f8-86f5-b58985f6b999 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1238 microversion: 2.1 time: 0.202715 Mar 08 14:51:30.494405 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 21/43] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:30 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1238 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:30.509483 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-0687872f-b46f-48dc-9382-b35cf13f70af tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:30.517395 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-0687872f-b46f-48dc-9382-b35cf13f70af tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] [instance: ac35fcd8-53a0-4e7b-93f2-a49b20549362] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:30.543376 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0687872f-b46f-48dc-9382-b35cf13f70af tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:30.546503 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0687872f-b46f-48dc-9382-b35cf13f70af tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:30.547647 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0687872f-b46f-48dc-9382-b35cf13f70af tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:30.548309 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0687872f-b46f-48dc-9382-b35cf13f70af tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:31.348391 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-724fad68-ca1e-468c-9447-427de7210744 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Flavor limits 0:0:0 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 14:51:31.348918 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-724fad68-ca1e-468c-9447-427de7210744 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Image limits 0:0:0 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 14:51:31.349583 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-724fad68-ca1e-468c-9447-427de7210744 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Flavor pref 0:0:0 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 14:51:31.350259 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-724fad68-ca1e-468c-9447-427de7210744 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Image pref 0:0:0 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 14:51:31.350686 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-724fad68-ca1e-468c-9447-427de7210744 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 14:51:31.370360 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-724fad68-ca1e-468c-9447-427de7210744 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:31.371080 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-724fad68-ca1e-468c-9447-427de7210744 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:31.372186 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-724fad68-ca1e-468c-9447-427de7210744 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:31.372874 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-724fad68-ca1e-468c-9447-427de7210744 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:31.412721 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.quota [None req-724fad68-ca1e-468c-9447-427de7210744 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Getting quotas for project 0cdd8e70c5dc4d1a8f531591dbd9216f. Resources: {'instances', 'ram', 'cores'} {{(pid=128351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 14:51:31.417215 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.quota [None req-724fad68-ca1e-468c-9447-427de7210744 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Getting quotas for user 1775260bd3f947ea85d14b3a1aa80b38 and project 0cdd8e70c5dc4d1a8f531591dbd9216f. Resources: {'instances', 'ram', 'cores'} {{(pid=128351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 14:51:31.430140 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-724fad68-ca1e-468c-9447-427de7210744 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Going to run 1 instances... {{(pid=128351) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 14:51:31.433018 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-724fad68-ca1e-468c-9447-427de7210744 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7541d53b-003d-4f1a-8d76-fc5f4bd8dabf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 14:51:31.545754 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-724fad68-ca1e-468c-9447-427de7210744 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.739171 Mar 08 14:51:31.549116 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 23/44] 10.222.0.30 () {62 vars in 1187 bytes} [Tue Mar 8 14:51:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 1743 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 08 14:51:31.564734 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-30e585f7-f83a-4c9d-baf2-4fa05f46dd58 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:31.565444 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-30e585f7-f83a-4c9d-baf2-4fa05f46dd58 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:31.581196 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-30e585f7-f83a-4c9d-baf2-4fa05f46dd58 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:31.582219 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-30e585f7-f83a-4c9d-baf2-4fa05f46dd58 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:31.583129 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-30e585f7-f83a-4c9d-baf2-4fa05f46dd58 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:31.583575 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-30e585f7-f83a-4c9d-baf2-4fa05f46dd58 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:31.759679 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-30e585f7-f83a-4c9d-baf2-4fa05f46dd58 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:31.767373 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-30e585f7-f83a-4c9d-baf2-4fa05f46dd58 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1280 microversion: 2.1 time: 0.217200 Mar 08 14:51:31.783325 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 24/45] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:31 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1280 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:31.788602 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-7ffb715e-4249-448e-8a58-df1d95bd5255 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:31.801153 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-7ffb715e-4249-448e-8a58-df1d95bd5255 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:31.820341 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-0687872f-b46f-48dc-9382-b35cf13f70af tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a343c19dc5f4ca1bcf659d05ffa92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dce7630acc4cbc80b4cb3ba27c7dd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:31.822234 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7ffb715e-4249-448e-8a58-df1d95bd5255 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:31.824895 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7ffb715e-4249-448e-8a58-df1d95bd5255 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:31.825786 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7ffb715e-4249-448e-8a58-df1d95bd5255 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:31.827513 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7ffb715e-4249-448e-8a58-df1d95bd5255 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:31.829120 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-0687872f-b46f-48dc-9382-b35cf13f70af tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] 10.222.0.30 "GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362" status: 200 len: 1315 microversion: 2.1 time: 1.332940 Mar 08 14:51:31.833555 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 22/46] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:30 2022] GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362 => generated 1315 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:31.849472 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-0478b965-d3b4-418a-9b5b-376664ae3eb7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:31.850111 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-0478b965-d3b4-418a-9b5b-376664ae3eb7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:32.233088 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-7ffb715e-4249-448e-8a58-df1d95bd5255 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:32.254919 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-0478b965-d3b4-418a-9b5b-376664ae3eb7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:32.257215 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-7ffb715e-4249-448e-8a58-df1d95bd5255 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1290 microversion: 2.1 time: 0.472504 Mar 08 14:51:32.268578 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 25/47] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:31 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1290 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:32.269696 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-0478b965-d3b4-418a-9b5b-376664ae3eb7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:32.280864 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-0478b965-d3b4-418a-9b5b-376664ae3eb7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:32.294133 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-0478b965-d3b4-418a-9b5b-376664ae3eb7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1281 microversion: 2.20 time: 0.459323 Mar 08 14:51:32.294996 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 23/48] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:51:31 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1281 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:51:32.793085 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-40ebef0c-b1d5-49d3-a16e-841a349d9f29 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:32.794049 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-40ebef0c-b1d5-49d3-a16e-841a349d9f29 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:32.813875 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-40ebef0c-b1d5-49d3-a16e-841a349d9f29 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:32.814775 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-40ebef0c-b1d5-49d3-a16e-841a349d9f29 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:32.815605 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-40ebef0c-b1d5-49d3-a16e-841a349d9f29 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:32.819703 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-40ebef0c-b1d5-49d3-a16e-841a349d9f29 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:32.857817 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-8fb1b4ce-5f1e-4b9e-9935-cae16da1b604 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:32.859873 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-8fb1b4ce-5f1e-4b9e-9935-cae16da1b604 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] [instance: ac35fcd8-53a0-4e7b-93f2-a49b20549362] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:32.886998 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8fb1b4ce-5f1e-4b9e-9935-cae16da1b604 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:32.887463 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8fb1b4ce-5f1e-4b9e-9935-cae16da1b604 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:32.895480 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8fb1b4ce-5f1e-4b9e-9935-cae16da1b604 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:32.896128 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8fb1b4ce-5f1e-4b9e-9935-cae16da1b604 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:33.226020 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-40ebef0c-b1d5-49d3-a16e-841a349d9f29 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:33.236892 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-40ebef0c-b1d5-49d3-a16e-841a349d9f29 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1322 microversion: 2.1 time: 0.453221 Mar 08 14:51:33.249150 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 26/49] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:32 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1322 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:33.256982 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [req-1ad77b7f-ba1e-4b54-b194-5795c28213b6 req-cf121b94-ff3b-4d19-85e6-5696817fab01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f936e19e-08fe-43d1-8c05-2fc52d3a5a67", "tag": "99e3fcea-0b0c-49ed-b6a7-b37449f1b07c"}]} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:51:33.278762 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-1ad77b7f-ba1e-4b54-b194-5795c28213b6 req-cf121b94-ff3b-4d19-85e6-5696817fab01 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:33.279555 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-1ad77b7f-ba1e-4b54-b194-5795c28213b6 req-cf121b94-ff3b-4d19-85e6-5696817fab01 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:33.328555 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.compute.server_external_events [req-1ad77b7f-ba1e-4b54-b194-5795c28213b6 req-cf121b94-ff3b-4d19-85e6-5696817fab01 service nova] Creating event network-changed:99e3fcea-0b0c-49ed-b6a7-b37449f1b07c for instance f936e19e-08fe-43d1-8c05-2fc52d3a5a67 on hv-cinder-83009 Mar 08 14:51:33.330359 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-1ad77b7f-ba1e-4b54-b194-5795c28213b6 req-cf121b94-ff3b-4d19-85e6-5696817fab01 service nova] Acquired lock "compute-rpcapi-router" {{(pid=128351) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 08 14:51:33.332269 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8eb830ee-699e-4789-91f7-5a801a6d8856 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:33.333611 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8eb830ee-699e-4789-91f7-5a801a6d8856 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:33.335005 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8eb830ee-699e-4789-91f7-5a801a6d8856 None None] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:33.335887 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8eb830ee-699e-4789-91f7-5a801a6d8856 None None] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:33.366467 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.compute.rpcapi [None req-8eb830ee-699e-4789-91f7-5a801a6d8856 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Mar 08 14:51:33.368617 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8eb830ee-699e-4789-91f7-5a801a6d8856 None None] Releasing lock "compute-rpcapi-router" {{(pid=128351) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 08 14:51:33.415507 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-8eb830ee-699e-4789-91f7-5a801a6d8856 None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164401 Mar 08 14:51:33.416659 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 27/50] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 14:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:51:33.429940 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-616819ac-8532-441d-b788-4642388f720e tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:33.430725 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-616819ac-8532-441d-b788-4642388f720e tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:33.444310 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-616819ac-8532-441d-b788-4642388f720e tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:33.446930 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-616819ac-8532-441d-b788-4642388f720e tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:33.447768 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-616819ac-8532-441d-b788-4642388f720e tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:33.450474 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-616819ac-8532-441d-b788-4642388f720e tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:33.532557 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-8fb1b4ce-5f1e-4b9e-9935-cae16da1b604 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a343c19dc5f4ca1bcf659d05ffa92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dce7630acc4cbc80b4cb3ba27c7dd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:33.540942 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-8fb1b4ce-5f1e-4b9e-9935-cae16da1b604 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] 10.222.0.30 "GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362" status: 200 len: 1315 microversion: 2.1 time: 0.691809 Mar 08 14:51:33.545333 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 24/51] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:32 2022] GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362 => generated 1315 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:33.555359 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c94f8168-0af0-42c3-ba04-f885545b59c0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:33.555974 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-c94f8168-0af0-42c3-ba04-f885545b59c0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:33.570557 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c94f8168-0af0-42c3-ba04-f885545b59c0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:33.572732 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c94f8168-0af0-42c3-ba04-f885545b59c0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:33.573687 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c94f8168-0af0-42c3-ba04-f885545b59c0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:33.575474 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c94f8168-0af0-42c3-ba04-f885545b59c0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:33.635351 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-616819ac-8532-441d-b788-4642388f720e tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:33.643588 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-616819ac-8532-441d-b788-4642388f720e tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1296 microversion: 2.1 time: 0.224792 Mar 08 14:51:33.647327 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 28/52] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:33 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1296 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:33.710997 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-c94f8168-0af0-42c3-ba04-f885545b59c0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:33.728724 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-c94f8168-0af0-42c3-ba04-f885545b59c0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:33.731254 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-c94f8168-0af0-42c3-ba04-f885545b59c0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:33.733016 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-c94f8168-0af0-42c3-ba04-f885545b59c0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1333 microversion: 2.20 time: 0.186637 Mar 08 14:51:33.733796 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 25/53] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:51:33 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1333 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:51:34.255773 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-cff80bca-440c-45b9-99c8-6c6f5b1223cc tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:34.256927 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-cff80bca-440c-45b9-99c8-6c6f5b1223cc tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:34.263947 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cff80bca-440c-45b9-99c8-6c6f5b1223cc tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:34.264650 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cff80bca-440c-45b9-99c8-6c6f5b1223cc tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:34.265897 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cff80bca-440c-45b9-99c8-6c6f5b1223cc tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:34.266543 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cff80bca-440c-45b9-99c8-6c6f5b1223cc tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:34.417316 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-cff80bca-440c-45b9-99c8-6c6f5b1223cc tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:34.428753 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-cff80bca-440c-45b9-99c8-6c6f5b1223cc tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1322 microversion: 2.1 time: 0.177758 Mar 08 14:51:34.439798 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 29/54] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:34 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:34.536439 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [req-65a2254c-235f-4528-8f6d-a09661b94205 req-628b7689-6aed-4fbe-887d-46b563b53702 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b118641-910c-41a0-82cd-66f465d96e77", "tag": "45194c50-df18-4d74-b8bf-5c3a8941141f"}]} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:51:34.555275 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-65a2254c-235f-4528-8f6d-a09661b94205 req-628b7689-6aed-4fbe-887d-46b563b53702 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:34.555980 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-65a2254c-235f-4528-8f6d-a09661b94205 req-628b7689-6aed-4fbe-887d-46b563b53702 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:34.567611 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-33cfe400-752f-447e-8719-71dbae0f2247 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:34.568670 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-33cfe400-752f-447e-8719-71dbae0f2247 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] [instance: ac35fcd8-53a0-4e7b-93f2-a49b20549362] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:34.579890 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.compute.server_external_events [req-65a2254c-235f-4528-8f6d-a09661b94205 req-628b7689-6aed-4fbe-887d-46b563b53702 service nova] Creating event network-changed:45194c50-df18-4d74-b8bf-5c3a8941141f for instance 0b118641-910c-41a0-82cd-66f465d96e77 on hv-cinder-83009 Mar 08 14:51:34.581106 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-33cfe400-752f-447e-8719-71dbae0f2247 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:34.586507 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-33cfe400-752f-447e-8719-71dbae0f2247 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:34.587707 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-33cfe400-752f-447e-8719-71dbae0f2247 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:34.588155 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [req-65a2254c-235f-4528-8f6d-a09661b94205 req-628b7689-6aed-4fbe-887d-46b563b53702 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.327072 Mar 08 14:51:34.589131 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-33cfe400-752f-447e-8719-71dbae0f2247 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:34.591442 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 26/55] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 14:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:51:34.664108 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-35013563-4c17-432d-86ce-31bed5a3c02d tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:34.665178 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-35013563-4c17-432d-86ce-31bed5a3c02d tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:34.676372 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-35013563-4c17-432d-86ce-31bed5a3c02d tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:34.677028 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-35013563-4c17-432d-86ce-31bed5a3c02d tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:34.678042 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-35013563-4c17-432d-86ce-31bed5a3c02d tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:34.678491 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-35013563-4c17-432d-86ce-31bed5a3c02d tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:34.755952 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-35013563-4c17-432d-86ce-31bed5a3c02d tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:34.764444 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-33cfe400-752f-447e-8719-71dbae0f2247 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a343c19dc5f4ca1bcf659d05ffa92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dce7630acc4cbc80b4cb3ba27c7dd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:34.770353 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-35013563-4c17-432d-86ce-31bed5a3c02d tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1296 microversion: 2.1 time: 0.111042 Mar 08 14:51:34.774123 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-33cfe400-752f-447e-8719-71dbae0f2247 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] 10.222.0.30 "GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362" status: 200 len: 1315 microversion: 2.1 time: 0.219551 Mar 08 14:51:34.775035 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 30/56] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:34 2022] GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:34.780645 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 27/57] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:34 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1296 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:51:34.784124 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-984219c5-4ecd-4f39-ac50-50eae355d42f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:34.785488 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-984219c5-4ecd-4f39-ac50-50eae355d42f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:34.791417 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-984219c5-4ecd-4f39-ac50-50eae355d42f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:34.792206 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-984219c5-4ecd-4f39-ac50-50eae355d42f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:34.792689 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-984219c5-4ecd-4f39-ac50-50eae355d42f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:34.793286 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-984219c5-4ecd-4f39-ac50-50eae355d42f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:34.855389 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-984219c5-4ecd-4f39-ac50-50eae355d42f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:34.863991 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-984219c5-4ecd-4f39-ac50-50eae355d42f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:34.866055 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-984219c5-4ecd-4f39-ac50-50eae355d42f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:34.867364 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-984219c5-4ecd-4f39-ac50-50eae355d42f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1333 microversion: 2.20 time: 0.091116 Mar 08 14:51:34.868181 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 31/58] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:51:34 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1333 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:51:35.446134 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-49331766-c8af-47e2-81ba-fe6cc84975ab tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:35.446757 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-49331766-c8af-47e2-81ba-fe6cc84975ab tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:35.452685 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-49331766-c8af-47e2-81ba-fe6cc84975ab tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:35.453137 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-49331766-c8af-47e2-81ba-fe6cc84975ab tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:35.454124 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-49331766-c8af-47e2-81ba-fe6cc84975ab tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:35.454570 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-49331766-c8af-47e2-81ba-fe6cc84975ab tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:35.788894 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-6df391f5-7a34-447c-8808-d2eae0d76609 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:35.789564 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-6df391f5-7a34-447c-8808-d2eae0d76609 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:35.798927 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6df391f5-7a34-447c-8808-d2eae0d76609 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:35.814224 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6df391f5-7a34-447c-8808-d2eae0d76609 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:35.815118 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6df391f5-7a34-447c-8808-d2eae0d76609 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:35.818875 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6df391f5-7a34-447c-8808-d2eae0d76609 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:35.964513 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-49331766-c8af-47e2-81ba-fe6cc84975ab tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:35.976444 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-49331766-c8af-47e2-81ba-fe6cc84975ab tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1322 microversion: 2.1 time: 0.531245 Mar 08 14:51:35.978081 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 28/59] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:35 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1322 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:51:35.990887 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-79504449-96a7-4aeb-9c7d-9862ae953a8f tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:35.992804 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-79504449-96a7-4aeb-9c7d-9862ae953a8f tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] [instance: ac35fcd8-53a0-4e7b-93f2-a49b20549362] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:36.009172 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-79504449-96a7-4aeb-9c7d-9862ae953a8f tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:36.013956 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-79504449-96a7-4aeb-9c7d-9862ae953a8f tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:36.015342 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-79504449-96a7-4aeb-9c7d-9862ae953a8f tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:36.016044 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-79504449-96a7-4aeb-9c7d-9862ae953a8f tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:36.137463 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-6df391f5-7a34-447c-8808-d2eae0d76609 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:36.152016 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-6df391f5-7a34-447c-8808-d2eae0d76609 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1296 microversion: 2.1 time: 0.366912 Mar 08 14:51:36.153166 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 32/60] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:35 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1296 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:51:36.161846 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-a785abed-9fd0-4f92-999a-dcd5bf25b475 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:36.171342 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-a785abed-9fd0-4f92-999a-dcd5bf25b475 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:36.192562 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a785abed-9fd0-4f92-999a-dcd5bf25b475 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:36.195681 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a785abed-9fd0-4f92-999a-dcd5bf25b475 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:36.203271 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a785abed-9fd0-4f92-999a-dcd5bf25b475 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:36.205360 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a785abed-9fd0-4f92-999a-dcd5bf25b475 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:36.347895 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-a785abed-9fd0-4f92-999a-dcd5bf25b475 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:36.362995 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-a785abed-9fd0-4f92-999a-dcd5bf25b475 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:36.365721 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-a785abed-9fd0-4f92-999a-dcd5bf25b475 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:36.367230 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-a785abed-9fd0-4f92-999a-dcd5bf25b475 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1339 microversion: 2.20 time: 0.212257 Mar 08 14:51:36.368118 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 33/61] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:51:36 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1339 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:51:36.607697 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [req-79553531-026f-4258-96b8-a54bde7b02c0 req-c767b1c7-3449-4c28-bf93-dcba5bb13970 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac35fcd8-53a0-4e7b-93f2-a49b20549362", "name": "network-vif-plugged", "status": "completed", "tag": "528f8832-4152-4513-9a7f-8d551b1fbad3"}]} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:51:36.620526 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-79553531-026f-4258-96b8-a54bde7b02c0 req-c767b1c7-3449-4c28-bf93-dcba5bb13970 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:36.621532 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-79553531-026f-4258-96b8-a54bde7b02c0 req-c767b1c7-3449-4c28-bf93-dcba5bb13970 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:36.637240 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.compute.server_external_events [req-79553531-026f-4258-96b8-a54bde7b02c0 req-c767b1c7-3449-4c28-bf93-dcba5bb13970 service nova] Creating event network-vif-plugged:528f8832-4152-4513-9a7f-8d551b1fbad3 for instance ac35fcd8-53a0-4e7b-93f2-a49b20549362 on hv-cinder-83009 Mar 08 14:51:36.645884 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [req-79553531-026f-4258-96b8-a54bde7b02c0 req-c767b1c7-3449-4c28-bf93-dcba5bb13970 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.264291 Mar 08 14:51:36.646688 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 34/62] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 14:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:51:36.996938 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-afc3ca39-0f6a-45f0-b702-70c8f4208376 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:36.997719 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-afc3ca39-0f6a-45f0-b702-70c8f4208376 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:37.011696 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-afc3ca39-0f6a-45f0-b702-70c8f4208376 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:37.012450 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-afc3ca39-0f6a-45f0-b702-70c8f4208376 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:37.013427 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-afc3ca39-0f6a-45f0-b702-70c8f4208376 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:37.014145 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-afc3ca39-0f6a-45f0-b702-70c8f4208376 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:37.115951 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-79504449-96a7-4aeb-9c7d-9862ae953a8f tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a343c19dc5f4ca1bcf659d05ffa92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dce7630acc4cbc80b4cb3ba27c7dd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:37.138487 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-79504449-96a7-4aeb-9c7d-9862ae953a8f tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] 10.222.0.30 "GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362" status: 200 len: 1315 microversion: 2.1 time: 1.155736 Mar 08 14:51:37.140262 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 29/63] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:35 2022] GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362 => generated 1315 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:37.172537 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-379d8594-852c-4e0c-a74c-bec8078d5eee tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:37.173983 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-379d8594-852c-4e0c-a74c-bec8078d5eee tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:37.181900 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-379d8594-852c-4e0c-a74c-bec8078d5eee tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:37.183690 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-379d8594-852c-4e0c-a74c-bec8078d5eee tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:37.184645 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-379d8594-852c-4e0c-a74c-bec8078d5eee tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:37.185234 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-379d8594-852c-4e0c-a74c-bec8078d5eee tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:37.369759 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-379d8594-852c-4e0c-a74c-bec8078d5eee tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:37.392142 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-379d8594-852c-4e0c-a74c-bec8078d5eee tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1296 microversion: 2.1 time: 0.226089 Mar 08 14:51:37.392720 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 30/64] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:37 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1296 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:51:37.400724 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-44e66743-e9d2-4306-a5f2-741af41be782 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:37.401481 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-44e66743-e9d2-4306-a5f2-741af41be782 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:37.416600 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-44e66743-e9d2-4306-a5f2-741af41be782 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:37.419507 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-44e66743-e9d2-4306-a5f2-741af41be782 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:37.420463 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-44e66743-e9d2-4306-a5f2-741af41be782 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:37.424499 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-44e66743-e9d2-4306-a5f2-741af41be782 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:37.514219 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-afc3ca39-0f6a-45f0-b702-70c8f4208376 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:37.525053 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-afc3ca39-0f6a-45f0-b702-70c8f4208376 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1322 microversion: 2.1 time: 0.532178 Mar 08 14:51:37.540761 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 35/65] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:36 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1322 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:51:37.562225 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-44e66743-e9d2-4306-a5f2-741af41be782 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:37.576744 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-44e66743-e9d2-4306-a5f2-741af41be782 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:37.578308 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-44e66743-e9d2-4306-a5f2-741af41be782 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:37.579421 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-44e66743-e9d2-4306-a5f2-741af41be782 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1339 microversion: 2.20 time: 0.185583 Mar 08 14:51:37.580281 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 31/66] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:51:37 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1339 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:51:38.160480 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-17d1eebb-f8a6-4378-8d0a-a8913b39aa86 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:38.161191 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-17d1eebb-f8a6-4378-8d0a-a8913b39aa86 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] [instance: ac35fcd8-53a0-4e7b-93f2-a49b20549362] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:38.168275 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-17d1eebb-f8a6-4378-8d0a-a8913b39aa86 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:38.168979 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-17d1eebb-f8a6-4378-8d0a-a8913b39aa86 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:38.169967 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-17d1eebb-f8a6-4378-8d0a-a8913b39aa86 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:38.170585 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-17d1eebb-f8a6-4378-8d0a-a8913b39aa86 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:38.348778 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-17d1eebb-f8a6-4378-8d0a-a8913b39aa86 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a343c19dc5f4ca1bcf659d05ffa92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dce7630acc4cbc80b4cb3ba27c7dd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:38.356674 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-17d1eebb-f8a6-4378-8d0a-a8913b39aa86 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] 10.222.0.30 "GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362" status: 200 len: 1315 microversion: 2.1 time: 0.201771 Mar 08 14:51:38.366884 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 36/67] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:38 2022] GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:38.408969 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-14188633-edb2-4c7e-82b2-5377d8988274 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:38.410489 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-14188633-edb2-4c7e-82b2-5377d8988274 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:38.419984 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-14188633-edb2-4c7e-82b2-5377d8988274 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:38.420702 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-14188633-edb2-4c7e-82b2-5377d8988274 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:38.421695 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-14188633-edb2-4c7e-82b2-5377d8988274 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:38.422269 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-14188633-edb2-4c7e-82b2-5377d8988274 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:38.558513 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-f65625bf-1700-4fee-92d4-4ca1ca116b96 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:38.560860 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-f65625bf-1700-4fee-92d4-4ca1ca116b96 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:38.576652 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f65625bf-1700-4fee-92d4-4ca1ca116b96 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:38.577103 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f65625bf-1700-4fee-92d4-4ca1ca116b96 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:38.578764 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f65625bf-1700-4fee-92d4-4ca1ca116b96 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:38.585196 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f65625bf-1700-4fee-92d4-4ca1ca116b96 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:38.747250 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-f65625bf-1700-4fee-92d4-4ca1ca116b96 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:38.759141 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-f65625bf-1700-4fee-92d4-4ca1ca116b96 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1322 microversion: 2.1 time: 0.214762 Mar 08 14:51:38.762521 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 37/68] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:38 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:38.774552 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-c9488b8e-aa5b-44d1-b3ca-94b83c7ec814 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:38.775533 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-c9488b8e-aa5b-44d1-b3ca-94b83c7ec814 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:38.788203 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c9488b8e-aa5b-44d1-b3ca-94b83c7ec814 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:38.789418 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c9488b8e-aa5b-44d1-b3ca-94b83c7ec814 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:38.791385 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c9488b8e-aa5b-44d1-b3ca-94b83c7ec814 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:38.792033 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c9488b8e-aa5b-44d1-b3ca-94b83c7ec814 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:39.073861 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-c9488b8e-aa5b-44d1-b3ca-94b83c7ec814 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:39.083029 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-c9488b8e-aa5b-44d1-b3ca-94b83c7ec814 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:39.084466 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-c9488b8e-aa5b-44d1-b3ca-94b83c7ec814 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:39.085596 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-c9488b8e-aa5b-44d1-b3ca-94b83c7ec814 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1407 microversion: 2.20 time: 0.321546 Mar 08 14:51:39.101545 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 38/69] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:51:38 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1407 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:51:39.138548 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-14188633-edb2-4c7e-82b2-5377d8988274 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:39.153066 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-14188633-edb2-4c7e-82b2-5377d8988274 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1362 microversion: 2.1 time: 0.748367 Mar 08 14:51:39.157966 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 32/70] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:38 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1362 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:51:39.375989 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-e1345bb9-38f7-4e25-8abd-0664d159ce0f tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:39.377174 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-e1345bb9-38f7-4e25-8abd-0664d159ce0f tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] [instance: ac35fcd8-53a0-4e7b-93f2-a49b20549362] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:39.391485 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e1345bb9-38f7-4e25-8abd-0664d159ce0f tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:39.397103 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e1345bb9-38f7-4e25-8abd-0664d159ce0f tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:39.399870 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e1345bb9-38f7-4e25-8abd-0664d159ce0f tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:39.401337 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e1345bb9-38f7-4e25-8abd-0664d159ce0f tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:39.702184 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-e1345bb9-38f7-4e25-8abd-0664d159ce0f tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a343c19dc5f4ca1bcf659d05ffa92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dce7630acc4cbc80b4cb3ba27c7dd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:39.711423 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-e1345bb9-38f7-4e25-8abd-0664d159ce0f tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] 10.222.0.30 "GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362" status: 200 len: 1315 microversion: 2.1 time: 0.340546 Mar 08 14:51:39.723903 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 39/71] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:39 2022] GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362 => generated 1315 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:39.780496 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ffd111a0-96fe-45a2-9651-61418c48703c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:39.781308 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ffd111a0-96fe-45a2-9651-61418c48703c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:39.798551 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ffd111a0-96fe-45a2-9651-61418c48703c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:39.798551 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ffd111a0-96fe-45a2-9651-61418c48703c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:39.798551 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ffd111a0-96fe-45a2-9651-61418c48703c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:39.798551 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ffd111a0-96fe-45a2-9651-61418c48703c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:40.106354 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [req-32d229ff-270f-48af-aec3-48f07aba4e19 req-73d09f9e-74ad-480b-929b-00fd546f0744 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04409dca-0761-4f98-b039-a620e2bef81e", "tag": "2a5a9e74-f475-4a3f-a2cc-034ea707cdeb"}]} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:51:40.117200 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-32d229ff-270f-48af-aec3-48f07aba4e19 req-73d09f9e-74ad-480b-929b-00fd546f0744 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:40.117775 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-32d229ff-270f-48af-aec3-48f07aba4e19 req-73d09f9e-74ad-480b-929b-00fd546f0744 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:40.138287 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.compute.server_external_events [req-32d229ff-270f-48af-aec3-48f07aba4e19 req-73d09f9e-74ad-480b-929b-00fd546f0744 service nova] Creating event network-changed:2a5a9e74-f475-4a3f-a2cc-034ea707cdeb for instance 04409dca-0761-4f98-b039-a620e2bef81e on hv-cinder-83009 Mar 08 14:51:40.146088 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [req-32d229ff-270f-48af-aec3-48f07aba4e19 req-73d09f9e-74ad-480b-929b-00fd546f0744 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043264 Mar 08 14:51:40.147046 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 40/72] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 14:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:51:40.154383 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-44e41e66-9528-4fa4-8ad7-45653f07d3d7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:40.155448 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-44e41e66-9528-4fa4-8ad7-45653f07d3d7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:40.164207 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-44e41e66-9528-4fa4-8ad7-45653f07d3d7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:40.164627 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-44e41e66-9528-4fa4-8ad7-45653f07d3d7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:40.165750 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-44e41e66-9528-4fa4-8ad7-45653f07d3d7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:40.166958 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-44e41e66-9528-4fa4-8ad7-45653f07d3d7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:40.290415 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ffd111a0-96fe-45a2-9651-61418c48703c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:40.308300 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ffd111a0-96fe-45a2-9651-61418c48703c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1322 microversion: 2.1 time: 0.531179 Mar 08 14:51:40.309185 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 33/73] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:39 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1322 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:40.324277 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-69fc2e40-5bea-4005-a923-6b70cb055dbf tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:40.325230 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-69fc2e40-5bea-4005-a923-6b70cb055dbf tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:40.338403 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-69fc2e40-5bea-4005-a923-6b70cb055dbf tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:40.349405 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-69fc2e40-5bea-4005-a923-6b70cb055dbf tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:40.350421 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-69fc2e40-5bea-4005-a923-6b70cb055dbf tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:40.350933 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-69fc2e40-5bea-4005-a923-6b70cb055dbf tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:40.399815 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-44e41e66-9528-4fa4-8ad7-45653f07d3d7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:40.420723 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-44e41e66-9528-4fa4-8ad7-45653f07d3d7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:40.422997 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-44e41e66-9528-4fa4-8ad7-45653f07d3d7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:40.424408 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-44e41e66-9528-4fa4-8ad7-45653f07d3d7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1407 microversion: 2.20 time: 0.275984 Mar 08 14:51:40.425453 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 41/74] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:51:40 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1407 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:51:40.731849 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-5b3b816b-cd5a-406c-8ada-22bdddd2261c tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:40.733227 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-5b3b816b-cd5a-406c-8ada-22bdddd2261c tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] [instance: ac35fcd8-53a0-4e7b-93f2-a49b20549362] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:40.740256 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5b3b816b-cd5a-406c-8ada-22bdddd2261c tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:40.742133 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5b3b816b-cd5a-406c-8ada-22bdddd2261c tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:40.743583 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5b3b816b-cd5a-406c-8ada-22bdddd2261c tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:40.744370 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5b3b816b-cd5a-406c-8ada-22bdddd2261c tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:40.793511 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-69fc2e40-5bea-4005-a923-6b70cb055dbf tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:40.803678 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-69fc2e40-5bea-4005-a923-6b70cb055dbf tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1362 microversion: 2.1 time: 0.493162 Mar 08 14:51:40.804279 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 34/75] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:40 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1362 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:41.093870 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-5b3b816b-cd5a-406c-8ada-22bdddd2261c tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a343c19dc5f4ca1bcf659d05ffa92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dce7630acc4cbc80b4cb3ba27c7dd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:41.103850 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-5b3b816b-cd5a-406c-8ada-22bdddd2261c tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] 10.222.0.30 "GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362" status: 200 len: 1501 microversion: 2.1 time: 0.376075 Mar 08 14:51:41.109151 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 42/76] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:40 2022] GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362 => generated 1501 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:41.329076 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d80e3b59-3c5d-4864-b5f6-6029dda65241 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:41.330113 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d80e3b59-3c5d-4864-b5f6-6029dda65241 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:41.347982 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d80e3b59-3c5d-4864-b5f6-6029dda65241 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:41.350020 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d80e3b59-3c5d-4864-b5f6-6029dda65241 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:41.352451 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d80e3b59-3c5d-4864-b5f6-6029dda65241 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:41.354460 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d80e3b59-3c5d-4864-b5f6-6029dda65241 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:41.443552 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-38e815a9-a2d8-4e87-b207-26f2edc16c07 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:41.445173 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-38e815a9-a2d8-4e87-b207-26f2edc16c07 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:41.459166 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-38e815a9-a2d8-4e87-b207-26f2edc16c07 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:41.462009 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-38e815a9-a2d8-4e87-b207-26f2edc16c07 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:41.462838 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-38e815a9-a2d8-4e87-b207-26f2edc16c07 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:41.463280 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-38e815a9-a2d8-4e87-b207-26f2edc16c07 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:42.000463 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d80e3b59-3c5d-4864-b5f6-6029dda65241 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:42.013272 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d80e3b59-3c5d-4864-b5f6-6029dda65241 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1322 microversion: 2.1 time: 0.688136 Mar 08 14:51:42.014949 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 35/77] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:41 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1322 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:42.020962 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-627d7f7f-e5d8-485b-b4af-d77ad589ea89 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:42.021996 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-627d7f7f-e5d8-485b-b4af-d77ad589ea89 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:42.031951 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-627d7f7f-e5d8-485b-b4af-d77ad589ea89 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:42.035161 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-627d7f7f-e5d8-485b-b4af-d77ad589ea89 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:42.036410 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-627d7f7f-e5d8-485b-b4af-d77ad589ea89 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:42.036956 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-627d7f7f-e5d8-485b-b4af-d77ad589ea89 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:42.277105 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-38e815a9-a2d8-4e87-b207-26f2edc16c07 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:42.287523 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-38e815a9-a2d8-4e87-b207-26f2edc16c07 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:42.289943 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-38e815a9-a2d8-4e87-b207-26f2edc16c07 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:42.291343 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-38e815a9-a2d8-4e87-b207-26f2edc16c07 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1407 microversion: 2.20 time: 0.852191 Mar 08 14:51:42.303595 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 43/78] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:51:41 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1407 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:51:42.308936 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [req-064f8cc6-21ba-413b-856b-6c31bf8b9425 req-afc7619c-6d7b-46b8-968b-c4caf3621be9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b7917ad-8941-400f-ae66-d22e26633416", "tag": "14e51cd2-ee26-4f88-bdde-048115f528a7"}]} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:51:42.318691 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-064f8cc6-21ba-413b-856b-6c31bf8b9425 req-afc7619c-6d7b-46b8-968b-c4caf3621be9 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:42.319239 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-064f8cc6-21ba-413b-856b-6c31bf8b9425 req-afc7619c-6d7b-46b8-968b-c4caf3621be9 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:42.343216 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.compute.server_external_events [req-064f8cc6-21ba-413b-856b-6c31bf8b9425 req-afc7619c-6d7b-46b8-968b-c4caf3621be9 service nova] Creating event network-changed:14e51cd2-ee26-4f88-bdde-048115f528a7 for instance 1b7917ad-8941-400f-ae66-d22e26633416 on hv-cinder-83009 Mar 08 14:51:42.350873 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [req-064f8cc6-21ba-413b-856b-6c31bf8b9425 req-afc7619c-6d7b-46b8-968b-c4caf3621be9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045193 Mar 08 14:51:42.352116 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 44/79] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 14:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:51:42.666971 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-627d7f7f-e5d8-485b-b4af-d77ad589ea89 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:42.678970 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-627d7f7f-e5d8-485b-b4af-d77ad589ea89 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1362 microversion: 2.1 time: 0.662481 Mar 08 14:51:42.679524 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 36/80] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:42 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1362 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:42.949986 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-e683de09-f8a6-4132-9851-4ef7bbccd478 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1fa92ad-6155-47f7-8b50-25f8df01ecfb"}} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:51:42.951154 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-e683de09-f8a6-4132-9851-4ef7bbccd478 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] [instance: ac35fcd8-53a0-4e7b-93f2-a49b20549362] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:42.967203 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e683de09-f8a6-4132-9851-4ef7bbccd478 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:42.967692 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e683de09-f8a6-4132-9851-4ef7bbccd478 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:42.970763 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e683de09-f8a6-4132-9851-4ef7bbccd478 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:42.971232 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e683de09-f8a6-4132-9851-4ef7bbccd478 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:43.032671 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b78fd02e-c311-46ea-9ce6-d759cff681f0 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:43.035094 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b78fd02e-c311-46ea-9ce6-d759cff681f0 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:43.054432 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b78fd02e-c311-46ea-9ce6-d759cff681f0 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:43.057534 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b78fd02e-c311-46ea-9ce6-d759cff681f0 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:43.059038 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b78fd02e-c311-46ea-9ce6-d759cff681f0 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:43.064197 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b78fd02e-c311-46ea-9ce6-d759cff681f0 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:43.443258 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b78fd02e-c311-46ea-9ce6-d759cff681f0 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:43.459074 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b78fd02e-c311-46ea-9ce6-d759cff681f0 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1322 microversion: 2.1 time: 0.431404 Mar 08 14:51:43.472637 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 37/81] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:43 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1322 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:43.482426 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [req-5f7ab818-c677-4aa8-af07-f38904feb2db req-69313105-6acc-4e7e-be3b-a0f59a007382 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f936e19e-08fe-43d1-8c05-2fc52d3a5a67", "name": "network-vif-plugged", "status": "completed", "tag": "99e3fcea-0b0c-49ed-b6a7-b37449f1b07c"}]} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:51:43.502529 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-5f7ab818-c677-4aa8-af07-f38904feb2db req-69313105-6acc-4e7e-be3b-a0f59a007382 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:43.503015 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-5f7ab818-c677-4aa8-af07-f38904feb2db req-69313105-6acc-4e7e-be3b-a0f59a007382 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:43.524765 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.compute.server_external_events [req-5f7ab818-c677-4aa8-af07-f38904feb2db req-69313105-6acc-4e7e-be3b-a0f59a007382 service nova] Creating event network-vif-plugged:99e3fcea-0b0c-49ed-b6a7-b37449f1b07c for instance f936e19e-08fe-43d1-8c05-2fc52d3a5a67 on hv-cinder-83009 Mar 08 14:51:43.530632 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [req-5f7ab818-c677-4aa8-af07-f38904feb2db req-69313105-6acc-4e7e-be3b-a0f59a007382 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056266 Mar 08 14:51:43.531820 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 38/82] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 14:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:51:43.540577 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-2a1817a8-4c2f-42d5-ba2f-5977d223d928 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:43.541570 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-2a1817a8-4c2f-42d5-ba2f-5977d223d928 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:43.550754 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2a1817a8-4c2f-42d5-ba2f-5977d223d928 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:43.551505 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2a1817a8-4c2f-42d5-ba2f-5977d223d928 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:43.552969 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2a1817a8-4c2f-42d5-ba2f-5977d223d928 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:43.553606 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2a1817a8-4c2f-42d5-ba2f-5977d223d928 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:43.798829 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-e683de09-f8a6-4132-9851-4ef7bbccd478 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] 10.222.0.30 "POST /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.853222 Mar 08 14:51:43.799368 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 45/83] 10.222.0.30 () {60 vars in 1322 bytes} [Tue Mar 8 14:51:42 2022] POST /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362/os-volume_attachments => generated 194 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:51:43.817275 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b394ab67-5be0-44e8-8c91-70b2975ca65f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:43.818218 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-b394ab67-5be0-44e8-8c91-70b2975ca65f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:43.833501 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b394ab67-5be0-44e8-8c91-70b2975ca65f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:43.834181 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b394ab67-5be0-44e8-8c91-70b2975ca65f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:43.835037 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b394ab67-5be0-44e8-8c91-70b2975ca65f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:43.835613 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b394ab67-5be0-44e8-8c91-70b2975ca65f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:44.077081 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-2a1817a8-4c2f-42d5-ba2f-5977d223d928 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:44.086591 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-2a1817a8-4c2f-42d5-ba2f-5977d223d928 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:44.088410 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-2a1817a8-4c2f-42d5-ba2f-5977d223d928 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:44.089998 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-2a1817a8-4c2f-42d5-ba2f-5977d223d928 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1407 microversion: 2.20 time: 0.556613 Mar 08 14:51:44.090804 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 39/84] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:51:43 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1407 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:51:44.186610 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-b394ab67-5be0-44e8-8c91-70b2975ca65f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:44.199342 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-b394ab67-5be0-44e8-8c91-70b2975ca65f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1362 microversion: 2.1 time: 0.395012 Mar 08 14:51:44.201932 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 46/85] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:43 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1362 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:44.481106 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-428b7d28-e9d8-48c9-a1d2-21e94be6f82d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:44.482026 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-428b7d28-e9d8-48c9-a1d2-21e94be6f82d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:44.502388 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-428b7d28-e9d8-48c9-a1d2-21e94be6f82d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:44.503318 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-428b7d28-e9d8-48c9-a1d2-21e94be6f82d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:44.504141 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-428b7d28-e9d8-48c9-a1d2-21e94be6f82d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:44.504585 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-428b7d28-e9d8-48c9-a1d2-21e94be6f82d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:44.738104 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-428b7d28-e9d8-48c9-a1d2-21e94be6f82d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:44.752724 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-428b7d28-e9d8-48c9-a1d2-21e94be6f82d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1322 microversion: 2.1 time: 0.277665 Mar 08 14:51:44.757410 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 40/86] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:44 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1322 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:45.118075 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-e21d6aa0-4563-45d5-8775-cc0c837c8813 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:45.119418 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-e21d6aa0-4563-45d5-8775-cc0c837c8813 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:45.132103 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e21d6aa0-4563-45d5-8775-cc0c837c8813 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:45.132913 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e21d6aa0-4563-45d5-8775-cc0c837c8813 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:45.134000 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e21d6aa0-4563-45d5-8775-cc0c837c8813 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:45.135464 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e21d6aa0-4563-45d5-8775-cc0c837c8813 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:45.220337 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-e4a1ed3f-31a0-4895-b1e2-d07f06b9648a tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:45.221239 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-e4a1ed3f-31a0-4895-b1e2-d07f06b9648a tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:45.237100 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e4a1ed3f-31a0-4895-b1e2-d07f06b9648a tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:45.240383 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e4a1ed3f-31a0-4895-b1e2-d07f06b9648a tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:45.243854 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e4a1ed3f-31a0-4895-b1e2-d07f06b9648a tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:45.244258 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e4a1ed3f-31a0-4895-b1e2-d07f06b9648a tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:45.564926 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-e21d6aa0-4563-45d5-8775-cc0c837c8813 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:45.580808 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-e21d6aa0-4563-45d5-8775-cc0c837c8813 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:45.583710 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-e21d6aa0-4563-45d5-8775-cc0c837c8813 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:45.585227 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-e21d6aa0-4563-45d5-8775-cc0c837c8813 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1407 microversion: 2.20 time: 0.479964 Mar 08 14:51:45.585846 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 47/87] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:51:45 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1407 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 14:51:45.596687 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [req-88811f2b-c76d-496d-8d24-170d4629f426 req-afc965f4-54ae-4f9c-ae50-64c2fb3fec4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b118641-910c-41a0-82cd-66f465d96e77", "name": "network-vif-plugged", "status": "completed", "tag": "45194c50-df18-4d74-b8bf-5c3a8941141f"}]} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:51:45.607305 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-88811f2b-c76d-496d-8d24-170d4629f426 req-afc965f4-54ae-4f9c-ae50-64c2fb3fec4d service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:45.607903 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-88811f2b-c76d-496d-8d24-170d4629f426 req-afc965f4-54ae-4f9c-ae50-64c2fb3fec4d service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:45.662542 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-e4a1ed3f-31a0-4895-b1e2-d07f06b9648a tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:45.670888 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-e4a1ed3f-31a0-4895-b1e2-d07f06b9648a tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1362 microversion: 2.1 time: 0.457307 Mar 08 14:51:45.673833 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 41/88] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:45 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1362 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:45.774808 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-7ae2713e-04bb-4026-b397-42620e667866 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:45.775315 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-7ae2713e-04bb-4026-b397-42620e667866 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:45.792679 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7ae2713e-04bb-4026-b397-42620e667866 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:45.794824 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7ae2713e-04bb-4026-b397-42620e667866 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:45.796371 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7ae2713e-04bb-4026-b397-42620e667866 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:45.799119 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7ae2713e-04bb-4026-b397-42620e667866 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:45.889448 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.compute.server_external_events [req-88811f2b-c76d-496d-8d24-170d4629f426 req-afc965f4-54ae-4f9c-ae50-64c2fb3fec4d service nova] Creating event network-vif-plugged:45194c50-df18-4d74-b8bf-5c3a8941141f for instance 0b118641-910c-41a0-82cd-66f465d96e77 on hv-cinder-83009 Mar 08 14:51:45.895512 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [req-88811f2b-c76d-496d-8d24-170d4629f426 req-afc965f4-54ae-4f9c-ae50-64c2fb3fec4d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.308405 Mar 08 14:51:45.896913 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 48/89] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 14:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:51:46.073505 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-7ae2713e-04bb-4026-b397-42620e667866 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:46.088549 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-7ae2713e-04bb-4026-b397-42620e667866 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1322 microversion: 2.1 time: 0.318724 Mar 08 14:51:46.089128 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 42/90] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:45 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1322 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:46.606406 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-08cdb254-5785-4fdd-a4a5-312ef5aa8c84 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:46.607112 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-08cdb254-5785-4fdd-a4a5-312ef5aa8c84 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:46.618733 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-08cdb254-5785-4fdd-a4a5-312ef5aa8c84 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:46.619499 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-08cdb254-5785-4fdd-a4a5-312ef5aa8c84 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:46.620276 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-08cdb254-5785-4fdd-a4a5-312ef5aa8c84 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:46.620722 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-08cdb254-5785-4fdd-a4a5-312ef5aa8c84 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:46.689442 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-4f769349-ef37-4f23-999c-954094151f21 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:46.690082 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-4f769349-ef37-4f23-999c-954094151f21 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:46.698122 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4f769349-ef37-4f23-999c-954094151f21 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:46.701143 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4f769349-ef37-4f23-999c-954094151f21 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:46.702136 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4f769349-ef37-4f23-999c-954094151f21 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:46.704001 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4f769349-ef37-4f23-999c-954094151f21 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:46.859126 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-08cdb254-5785-4fdd-a4a5-312ef5aa8c84 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:46.870344 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-08cdb254-5785-4fdd-a4a5-312ef5aa8c84 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:46.872282 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-08cdb254-5785-4fdd-a4a5-312ef5aa8c84 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:46.873995 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-08cdb254-5785-4fdd-a4a5-312ef5aa8c84 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1407 microversion: 2.20 time: 0.273537 Mar 08 14:51:46.875215 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 49/91] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:51:46 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1407 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:51:46.976352 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-4f769349-ef37-4f23-999c-954094151f21 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:46.986867 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-4f769349-ef37-4f23-999c-954094151f21 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1362 microversion: 2.1 time: 0.301211 Mar 08 14:51:46.989074 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 43/92] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:46 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1362 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:51:47.106187 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-6a14be07-7704-4ce6-9adc-6d0e992f8c5d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:47.107014 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-6a14be07-7704-4ce6-9adc-6d0e992f8c5d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:47.122778 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6a14be07-7704-4ce6-9adc-6d0e992f8c5d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:47.123232 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6a14be07-7704-4ce6-9adc-6d0e992f8c5d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:47.124000 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6a14be07-7704-4ce6-9adc-6d0e992f8c5d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:47.124493 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6a14be07-7704-4ce6-9adc-6d0e992f8c5d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:47.470808 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-6a14be07-7704-4ce6-9adc-6d0e992f8c5d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:47.489422 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-6a14be07-7704-4ce6-9adc-6d0e992f8c5d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1322 microversion: 2.1 time: 0.387122 Mar 08 14:51:47.490213 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 50/93] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:47 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1322 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:47.891774 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ec2753a2-745d-447d-8060-77ec09123098 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:47.894273 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ec2753a2-745d-447d-8060-77ec09123098 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:47.903159 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ec2753a2-745d-447d-8060-77ec09123098 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:47.904027 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ec2753a2-745d-447d-8060-77ec09123098 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:47.905327 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ec2753a2-745d-447d-8060-77ec09123098 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:47.905991 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ec2753a2-745d-447d-8060-77ec09123098 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:47.919049 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [req-5102af64-4ef1-46e4-a591-7978435f4433 req-c407460d-25c7-41eb-a7da-46861eb3a18a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04409dca-0761-4f98-b039-a620e2bef81e", "name": "network-vif-plugged", "status": "completed", "tag": "2a5a9e74-f475-4a3f-a2cc-034ea707cdeb"}]} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:51:47.939318 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-5102af64-4ef1-46e4-a591-7978435f4433 req-c407460d-25c7-41eb-a7da-46861eb3a18a service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:47.939767 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-5102af64-4ef1-46e4-a591-7978435f4433 req-c407460d-25c7-41eb-a7da-46861eb3a18a service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:47.954363 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.compute.server_external_events [req-5102af64-4ef1-46e4-a591-7978435f4433 req-c407460d-25c7-41eb-a7da-46861eb3a18a service nova] Creating event network-vif-plugged:2a5a9e74-f475-4a3f-a2cc-034ea707cdeb for instance 04409dca-0761-4f98-b039-a620e2bef81e on hv-cinder-83009 Mar 08 14:51:47.960349 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [req-5102af64-4ef1-46e4-a591-7978435f4433 req-c407460d-25c7-41eb-a7da-46861eb3a18a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046541 Mar 08 14:51:47.960942 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 51/94] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 14:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:51:48.010530 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-498b5a4a-4049-4b2c-9e3f-d381ff78cf77 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:48.011136 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-498b5a4a-4049-4b2c-9e3f-d381ff78cf77 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:48.020368 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-498b5a4a-4049-4b2c-9e3f-d381ff78cf77 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:48.020818 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-498b5a4a-4049-4b2c-9e3f-d381ff78cf77 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:48.021636 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-498b5a4a-4049-4b2c-9e3f-d381ff78cf77 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:48.022093 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-498b5a4a-4049-4b2c-9e3f-d381ff78cf77 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:48.197228 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ec2753a2-745d-447d-8060-77ec09123098 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:48.209557 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ec2753a2-745d-447d-8060-77ec09123098 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:48.211183 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ec2753a2-745d-447d-8060-77ec09123098 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:48.212318 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ec2753a2-745d-447d-8060-77ec09123098 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1407 microversion: 2.20 time: 0.325432 Mar 08 14:51:48.212883 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 44/95] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:51:47 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1407 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:51:48.242869 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-498b5a4a-4049-4b2c-9e3f-d381ff78cf77 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:48.251371 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-498b5a4a-4049-4b2c-9e3f-d381ff78cf77 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1362 microversion: 2.1 time: 0.248657 Mar 08 14:51:48.262332 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 52/96] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:48 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1362 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:51:48.507389 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-40247f8d-bdce-484d-ab4a-fe5a461c9508 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:48.508209 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-40247f8d-bdce-484d-ab4a-fe5a461c9508 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:48.515092 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-40247f8d-bdce-484d-ab4a-fe5a461c9508 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:48.515556 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-40247f8d-bdce-484d-ab4a-fe5a461c9508 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:48.516466 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-40247f8d-bdce-484d-ab4a-fe5a461c9508 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:48.516820 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-40247f8d-bdce-484d-ab4a-fe5a461c9508 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:48.725727 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-40247f8d-bdce-484d-ab4a-fe5a461c9508 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:48.736163 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-40247f8d-bdce-484d-ab4a-fe5a461c9508 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1517 microversion: 2.1 time: 0.233704 Mar 08 14:51:48.737792 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 45/97] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:48 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1517 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:48.755993 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-59fe1673-7ef4-4cd4-ab54-e7f206f98ac3 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:51:48.757945 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-59fe1673-7ef4-4cd4-ab54-e7f206f98ac3 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:48.765063 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-59fe1673-7ef4-4cd4-ab54-e7f206f98ac3 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:48.765817 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-59fe1673-7ef4-4cd4-ab54-e7f206f98ac3 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:48.766843 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-59fe1673-7ef4-4cd4-ab54-e7f206f98ac3 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:48.767492 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-59fe1673-7ef4-4cd4-ab54-e7f206f98ac3 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:48.792792 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.objects.instance [None req-59fe1673-7ef4-4cd4-ab54-e7f206f98ac3 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lazy-loading 'flavor' on Instance uuid 0b118641-910c-41a0-82cd-66f465d96e77 {{(pid=128351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 14:51:48.926927 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-59fe1673-7ef4-4cd4-ab54-e7f206f98ac3 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "POST /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77/action" status: 200 len: 32 microversion: 2.1 time: 0.176185 Mar 08 14:51:48.927591 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 53/98] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Mar 8 14:51:48 2022] POST /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77/action => generated 32 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 08 14:51:48.937349 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-bde6f6a7-b979-4ffa-99b2-0008fbbd0ed7 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:48.937963 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-bde6f6a7-b979-4ffa-99b2-0008fbbd0ed7 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:48.944704 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bde6f6a7-b979-4ffa-99b2-0008fbbd0ed7 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:48.945375 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bde6f6a7-b979-4ffa-99b2-0008fbbd0ed7 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:48.946591 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bde6f6a7-b979-4ffa-99b2-0008fbbd0ed7 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:48.947188 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bde6f6a7-b979-4ffa-99b2-0008fbbd0ed7 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:49.185700 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-bde6f6a7-b979-4ffa-99b2-0008fbbd0ed7 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:49.194004 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-bde6f6a7-b979-4ffa-99b2-0008fbbd0ed7 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1523 microversion: 2.1 time: 0.260854 Mar 08 14:51:49.203542 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 46/99] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:48 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1523 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:51:49.231518 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-9a5bb4e3-de51-48c2-94fe-c3a8e2d363c2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:49.232602 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-9a5bb4e3-de51-48c2-94fe-c3a8e2d363c2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:49.239380 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9a5bb4e3-de51-48c2-94fe-c3a8e2d363c2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:49.239974 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9a5bb4e3-de51-48c2-94fe-c3a8e2d363c2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:49.240925 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9a5bb4e3-de51-48c2-94fe-c3a8e2d363c2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:49.241550 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9a5bb4e3-de51-48c2-94fe-c3a8e2d363c2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:49.269655 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3dd2f5e3-911b-4fca-8fc1-ddcc003b85df tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:49.270353 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-3dd2f5e3-911b-4fca-8fc1-ddcc003b85df tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:49.283286 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3dd2f5e3-911b-4fca-8fc1-ddcc003b85df tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:49.283834 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3dd2f5e3-911b-4fca-8fc1-ddcc003b85df tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:49.284747 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3dd2f5e3-911b-4fca-8fc1-ddcc003b85df tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:49.285408 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3dd2f5e3-911b-4fca-8fc1-ddcc003b85df tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:49.402317 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-9a5bb4e3-de51-48c2-94fe-c3a8e2d363c2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:49.414856 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-9a5bb4e3-de51-48c2-94fe-c3a8e2d363c2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:49.416620 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-9a5bb4e3-de51-48c2-94fe-c3a8e2d363c2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:49.418658 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-9a5bb4e3-de51-48c2-94fe-c3a8e2d363c2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1407 microversion: 2.20 time: 0.191115 Mar 08 14:51:49.420193 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 54/100] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:51:49 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:51:49.650439 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-3dd2f5e3-911b-4fca-8fc1-ddcc003b85df tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:49.666091 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-3dd2f5e3-911b-4fca-8fc1-ddcc003b85df tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1362 microversion: 2.1 time: 0.401028 Mar 08 14:51:49.672984 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 47/101] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:49 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1362 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:51:49.985661 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [req-46f3b29a-e4be-489d-9e63-48a13550b3b7 req-7555bad7-29a4-4560-a4d7-de9e96c128b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b7917ad-8941-400f-ae66-d22e26633416", "name": "network-vif-plugged", "status": "completed", "tag": "14e51cd2-ee26-4f88-bdde-048115f528a7"}]} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:51:49.995004 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-46f3b29a-e4be-489d-9e63-48a13550b3b7 req-7555bad7-29a4-4560-a4d7-de9e96c128b9 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:49.995472 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-46f3b29a-e4be-489d-9e63-48a13550b3b7 req-7555bad7-29a4-4560-a4d7-de9e96c128b9 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:50.011963 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.compute.server_external_events [req-46f3b29a-e4be-489d-9e63-48a13550b3b7 req-7555bad7-29a4-4560-a4d7-de9e96c128b9 service nova] Creating event network-vif-plugged:14e51cd2-ee26-4f88-bdde-048115f528a7 for instance 1b7917ad-8941-400f-ae66-d22e26633416 on hv-cinder-83009 Mar 08 14:51:50.017260 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [req-46f3b29a-e4be-489d-9e63-48a13550b3b7 req-7555bad7-29a4-4560-a4d7-de9e96c128b9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039998 Mar 08 14:51:50.018499 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 55/102] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 14:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:51:50.210543 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-85364055-f818-4119-919a-fa348f7a5bb4 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:50.211271 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-85364055-f818-4119-919a-fa348f7a5bb4 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:50.220261 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-85364055-f818-4119-919a-fa348f7a5bb4 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:50.221595 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-85364055-f818-4119-919a-fa348f7a5bb4 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:50.224262 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-85364055-f818-4119-919a-fa348f7a5bb4 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:50.225947 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-85364055-f818-4119-919a-fa348f7a5bb4 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:50.439961 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-82b0424a-ca8c-468b-b91e-eaccadad4e2b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:50.442272 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-82b0424a-ca8c-468b-b91e-eaccadad4e2b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:50.450975 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-82b0424a-ca8c-468b-b91e-eaccadad4e2b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:50.451750 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-82b0424a-ca8c-468b-b91e-eaccadad4e2b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:50.452749 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-82b0424a-ca8c-468b-b91e-eaccadad4e2b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:50.453501 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-82b0424a-ca8c-468b-b91e-eaccadad4e2b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:50.661561 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-85364055-f818-4119-919a-fa348f7a5bb4 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:50.669888 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-85364055-f818-4119-919a-fa348f7a5bb4 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1523 microversion: 2.1 time: 0.463771 Mar 08 14:51:50.680080 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 48/103] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:50 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1523 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:50.687375 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3481257f-ed4b-4535-9dac-f015cbfc75f0 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:50.687987 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-3481257f-ed4b-4535-9dac-f015cbfc75f0 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:50.695969 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3481257f-ed4b-4535-9dac-f015cbfc75f0 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:50.696444 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3481257f-ed4b-4535-9dac-f015cbfc75f0 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:50.697407 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3481257f-ed4b-4535-9dac-f015cbfc75f0 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:50.697840 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3481257f-ed4b-4535-9dac-f015cbfc75f0 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:50.733140 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-82b0424a-ca8c-468b-b91e-eaccadad4e2b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:50.741768 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-82b0424a-ca8c-468b-b91e-eaccadad4e2b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:50.746977 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-82b0424a-ca8c-468b-b91e-eaccadad4e2b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:50.750465 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-82b0424a-ca8c-468b-b91e-eaccadad4e2b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1407 microversion: 2.20 time: 0.316494 Mar 08 14:51:50.752091 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 56/104] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:51:50 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1407 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 14:51:50.857737 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-3481257f-ed4b-4535-9dac-f015cbfc75f0 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:50.866729 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-3481257f-ed4b-4535-9dac-f015cbfc75f0 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1548 microversion: 2.1 time: 0.183849 Mar 08 14:51:50.867776 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 49/105] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:50 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1548 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:51:50.884863 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-60f14eea-c3ac-446b-af58-9cc7d52b07ea tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:50.885689 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-60f14eea-c3ac-446b-af58-9cc7d52b07ea tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:50.892113 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-60f14eea-c3ac-446b-af58-9cc7d52b07ea tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:50.892886 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-60f14eea-c3ac-446b-af58-9cc7d52b07ea tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:50.894621 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-60f14eea-c3ac-446b-af58-9cc7d52b07ea tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:50.895305 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-60f14eea-c3ac-446b-af58-9cc7d52b07ea tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:50.993125 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-60f14eea-c3ac-446b-af58-9cc7d52b07ea tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.112151 Mar 08 14:51:50.994075 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 57/106] 10.222.0.30 () {58 vars in 1274 bytes} [Tue Mar 8 14:51:50 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e/os-interface => generated 284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:51:51.689741 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-fcb0e260-48dc-40fe-a38e-c7c5ba733854 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:51.691772 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-fcb0e260-48dc-40fe-a38e-c7c5ba733854 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:51.703809 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fcb0e260-48dc-40fe-a38e-c7c5ba733854 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:51.704404 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fcb0e260-48dc-40fe-a38e-c7c5ba733854 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:51.705558 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fcb0e260-48dc-40fe-a38e-c7c5ba733854 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:51.706282 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fcb0e260-48dc-40fe-a38e-c7c5ba733854 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:51.771054 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-1328bc4d-cead-4df8-bcac-691c0d15d9c8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:51.771912 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-1328bc4d-cead-4df8-bcac-691c0d15d9c8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:51.778845 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1328bc4d-cead-4df8-bcac-691c0d15d9c8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:51.779572 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1328bc4d-cead-4df8-bcac-691c0d15d9c8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:51.780979 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1328bc4d-cead-4df8-bcac-691c0d15d9c8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:51.781783 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1328bc4d-cead-4df8-bcac-691c0d15d9c8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:51.923924 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-fcb0e260-48dc-40fe-a38e-c7c5ba733854 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:51.938085 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-fcb0e260-48dc-40fe-a38e-c7c5ba733854 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1523 microversion: 2.1 time: 0.248184 Mar 08 14:51:51.938085 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 50/107] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:51 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1523 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:52.365445 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-1328bc4d-cead-4df8-bcac-691c0d15d9c8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:52.375973 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-1328bc4d-cead-4df8-bcac-691c0d15d9c8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:52.378203 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-1328bc4d-cead-4df8-bcac-691c0d15d9c8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:52.379418 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-1328bc4d-cead-4df8-bcac-691c0d15d9c8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1407 microversion: 2.20 time: 0.614660 Mar 08 14:51:52.379988 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 58/108] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:51:51 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1407 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 14:51:52.523794 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-72f40314-d82b-4e5b-b8b6-aa9bb0a407b2 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-80884448", "imageRef": "7541d53b-003d-4f1a-8d76-fc5f4bd8dabf", "flavorRef": "452", "networks": [{"uuid": "bdbc59ae-a037-4071-94d0-6d42a3375e97"}]}} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:51:52.595658 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.network.neutron [None req-72f40314-d82b-4e5b-b8b6-aa9bb0a407b2 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] validate_networks() for [('bdbc59ae-a037-4071-94d0-6d42a3375e97', None, None, None, None, None)] {{(pid=128352) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 14:51:52.757298 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-11ffa856-b247-4b24-aea3-46bda9a244ec tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:52.757790 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-11ffa856-b247-4b24-aea3-46bda9a244ec tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] [instance: ac35fcd8-53a0-4e7b-93f2-a49b20549362] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:52.764861 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-11ffa856-b247-4b24-aea3-46bda9a244ec tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:52.765540 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-11ffa856-b247-4b24-aea3-46bda9a244ec tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:52.766526 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-11ffa856-b247-4b24-aea3-46bda9a244ec tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:52.767141 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-11ffa856-b247-4b24-aea3-46bda9a244ec tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:52.797212 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-11ffa856-b247-4b24-aea3-46bda9a244ec tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] [instance: ac35fcd8-53a0-4e7b-93f2-a49b20549362] Going to try to terminate instance {{(pid=128351) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 14:51:52.915674 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-11ffa856-b247-4b24-aea3-46bda9a244ec tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362" status: 204 len: 0 microversion: 2.1 time: 0.161688 Mar 08 14:51:52.916434 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 59/109] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 14:51:52 2022] DELETE /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 08 14:51:52.924868 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [req-4b11aa76-26b1-4bc9-b769-94d508665202 req-3a47911e-e2f7-4409-a480-dd95b64ea49b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04409dca-0761-4f98-b039-a620e2bef81e", "tag": "2a5a9e74-f475-4a3f-a2cc-034ea707cdeb"}]} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:51:52.936619 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-4b11aa76-26b1-4bc9-b769-94d508665202 req-3a47911e-e2f7-4409-a480-dd95b64ea49b service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:52.937524 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-4b11aa76-26b1-4bc9-b769-94d508665202 req-3a47911e-e2f7-4409-a480-dd95b64ea49b service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:52.962076 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.compute.server_external_events [req-4b11aa76-26b1-4bc9-b769-94d508665202 req-3a47911e-e2f7-4409-a480-dd95b64ea49b service nova] Creating event network-changed:2a5a9e74-f475-4a3f-a2cc-034ea707cdeb for instance 04409dca-0761-4f98-b039-a620e2bef81e on hv-cinder-83009 Mar 08 14:51:52.968941 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [req-4b11aa76-26b1-4bc9-b769-94d508665202 req-3a47911e-e2f7-4409-a480-dd95b64ea49b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050756 Mar 08 14:51:52.969602 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 60/110] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 14:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:51:52.976407 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-df72f791-0d27-44b8-93de-45196853bca8 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:52.977484 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-df72f791-0d27-44b8-93de-45196853bca8 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] [instance: ac35fcd8-53a0-4e7b-93f2-a49b20549362] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:52.984416 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-df72f791-0d27-44b8-93de-45196853bca8 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:52.984927 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-df72f791-0d27-44b8-93de-45196853bca8 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:52.985717 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-df72f791-0d27-44b8-93de-45196853bca8 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:52.986523 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-df72f791-0d27-44b8-93de-45196853bca8 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:53.083940 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.virt.hardware [None req-72f40314-d82b-4e5b-b8b6-aa9bb0a407b2 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Flavor limits 0:0:0 {{(pid=128352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 14:51:53.085839 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.virt.hardware [None req-72f40314-d82b-4e5b-b8b6-aa9bb0a407b2 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Image limits 0:0:0 {{(pid=128352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 14:51:53.087591 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.virt.hardware [None req-72f40314-d82b-4e5b-b8b6-aa9bb0a407b2 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Flavor pref 0:0:0 {{(pid=128352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 14:51:53.088958 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.virt.hardware [None req-72f40314-d82b-4e5b-b8b6-aa9bb0a407b2 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Image pref 0:0:0 {{(pid=128352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 14:51:53.090782 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.virt.hardware [None req-72f40314-d82b-4e5b-b8b6-aa9bb0a407b2 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 14:51:53.107227 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-72f40314-d82b-4e5b-b8b6-aa9bb0a407b2 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:53.107949 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-72f40314-d82b-4e5b-b8b6-aa9bb0a407b2 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:53.109626 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-72f40314-d82b-4e5b-b8b6-aa9bb0a407b2 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:53.110477 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-72f40314-d82b-4e5b-b8b6-aa9bb0a407b2 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:53.135564 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.quota [None req-72f40314-d82b-4e5b-b8b6-aa9bb0a407b2 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Getting quotas for project 4c0e945e64844205b1df851fb73e1ea2. Resources: {'instances', 'ram', 'cores'} {{(pid=128352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 14:51:53.139927 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.quota [None req-72f40314-d82b-4e5b-b8b6-aa9bb0a407b2 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Getting quotas for user 6cb5f67687dc4e9892e8ddd5c0aca940 and project 4c0e945e64844205b1df851fb73e1ea2. Resources: {'instances', 'ram', 'cores'} {{(pid=128352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 14:51:53.153046 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-72f40314-d82b-4e5b-b8b6-aa9bb0a407b2 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Going to run 1 instances... {{(pid=128352) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 14:51:53.155433 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-72f40314-d82b-4e5b-b8b6-aa9bb0a407b2 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] [instance: cca3d7fe-2031-420b-9848-8d65b1058b44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7541d53b-003d-4f1a-8d76-fc5f4bd8dabf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 14:51:53.167476 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-df72f791-0d27-44b8-93de-45196853bca8 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a343c19dc5f4ca1bcf659d05ffa92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dce7630acc4cbc80b4cb3ba27c7dd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:53.177067 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-df72f791-0d27-44b8-93de-45196853bca8 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] 10.222.0.30 "GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362" status: 200 len: 1553 microversion: 2.1 time: 0.206031 Mar 08 14:51:53.178362 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 61/111] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:52 2022] GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362 => generated 1553 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:53.183655 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-ce8e9f33-38aa-4737-97a4-33e0384f58b2 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:53.184508 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-ce8e9f33-38aa-4737-97a4-33e0384f58b2 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:53.191864 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ce8e9f33-38aa-4737-97a4-33e0384f58b2 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:53.192435 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ce8e9f33-38aa-4737-97a4-33e0384f58b2 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:53.193457 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ce8e9f33-38aa-4737-97a4-33e0384f58b2 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:53.194163 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ce8e9f33-38aa-4737-97a4-33e0384f58b2 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:53.224501 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-72f40314-d82b-4e5b-b8b6-aa9bb0a407b2 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.707568 Mar 08 14:51:53.230959 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 51/112] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Mar 8 14:51:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 14:51:53.246406 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-00d9756b-aab7-447e-8341-5f38dea8f1cb tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:53.247270 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-00d9756b-aab7-447e-8341-5f38dea8f1cb tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] [instance: cca3d7fe-2031-420b-9848-8d65b1058b44] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:53.371642 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-00d9756b-aab7-447e-8341-5f38dea8f1cb tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb5f67687dc4e9892e8ddd5c0aca940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e945e64844205b1df851fb73e1ea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:53.380825 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-00d9756b-aab7-447e-8341-5f38dea8f1cb tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] 10.222.0.30 "GET /compute/v2.1/servers/cca3d7fe-2031-420b-9848-8d65b1058b44" status: 200 len: 1212 microversion: 2.1 time: 0.147556 Mar 08 14:51:53.381702 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 52/113] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:53 2022] GET /compute/v2.1/servers/cca3d7fe-2031-420b-9848-8d65b1058b44 => generated 1212 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:53.406964 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-4075a992-1e78-41ec-a6eb-e2034800a022 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:53.408382 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-4075a992-1e78-41ec-a6eb-e2034800a022 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:53.416404 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4075a992-1e78-41ec-a6eb-e2034800a022 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:53.417106 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4075a992-1e78-41ec-a6eb-e2034800a022 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:53.418823 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4075a992-1e78-41ec-a6eb-e2034800a022 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:53.419348 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4075a992-1e78-41ec-a6eb-e2034800a022 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:53.482114 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-ce8e9f33-38aa-4737-97a4-33e0384f58b2 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:53.493082 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-ce8e9f33-38aa-4737-97a4-33e0384f58b2 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1523 microversion: 2.1 time: 0.311478 Mar 08 14:51:53.493684 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 62/114] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:53 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1523 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:53.681437 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-4075a992-1e78-41ec-a6eb-e2034800a022 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:53.697351 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-4075a992-1e78-41ec-a6eb-e2034800a022 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:53.700533 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-4075a992-1e78-41ec-a6eb-e2034800a022 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:53.716670 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-4075a992-1e78-41ec-a6eb-e2034800a022 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1600 microversion: 2.20 time: 0.320709 Mar 08 14:51:53.726560 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 53/115] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:51:53 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1600 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:51:53.736071 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-bb9d5a0b-de3d-4349-85c8-26142f0e0c02 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:53.736681 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-bb9d5a0b-de3d-4349-85c8-26142f0e0c02 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:53.745981 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bb9d5a0b-de3d-4349-85c8-26142f0e0c02 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:53.746576 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bb9d5a0b-de3d-4349-85c8-26142f0e0c02 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:53.747371 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bb9d5a0b-de3d-4349-85c8-26142f0e0c02 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:53.747817 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bb9d5a0b-de3d-4349-85c8-26142f0e0c02 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:53.872738 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-bb9d5a0b-de3d-4349-85c8-26142f0e0c02 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.140620 Mar 08 14:51:53.873480 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 63/116] 10.222.0.30 () {60 vars in 1315 bytes} [Tue Mar 8 14:51:53 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-interface => generated 285 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:51:54.194223 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-de87a861-3962-4456-9c7b-536682197952 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:54.195442 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-de87a861-3962-4456-9c7b-536682197952 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] [instance: ac35fcd8-53a0-4e7b-93f2-a49b20549362] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:54.210394 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-de87a861-3962-4456-9c7b-536682197952 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:54.214175 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-de87a861-3962-4456-9c7b-536682197952 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:54.215409 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-de87a861-3962-4456-9c7b-536682197952 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:54.216008 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-de87a861-3962-4456-9c7b-536682197952 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:54.402121 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-6987b5b0-e419-455c-8d23-730e52cb4053 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:54.403705 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-6987b5b0-e419-455c-8d23-730e52cb4053 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] [instance: cca3d7fe-2031-420b-9848-8d65b1058b44] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:54.414379 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6987b5b0-e419-455c-8d23-730e52cb4053 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:54.416605 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6987b5b0-e419-455c-8d23-730e52cb4053 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:54.418472 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6987b5b0-e419-455c-8d23-730e52cb4053 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:54.420294 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6987b5b0-e419-455c-8d23-730e52cb4053 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:54.481754 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-de87a861-3962-4456-9c7b-536682197952 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a343c19dc5f4ca1bcf659d05ffa92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dce7630acc4cbc80b4cb3ba27c7dd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:54.498562 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-de87a861-3962-4456-9c7b-536682197952 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] 10.222.0.30 "GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362" status: 200 len: 1553 microversion: 2.1 time: 0.308732 Mar 08 14:51:54.501006 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 54/117] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:54 2022] GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362 => generated 1553 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:54.510815 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d9b928fd-6cb6-40f5-ad9b-c05573300a55 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:54.511751 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d9b928fd-6cb6-40f5-ad9b-c05573300a55 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:54.520616 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d9b928fd-6cb6-40f5-ad9b-c05573300a55 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:54.521437 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d9b928fd-6cb6-40f5-ad9b-c05573300a55 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:54.522482 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d9b928fd-6cb6-40f5-ad9b-c05573300a55 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:54.523165 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d9b928fd-6cb6-40f5-ad9b-c05573300a55 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:54.539304 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-6987b5b0-e419-455c-8d23-730e52cb4053 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb5f67687dc4e9892e8ddd5c0aca940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e945e64844205b1df851fb73e1ea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:54.562282 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-6987b5b0-e419-455c-8d23-730e52cb4053 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] 10.222.0.30 "GET /compute/v2.1/servers/cca3d7fe-2031-420b-9848-8d65b1058b44" status: 200 len: 1264 microversion: 2.1 time: 0.165162 Mar 08 14:51:54.563558 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 64/118] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:54 2022] GET /compute/v2.1/servers/cca3d7fe-2031-420b-9848-8d65b1058b44 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:54.798242 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d9b928fd-6cb6-40f5-ad9b-c05573300a55 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:54.807466 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d9b928fd-6cb6-40f5-ad9b-c05573300a55 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1523 microversion: 2.1 time: 0.300335 Mar 08 14:51:54.807994 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 55/119] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:54 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1523 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:55.519359 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-0ee8f25b-7e45-424f-b310-28db4f582217 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:55.520258 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-0ee8f25b-7e45-424f-b310-28db4f582217 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] [instance: ac35fcd8-53a0-4e7b-93f2-a49b20549362] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:55.528311 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0ee8f25b-7e45-424f-b310-28db4f582217 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:55.528772 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0ee8f25b-7e45-424f-b310-28db4f582217 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:55.529773 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0ee8f25b-7e45-424f-b310-28db4f582217 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:55.530052 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0ee8f25b-7e45-424f-b310-28db4f582217 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:55.589018 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d6e8a113-7e37-4f5f-b9d4-bb2e6ca1be5b tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:55.589642 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d6e8a113-7e37-4f5f-b9d4-bb2e6ca1be5b tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] [instance: cca3d7fe-2031-420b-9848-8d65b1058b44] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:55.606886 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d6e8a113-7e37-4f5f-b9d4-bb2e6ca1be5b tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:55.607682 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d6e8a113-7e37-4f5f-b9d4-bb2e6ca1be5b tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:55.608827 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d6e8a113-7e37-4f5f-b9d4-bb2e6ca1be5b tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:55.609553 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d6e8a113-7e37-4f5f-b9d4-bb2e6ca1be5b tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:55.720576 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-0ee8f25b-7e45-424f-b310-28db4f582217 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a343c19dc5f4ca1bcf659d05ffa92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dce7630acc4cbc80b4cb3ba27c7dd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:55.731590 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-0ee8f25b-7e45-424f-b310-28db4f582217 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] 10.222.0.30 "GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362" status: 200 len: 1553 microversion: 2.1 time: 0.217255 Mar 08 14:51:55.742056 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 65/120] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:55 2022] GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362 => generated 1553 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:55.749489 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [req-350d02fc-7551-40b2-a38a-c7cd8d51446c req-bae3d7bd-3e9e-4825-9278-cc027f65812f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b7917ad-8941-400f-ae66-d22e26633416", "tag": "14e51cd2-ee26-4f88-bdde-048115f528a7"}]} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:51:55.758504 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-350d02fc-7551-40b2-a38a-c7cd8d51446c req-bae3d7bd-3e9e-4825-9278-cc027f65812f service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:55.759191 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-350d02fc-7551-40b2-a38a-c7cd8d51446c req-bae3d7bd-3e9e-4825-9278-cc027f65812f service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:55.773839 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.compute.server_external_events [req-350d02fc-7551-40b2-a38a-c7cd8d51446c req-bae3d7bd-3e9e-4825-9278-cc027f65812f service nova] Creating event network-changed:14e51cd2-ee26-4f88-bdde-048115f528a7 for instance 1b7917ad-8941-400f-ae66-d22e26633416 on hv-cinder-83009 Mar 08 14:51:55.785197 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [req-350d02fc-7551-40b2-a38a-c7cd8d51446c req-bae3d7bd-3e9e-4825-9278-cc027f65812f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040620 Mar 08 14:51:55.786645 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 66/121] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 14:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:51:55.798307 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d6e8a113-7e37-4f5f-b9d4-bb2e6ca1be5b tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb5f67687dc4e9892e8ddd5c0aca940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e945e64844205b1df851fb73e1ea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:55.811302 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d6e8a113-7e37-4f5f-b9d4-bb2e6ca1be5b tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] 10.222.0.30 "GET /compute/v2.1/servers/cca3d7fe-2031-420b-9848-8d65b1058b44" status: 200 len: 1270 microversion: 2.1 time: 0.233184 Mar 08 14:51:55.812099 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 56/122] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:55 2022] GET /compute/v2.1/servers/cca3d7fe-2031-420b-9848-8d65b1058b44 => generated 1270 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:55.829751 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-a9f23991-2425-4f5b-aa34-4501492ac07d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:55.830491 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-a9f23991-2425-4f5b-aa34-4501492ac07d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:55.837376 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a9f23991-2425-4f5b-aa34-4501492ac07d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:55.837920 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a9f23991-2425-4f5b-aa34-4501492ac07d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:55.838640 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a9f23991-2425-4f5b-aa34-4501492ac07d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:55.839081 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a9f23991-2425-4f5b-aa34-4501492ac07d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:56.074134 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-a9f23991-2425-4f5b-aa34-4501492ac07d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:56.086663 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-a9f23991-2425-4f5b-aa34-4501492ac07d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1523 microversion: 2.1 time: 0.260790 Mar 08 14:51:56.098247 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 67/123] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:55 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1523 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:56.762649 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b5540406-4767-4a6a-ad5d-ab95bb1f060a tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:56.763285 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b5540406-4767-4a6a-ad5d-ab95bb1f060a tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] [instance: ac35fcd8-53a0-4e7b-93f2-a49b20549362] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:56.782094 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b5540406-4767-4a6a-ad5d-ab95bb1f060a tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:56.782592 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b5540406-4767-4a6a-ad5d-ab95bb1f060a tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:56.788617 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b5540406-4767-4a6a-ad5d-ab95bb1f060a tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:56.788764 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b5540406-4767-4a6a-ad5d-ab95bb1f060a tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:56.835130 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-d1b839d2-f4f6-40bb-a601-e49432f5a205 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:56.837238 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-d1b839d2-f4f6-40bb-a601-e49432f5a205 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] [instance: cca3d7fe-2031-420b-9848-8d65b1058b44] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:56.870441 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d1b839d2-f4f6-40bb-a601-e49432f5a205 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:56.873611 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d1b839d2-f4f6-40bb-a601-e49432f5a205 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:56.878683 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d1b839d2-f4f6-40bb-a601-e49432f5a205 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:56.889453 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d1b839d2-f4f6-40bb-a601-e49432f5a205 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:57.177436 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-d1b839d2-f4f6-40bb-a601-e49432f5a205 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb5f67687dc4e9892e8ddd5c0aca940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e945e64844205b1df851fb73e1ea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:57.185916 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-d1b839d2-f4f6-40bb-a601-e49432f5a205 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] 10.222.0.30 "GET /compute/v2.1/servers/cca3d7fe-2031-420b-9848-8d65b1058b44" status: 200 len: 1312 microversion: 2.1 time: 0.358542 Mar 08 14:51:57.202852 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 68/124] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:56 2022] GET /compute/v2.1/servers/cca3d7fe-2031-420b-9848-8d65b1058b44 => generated 1312 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:57.228807 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-0e69b510-c017-4315-b333-d33c8360529e tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:57.229696 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-0e69b510-c017-4315-b333-d33c8360529e tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:57.236175 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0e69b510-c017-4315-b333-d33c8360529e tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:57.236882 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0e69b510-c017-4315-b333-d33c8360529e tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:57.237976 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0e69b510-c017-4315-b333-d33c8360529e tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:57.238569 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0e69b510-c017-4315-b333-d33c8360529e tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:57.493038 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-0e69b510-c017-4315-b333-d33c8360529e tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:57.502002 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-0e69b510-c017-4315-b333-d33c8360529e tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1523 microversion: 2.1 time: 0.297698 Mar 08 14:51:57.502624 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 69/125] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:57 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1523 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:57.566040 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [req-96340af0-9ccd-481e-8198-c22ac4d2559a req-3874fbfa-4430-4afe-881b-288253e5ccdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac35fcd8-53a0-4e7b-93f2-a49b20549362", "name": "network-vif-deleted", "tag": "528f8832-4152-4513-9a7f-8d551b1fbad3"}]} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:51:57.590098 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-96340af0-9ccd-481e-8198-c22ac4d2559a req-3874fbfa-4430-4afe-881b-288253e5ccdc service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:57.590796 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-96340af0-9ccd-481e-8198-c22ac4d2559a req-3874fbfa-4430-4afe-881b-288253e5ccdc service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:57.598250 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b5540406-4767-4a6a-ad5d-ab95bb1f060a tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a343c19dc5f4ca1bcf659d05ffa92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dce7630acc4cbc80b4cb3ba27c7dd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:57.615024 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b5540406-4767-4a6a-ad5d-ab95bb1f060a tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] 10.222.0.30 "GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362" status: 200 len: 1553 microversion: 2.1 time: 0.867937 Mar 08 14:51:57.624180 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 57/126] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:56 2022] GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362 => generated 1553 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:57.635981 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.compute.server_external_events [req-96340af0-9ccd-481e-8198-c22ac4d2559a req-3874fbfa-4430-4afe-881b-288253e5ccdc service nova] Creating event network-vif-deleted:528f8832-4152-4513-9a7f-8d551b1fbad3 for instance ac35fcd8-53a0-4e7b-93f2-a49b20549362 on hv-cinder-83009 Mar 08 14:51:57.645146 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [req-96340af0-9ccd-481e-8198-c22ac4d2559a req-3874fbfa-4430-4afe-881b-288253e5ccdc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082023 Mar 08 14:51:57.645938 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 70/127] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 14:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:51:58.203611 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-986a9a02-36dc-4ba8-b440-9d35872dc6fa tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:58.204235 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-986a9a02-36dc-4ba8-b440-9d35872dc6fa tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] [instance: cca3d7fe-2031-420b-9848-8d65b1058b44] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:58.210890 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-986a9a02-36dc-4ba8-b440-9d35872dc6fa tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:58.211341 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-986a9a02-36dc-4ba8-b440-9d35872dc6fa tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:58.212601 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-986a9a02-36dc-4ba8-b440-9d35872dc6fa tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:58.213198 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-986a9a02-36dc-4ba8-b440-9d35872dc6fa tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:58.484992 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-986a9a02-36dc-4ba8-b440-9d35872dc6fa tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb5f67687dc4e9892e8ddd5c0aca940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e945e64844205b1df851fb73e1ea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:58.495832 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-986a9a02-36dc-4ba8-b440-9d35872dc6fa tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] 10.222.0.30 "GET /compute/v2.1/servers/cca3d7fe-2031-420b-9848-8d65b1058b44" status: 200 len: 1312 microversion: 2.1 time: 0.295887 Mar 08 14:51:58.498252 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 58/128] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:58 2022] GET /compute/v2.1/servers/cca3d7fe-2031-420b-9848-8d65b1058b44 => generated 1312 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:58.521523 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-87984047-8980-4547-b836-ca7b04d7e988 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:58.522300 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-87984047-8980-4547-b836-ca7b04d7e988 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:58.544007 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-87984047-8980-4547-b836-ca7b04d7e988 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:58.544478 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-87984047-8980-4547-b836-ca7b04d7e988 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:58.545280 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-87984047-8980-4547-b836-ca7b04d7e988 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:58.545741 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-87984047-8980-4547-b836-ca7b04d7e988 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:58.634094 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-1f5f40b8-2937-4195-86f9-bd3fd294e3e3 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:58.635093 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-1f5f40b8-2937-4195-86f9-bd3fd294e3e3 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] [instance: ac35fcd8-53a0-4e7b-93f2-a49b20549362] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:58.641970 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1f5f40b8-2937-4195-86f9-bd3fd294e3e3 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:58.642873 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1f5f40b8-2937-4195-86f9-bd3fd294e3e3 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:58.645055 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1f5f40b8-2937-4195-86f9-bd3fd294e3e3 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:58.645878 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1f5f40b8-2937-4195-86f9-bd3fd294e3e3 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:58.686830 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1f5f40b8-2937-4195-86f9-bd3fd294e3e3 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:58.687659 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1f5f40b8-2937-4195-86f9-bd3fd294e3e3 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:58.688590 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.objects.instance [None req-1f5f40b8-2937-4195-86f9-bd3fd294e3e3 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lazy-loading 'fault' on Instance uuid ac35fcd8-53a0-4e7b-93f2-a49b20549362 {{(pid=128352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 14:51:58.801007 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-1f5f40b8-2937-4195-86f9-bd3fd294e3e3 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a343c19dc5f4ca1bcf659d05ffa92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46dce7630acc4cbc80b4cb3ba27c7dd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:58.820187 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-1f5f40b8-2937-4195-86f9-bd3fd294e3e3 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] 10.222.0.30 "GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362" status: 200 len: 1351 microversion: 2.1 time: 0.182969 Mar 08 14:51:58.820187 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 59/129] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:58 2022] GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362 => generated 1351 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:51:58.820388 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-87984047-8980-4547-b836-ca7b04d7e988 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:58.831689 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-87984047-8980-4547-b836-ca7b04d7e988 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1523 microversion: 2.1 time: 0.312917 Mar 08 14:51:58.832877 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 71/130] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:58 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1523 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:59.520421 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ed5be93f-2bdd-44f0-b3a2-500c76d156f6 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:59.521116 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ed5be93f-2bdd-44f0-b3a2-500c76d156f6 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] [instance: cca3d7fe-2031-420b-9848-8d65b1058b44] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:59.527149 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ed5be93f-2bdd-44f0-b3a2-500c76d156f6 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:59.527605 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ed5be93f-2bdd-44f0-b3a2-500c76d156f6 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:59.528565 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ed5be93f-2bdd-44f0-b3a2-500c76d156f6 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:59.529178 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ed5be93f-2bdd-44f0-b3a2-500c76d156f6 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:59.666473 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [req-d53472eb-f51b-466f-b4e6-18e6f9b2d35a req-77f2a473-fcdc-4877-ba68-ded75f201623 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cca3d7fe-2031-420b-9848-8d65b1058b44", "tag": "26aeb493-2f19-4e7c-9bc3-1bc59b4e0ef0"}]} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:51:59.683404 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-d53472eb-f51b-466f-b4e6-18e6f9b2d35a req-77f2a473-fcdc-4877-ba68-ded75f201623 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:59.684993 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-d53472eb-f51b-466f-b4e6-18e6f9b2d35a req-77f2a473-fcdc-4877-ba68-ded75f201623 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:59.697173 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ed5be93f-2bdd-44f0-b3a2-500c76d156f6 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb5f67687dc4e9892e8ddd5c0aca940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e945e64844205b1df851fb73e1ea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:51:59.702100 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.compute.server_external_events [req-d53472eb-f51b-466f-b4e6-18e6f9b2d35a req-77f2a473-fcdc-4877-ba68-ded75f201623 service nova] Creating event network-changed:26aeb493-2f19-4e7c-9bc3-1bc59b4e0ef0 for instance cca3d7fe-2031-420b-9848-8d65b1058b44 on hv-cinder-83009 Mar 08 14:51:59.707955 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [req-d53472eb-f51b-466f-b4e6-18e6f9b2d35a req-77f2a473-fcdc-4877-ba68-ded75f201623 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046376 Mar 08 14:51:59.708699 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ed5be93f-2bdd-44f0-b3a2-500c76d156f6 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] 10.222.0.30 "GET /compute/v2.1/servers/cca3d7fe-2031-420b-9848-8d65b1058b44" status: 200 len: 1312 microversion: 2.1 time: 0.193700 Mar 08 14:51:59.709559 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 72/131] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 14:51:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:51:59.709741 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 60/132] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:59 2022] GET /compute/v2.1/servers/cca3d7fe-2031-420b-9848-8d65b1058b44 => generated 1312 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:51:59.831177 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c9dec420-5d41-4045-961b-3f5ab68c92f0 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:59.832261 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-c9dec420-5d41-4045-961b-3f5ab68c92f0 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] [instance: ac35fcd8-53a0-4e7b-93f2-a49b20549362] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:59.839078 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c9dec420-5d41-4045-961b-3f5ab68c92f0 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:59.839904 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c9dec420-5d41-4045-961b-3f5ab68c92f0 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:59.841154 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c9dec420-5d41-4045-961b-3f5ab68c92f0 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:59.841805 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c9dec420-5d41-4045-961b-3f5ab68c92f0 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:59.849630 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-de2695dd-c5cb-4dd2-a28d-ae62317b8983 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:51:59.850396 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-de2695dd-c5cb-4dd2-a28d-ae62317b8983 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:51:59.858159 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-c9dec420-5d41-4045-961b-3f5ab68c92f0 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] HTTP exception thrown: Instance ac35fcd8-53a0-4e7b-93f2-a49b20549362 could not be found. Mar 08 14:51:59.859082 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c9dec420-5d41-4045-961b-3f5ab68c92f0 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Returning 404 to user: Instance ac35fcd8-53a0-4e7b-93f2-a49b20549362 could not be found. {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 14:51:59.859217 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-de2695dd-c5cb-4dd2-a28d-ae62317b8983 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:59.859680 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-de2695dd-c5cb-4dd2-a28d-ae62317b8983 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:59.860458 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-c9dec420-5d41-4045-961b-3f5ab68c92f0 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] 10.222.0.30 "GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362" status: 404 len: 111 microversion: 2.1 time: 0.033588 Mar 08 14:51:59.860582 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-de2695dd-c5cb-4dd2-a28d-ae62317b8983 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:51:59.860905 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-de2695dd-c5cb-4dd2-a28d-ae62317b8983 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:51:59.866043 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 61/133] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:59 2022] GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 14:52:00.010880 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3dd46009-0569-4819-8838-a7ef8e1aaf45 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:00.012234 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-3dd46009-0569-4819-8838-a7ef8e1aaf45 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] [instance: ac35fcd8-53a0-4e7b-93f2-a49b20549362] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:00.022557 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3dd46009-0569-4819-8838-a7ef8e1aaf45 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:00.023430 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3dd46009-0569-4819-8838-a7ef8e1aaf45 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:00.025217 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3dd46009-0569-4819-8838-a7ef8e1aaf45 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:00.026126 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3dd46009-0569-4819-8838-a7ef8e1aaf45 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:00.093020 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-de2695dd-c5cb-4dd2-a28d-ae62317b8983 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:00.101475 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-de2695dd-c5cb-4dd2-a28d-ae62317b8983 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1523 microversion: 2.1 time: 0.256439 Mar 08 14:52:00.103221 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 73/134] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:51:59 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1523 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:00.110677 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-3dd46009-0569-4819-8838-a7ef8e1aaf45 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] HTTP exception thrown: Instance ac35fcd8-53a0-4e7b-93f2-a49b20549362 could not be found. Mar 08 14:52:00.111562 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3dd46009-0569-4819-8838-a7ef8e1aaf45 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Returning 404 to user: Instance ac35fcd8-53a0-4e7b-93f2-a49b20549362 could not be found. {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 14:52:00.112529 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-3dd46009-0569-4819-8838-a7ef8e1aaf45 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] 10.222.0.30 "GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.106552 Mar 08 14:52:00.113251 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 62/135] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:52:00 2022] GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362/os-volume_attachments => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 14:52:00.729157 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-f0f78fa1-51e3-4e94-a309-090b31906d66 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:00.731066 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-f0f78fa1-51e3-4e94-a309-090b31906d66 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] [instance: cca3d7fe-2031-420b-9848-8d65b1058b44] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:00.738950 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f0f78fa1-51e3-4e94-a309-090b31906d66 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:00.739299 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f0f78fa1-51e3-4e94-a309-090b31906d66 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:00.740080 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f0f78fa1-51e3-4e94-a309-090b31906d66 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:00.740724 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f0f78fa1-51e3-4e94-a309-090b31906d66 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:00.926574 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-f0f78fa1-51e3-4e94-a309-090b31906d66 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb5f67687dc4e9892e8ddd5c0aca940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e945e64844205b1df851fb73e1ea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:00.937938 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-f0f78fa1-51e3-4e94-a309-090b31906d66 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] 10.222.0.30 "GET /compute/v2.1/servers/cca3d7fe-2031-420b-9848-8d65b1058b44" status: 200 len: 1312 microversion: 2.1 time: 0.212974 Mar 08 14:52:00.939276 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 74/136] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:00 2022] GET /compute/v2.1/servers/cca3d7fe-2031-420b-9848-8d65b1058b44 => generated 1312 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:01.119586 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5b624596-3197-4a4c-8f2b-c1260366a2e1 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:01.120224 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5b624596-3197-4a4c-8f2b-c1260366a2e1 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:01.125957 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5b624596-3197-4a4c-8f2b-c1260366a2e1 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:01.126404 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5b624596-3197-4a4c-8f2b-c1260366a2e1 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:01.127157 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5b624596-3197-4a4c-8f2b-c1260366a2e1 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:01.128122 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5b624596-3197-4a4c-8f2b-c1260366a2e1 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:01.339962 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-5b624596-3197-4a4c-8f2b-c1260366a2e1 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:01.348417 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5b624596-3197-4a4c-8f2b-c1260366a2e1 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1523 microversion: 2.1 time: 0.232653 Mar 08 14:52:01.349315 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 63/137] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:01 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1523 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:01.383348 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-c4651508-75cc-4907-a07f-9c9f00c45c0d tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:01.383851 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-c4651508-75cc-4907-a07f-9c9f00c45c0d tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] [instance: ac35fcd8-53a0-4e7b-93f2-a49b20549362] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:01.389725 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c4651508-75cc-4907-a07f-9c9f00c45c0d tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:01.390218 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c4651508-75cc-4907-a07f-9c9f00c45c0d tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:01.391051 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c4651508-75cc-4907-a07f-9c9f00c45c0d tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:01.391391 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c4651508-75cc-4907-a07f-9c9f00c45c0d tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:01.410267 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.wsgi [None req-c4651508-75cc-4907-a07f-9c9f00c45c0d tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] HTTP exception thrown: Instance ac35fcd8-53a0-4e7b-93f2-a49b20549362 could not be found. Mar 08 14:52:01.411380 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-c4651508-75cc-4907-a07f-9c9f00c45c0d tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Returning 404 to user: Instance ac35fcd8-53a0-4e7b-93f2-a49b20549362 could not be found. {{(pid=128351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 14:52:01.412582 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-c4651508-75cc-4907-a07f-9c9f00c45c0d tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362" status: 404 len: 111 microversion: 2.1 time: 0.032953 Mar 08 14:52:01.413151 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 75/138] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 14:52:01 2022] DELETE /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 14:52:01.421634 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-72d9df4f-b037-4275-b3e3-6820711bd363 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:01.422537 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-72d9df4f-b037-4275-b3e3-6820711bd363 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] [instance: ac35fcd8-53a0-4e7b-93f2-a49b20549362] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:01.429452 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-72d9df4f-b037-4275-b3e3-6820711bd363 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:01.429923 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-72d9df4f-b037-4275-b3e3-6820711bd363 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:01.430703 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-72d9df4f-b037-4275-b3e3-6820711bd363 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:01.431131 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-72d9df4f-b037-4275-b3e3-6820711bd363 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:01.444751 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-72d9df4f-b037-4275-b3e3-6820711bd363 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] HTTP exception thrown: Instance ac35fcd8-53a0-4e7b-93f2-a49b20549362 could not be found. Mar 08 14:52:01.445337 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-72d9df4f-b037-4275-b3e3-6820711bd363 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] Returning 404 to user: Instance ac35fcd8-53a0-4e7b-93f2-a49b20549362 could not be found. {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 14:52:01.446192 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-72d9df4f-b037-4275-b3e3-6820711bd363 tempest-DeleteServersTestJSON-1458350675 tempest-DeleteServersTestJSON-1458350675-project] 10.222.0.30 "GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362" status: 404 len: 111 microversion: 2.1 time: 0.028744 Mar 08 14:52:01.446731 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 64/139] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:01 2022] GET /compute/v2.1/servers/ac35fcd8-53a0-4e7b-93f2-a49b20549362 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 08 14:52:01.956776 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-3b66110c-519d-44e1-aa7e-1b9708095b16 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:01.957399 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-3b66110c-519d-44e1-aa7e-1b9708095b16 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] [instance: cca3d7fe-2031-420b-9848-8d65b1058b44] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:01.964066 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3b66110c-519d-44e1-aa7e-1b9708095b16 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:01.965534 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3b66110c-519d-44e1-aa7e-1b9708095b16 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:01.967299 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3b66110c-519d-44e1-aa7e-1b9708095b16 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:01.967955 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3b66110c-519d-44e1-aa7e-1b9708095b16 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:02.261546 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-3b66110c-519d-44e1-aa7e-1b9708095b16 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb5f67687dc4e9892e8ddd5c0aca940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e945e64844205b1df851fb73e1ea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:02.271852 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-3b66110c-519d-44e1-aa7e-1b9708095b16 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] 10.222.0.30 "GET /compute/v2.1/servers/cca3d7fe-2031-420b-9848-8d65b1058b44" status: 200 len: 1312 microversion: 2.1 time: 0.319017 Mar 08 14:52:02.272560 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 76/140] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:01 2022] GET /compute/v2.1/servers/cca3d7fe-2031-420b-9848-8d65b1058b44 => generated 1312 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:02.370061 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-450bbdb2-6d56-46c4-8cbe-3c9cadfa4574 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:02.370832 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-450bbdb2-6d56-46c4-8cbe-3c9cadfa4574 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:02.378129 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-450bbdb2-6d56-46c4-8cbe-3c9cadfa4574 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:02.379148 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-450bbdb2-6d56-46c4-8cbe-3c9cadfa4574 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:02.380084 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-450bbdb2-6d56-46c4-8cbe-3c9cadfa4574 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:02.380913 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-450bbdb2-6d56-46c4-8cbe-3c9cadfa4574 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:02.707469 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-450bbdb2-6d56-46c4-8cbe-3c9cadfa4574 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:02.733295 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-450bbdb2-6d56-46c4-8cbe-3c9cadfa4574 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1523 microversion: 2.1 time: 0.369281 Mar 08 14:52:02.744358 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 65/141] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:02 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1523 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:03.306689 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-5d4a9a5b-e778-4253-acd2-2eef99ac5ab2 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:03.312039 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-5d4a9a5b-e778-4253-acd2-2eef99ac5ab2 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] [instance: cca3d7fe-2031-420b-9848-8d65b1058b44] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:03.327329 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5d4a9a5b-e778-4253-acd2-2eef99ac5ab2 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:03.327953 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5d4a9a5b-e778-4253-acd2-2eef99ac5ab2 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:03.328910 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5d4a9a5b-e778-4253-acd2-2eef99ac5ab2 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:03.330026 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5d4a9a5b-e778-4253-acd2-2eef99ac5ab2 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:03.571478 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-5d4a9a5b-e778-4253-acd2-2eef99ac5ab2 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb5f67687dc4e9892e8ddd5c0aca940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e945e64844205b1df851fb73e1ea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:03.580580 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-5d4a9a5b-e778-4253-acd2-2eef99ac5ab2 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] 10.222.0.30 "GET /compute/v2.1/servers/cca3d7fe-2031-420b-9848-8d65b1058b44" status: 200 len: 1312 microversion: 2.1 time: 0.293474 Mar 08 14:52:03.590477 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 77/142] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:03 2022] GET /compute/v2.1/servers/cca3d7fe-2031-420b-9848-8d65b1058b44 => generated 1312 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:52:03.751375 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5e78bf49-78b3-40a8-a58a-1e955048cbc0 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:03.751976 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5e78bf49-78b3-40a8-a58a-1e955048cbc0 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:03.758732 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5e78bf49-78b3-40a8-a58a-1e955048cbc0 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:03.759178 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5e78bf49-78b3-40a8-a58a-1e955048cbc0 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:03.759944 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5e78bf49-78b3-40a8-a58a-1e955048cbc0 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:03.760375 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5e78bf49-78b3-40a8-a58a-1e955048cbc0 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:03.903303 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-5e78bf49-78b3-40a8-a58a-1e955048cbc0 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:03.910597 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5e78bf49-78b3-40a8-a58a-1e955048cbc0 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1523 microversion: 2.1 time: 0.163163 Mar 08 14:52:03.911153 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 66/143] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:03 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:04.598635 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-f1397500-7250-428f-b3de-d6295318f36f tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:04.599328 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-f1397500-7250-428f-b3de-d6295318f36f tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] [instance: cca3d7fe-2031-420b-9848-8d65b1058b44] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:04.605178 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f1397500-7250-428f-b3de-d6295318f36f tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:04.605629 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f1397500-7250-428f-b3de-d6295318f36f tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:04.606455 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f1397500-7250-428f-b3de-d6295318f36f tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:04.606891 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f1397500-7250-428f-b3de-d6295318f36f tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:04.800467 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-f1397500-7250-428f-b3de-d6295318f36f tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb5f67687dc4e9892e8ddd5c0aca940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e945e64844205b1df851fb73e1ea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:04.812550 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-f1397500-7250-428f-b3de-d6295318f36f tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] 10.222.0.30 "GET /compute/v2.1/servers/cca3d7fe-2031-420b-9848-8d65b1058b44" status: 200 len: 1312 microversion: 2.1 time: 0.213964 Mar 08 14:52:04.812550 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 78/144] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:04 2022] GET /compute/v2.1/servers/cca3d7fe-2031-420b-9848-8d65b1058b44 => generated 1312 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:04.921645 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [req-c933fec1-6e05-4ec1-a1fd-c3871673bf07 req-9b64ef5c-db2f-4999-b53e-0a65b56ecdcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca3d7fe-2031-420b-9848-8d65b1058b44", "name": "network-vif-plugged", "status": "completed", "tag": "26aeb493-2f19-4e7c-9bc3-1bc59b4e0ef0"}]} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:52:04.929729 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-ee0000ba-ff30-43a4-968d-f144d44d59d7 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:04.931964 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-ee0000ba-ff30-43a4-968d-f144d44d59d7 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:04.932503 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-c933fec1-6e05-4ec1-a1fd-c3871673bf07 req-9b64ef5c-db2f-4999-b53e-0a65b56ecdcb service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:04.933151 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-c933fec1-6e05-4ec1-a1fd-c3871673bf07 req-9b64ef5c-db2f-4999-b53e-0a65b56ecdcb service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:04.948838 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ee0000ba-ff30-43a4-968d-f144d44d59d7 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:04.952261 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ee0000ba-ff30-43a4-968d-f144d44d59d7 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:04.956378 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ee0000ba-ff30-43a4-968d-f144d44d59d7 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:04.957268 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ee0000ba-ff30-43a4-968d-f144d44d59d7 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:04.967135 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.compute.server_external_events [req-c933fec1-6e05-4ec1-a1fd-c3871673bf07 req-9b64ef5c-db2f-4999-b53e-0a65b56ecdcb service nova] Creating event network-vif-plugged:26aeb493-2f19-4e7c-9bc3-1bc59b4e0ef0 for instance cca3d7fe-2031-420b-9848-8d65b1058b44 on hv-cinder-83009 Mar 08 14:52:04.974339 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [req-c933fec1-6e05-4ec1-a1fd-c3871673bf07 req-9b64ef5c-db2f-4999-b53e-0a65b56ecdcb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055852 Mar 08 14:52:04.975152 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 67/145] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 14:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:52:05.169504 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-ee0000ba-ff30-43a4-968d-f144d44d59d7 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:05.178402 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-ee0000ba-ff30-43a4-968d-f144d44d59d7 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1523 microversion: 2.1 time: 0.255255 Mar 08 14:52:05.179035 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 79/146] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:04 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1523 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:05.826804 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-57b824f7-04a8-4966-bc9e-f7f3297de379 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:05.827584 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-57b824f7-04a8-4966-bc9e-f7f3297de379 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] [instance: cca3d7fe-2031-420b-9848-8d65b1058b44] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:05.833570 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-57b824f7-04a8-4966-bc9e-f7f3297de379 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:05.834178 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-57b824f7-04a8-4966-bc9e-f7f3297de379 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:05.834955 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-57b824f7-04a8-4966-bc9e-f7f3297de379 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:05.835389 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-57b824f7-04a8-4966-bc9e-f7f3297de379 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:05.975424 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-57b824f7-04a8-4966-bc9e-f7f3297de379 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb5f67687dc4e9892e8ddd5c0aca940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e945e64844205b1df851fb73e1ea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:05.982752 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-57b824f7-04a8-4966-bc9e-f7f3297de379 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] 10.222.0.30 "GET /compute/v2.1/servers/cca3d7fe-2031-420b-9848-8d65b1058b44" status: 200 len: 1312 microversion: 2.1 time: 0.160171 Mar 08 14:52:05.983320 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 68/147] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:05 2022] GET /compute/v2.1/servers/cca3d7fe-2031-420b-9848-8d65b1058b44 => generated 1312 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:06.195644 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-bf782f22-2c80-44cd-9788-be9142fcd67c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:06.196254 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-bf782f22-2c80-44cd-9788-be9142fcd67c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:06.202719 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bf782f22-2c80-44cd-9788-be9142fcd67c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:06.203327 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bf782f22-2c80-44cd-9788-be9142fcd67c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:06.204455 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bf782f22-2c80-44cd-9788-be9142fcd67c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:06.205096 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bf782f22-2c80-44cd-9788-be9142fcd67c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:06.350481 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-bf782f22-2c80-44cd-9788-be9142fcd67c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:06.358876 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-bf782f22-2c80-44cd-9788-be9142fcd67c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1523 microversion: 2.1 time: 0.167088 Mar 08 14:52:06.359463 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 80/148] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:06 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:06.999773 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-1f9587a0-1238-4fac-9f7c-5eece8d3f39a tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:07.000373 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-1f9587a0-1238-4fac-9f7c-5eece8d3f39a tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] [instance: cca3d7fe-2031-420b-9848-8d65b1058b44] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:07.006864 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1f9587a0-1238-4fac-9f7c-5eece8d3f39a tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:07.007310 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1f9587a0-1238-4fac-9f7c-5eece8d3f39a tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:07.008077 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1f9587a0-1238-4fac-9f7c-5eece8d3f39a tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:07.008507 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1f9587a0-1238-4fac-9f7c-5eece8d3f39a tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:07.162047 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-1f9587a0-1238-4fac-9f7c-5eece8d3f39a tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb5f67687dc4e9892e8ddd5c0aca940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e945e64844205b1df851fb73e1ea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:07.169481 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-1f9587a0-1238-4fac-9f7c-5eece8d3f39a tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] 10.222.0.30 "GET /compute/v2.1/servers/cca3d7fe-2031-420b-9848-8d65b1058b44" status: 200 len: 1497 microversion: 2.1 time: 0.173681 Mar 08 14:52:07.170103 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 69/149] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:06 2022] GET /compute/v2.1/servers/cca3d7fe-2031-420b-9848-8d65b1058b44 => generated 1497 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:07.378206 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-cc455040-b7bd-49ba-a92b-33a5c6e81a06 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:07.378838 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-cc455040-b7bd-49ba-a92b-33a5c6e81a06 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:07.390594 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cc455040-b7bd-49ba-a92b-33a5c6e81a06 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:07.391052 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cc455040-b7bd-49ba-a92b-33a5c6e81a06 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:07.391849 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cc455040-b7bd-49ba-a92b-33a5c6e81a06 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:07.392291 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cc455040-b7bd-49ba-a92b-33a5c6e81a06 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:07.587455 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-cc455040-b7bd-49ba-a92b-33a5c6e81a06 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:07.596419 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-cc455040-b7bd-49ba-a92b-33a5c6e81a06 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1523 microversion: 2.1 time: 0.224831 Mar 08 14:52:07.597380 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 81/150] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:07 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1523 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:08.614563 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-7e90ef7b-a227-4779-9b26-9a9c9df5f8e0 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:08.615164 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-7e90ef7b-a227-4779-9b26-9a9c9df5f8e0 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:08.620779 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7e90ef7b-a227-4779-9b26-9a9c9df5f8e0 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:08.621224 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7e90ef7b-a227-4779-9b26-9a9c9df5f8e0 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:08.622002 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7e90ef7b-a227-4779-9b26-9a9c9df5f8e0 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:08.622439 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7e90ef7b-a227-4779-9b26-9a9c9df5f8e0 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:08.907152 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-7e90ef7b-a227-4779-9b26-9a9c9df5f8e0 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:08.914654 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-7e90ef7b-a227-4779-9b26-9a9c9df5f8e0 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1523 microversion: 2.1 time: 0.304680 Mar 08 14:52:08.915220 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 70/151] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:08 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1523 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:09.931864 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-40dcf00f-2981-4122-8d99-926050dd1d9b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:09.932473 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-40dcf00f-2981-4122-8d99-926050dd1d9b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:09.939247 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-40dcf00f-2981-4122-8d99-926050dd1d9b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:09.939766 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-40dcf00f-2981-4122-8d99-926050dd1d9b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:09.940760 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-40dcf00f-2981-4122-8d99-926050dd1d9b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:09.941201 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-40dcf00f-2981-4122-8d99-926050dd1d9b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:10.097990 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-40dcf00f-2981-4122-8d99-926050dd1d9b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:10.105137 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-40dcf00f-2981-4122-8d99-926050dd1d9b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1523 microversion: 2.1 time: 0.177052 Mar 08 14:52:10.105713 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 82/152] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:09 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:11.121808 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-839fc9a8-f9a9-4869-8f0b-e2e578cbf88f tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:11.122468 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-839fc9a8-f9a9-4869-8f0b-e2e578cbf88f tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:11.129083 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-839fc9a8-f9a9-4869-8f0b-e2e578cbf88f tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:11.129572 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-839fc9a8-f9a9-4869-8f0b-e2e578cbf88f tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:11.130485 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-839fc9a8-f9a9-4869-8f0b-e2e578cbf88f tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:11.130797 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-839fc9a8-f9a9-4869-8f0b-e2e578cbf88f tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:11.166866 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-7ff85576-9c27-4334-86f3-8000577c14cc tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:11.167344 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-7ff85576-9c27-4334-86f3-8000577c14cc tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] [instance: cca3d7fe-2031-420b-9848-8d65b1058b44] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:11.173510 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7ff85576-9c27-4334-86f3-8000577c14cc tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:11.175014 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7ff85576-9c27-4334-86f3-8000577c14cc tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:11.175990 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7ff85576-9c27-4334-86f3-8000577c14cc tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:11.176494 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7ff85576-9c27-4334-86f3-8000577c14cc tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:11.201969 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-7ff85576-9c27-4334-86f3-8000577c14cc tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] [instance: cca3d7fe-2031-420b-9848-8d65b1058b44] Going to try to terminate instance {{(pid=128351) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 14:52:11.283733 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-839fc9a8-f9a9-4869-8f0b-e2e578cbf88f tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:11.296223 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-7ff85576-9c27-4334-86f3-8000577c14cc tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] 10.222.0.30 "DELETE /compute/v2.1/servers/cca3d7fe-2031-420b-9848-8d65b1058b44" status: 204 len: 0 microversion: 2.1 time: 0.132955 Mar 08 14:52:11.296815 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 83/153] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 14:52:11 2022] DELETE /compute/v2.1/servers/cca3d7fe-2031-420b-9848-8d65b1058b44 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 08 14:52:11.302167 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-839fc9a8-f9a9-4869-8f0b-e2e578cbf88f tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1523 microversion: 2.1 time: 0.184088 Mar 08 14:52:11.303439 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 71/154] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:11 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:11.306998 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-822efa30-b70d-45c0-b341-a2f9feaf9d56 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:11.307901 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-822efa30-b70d-45c0-b341-a2f9feaf9d56 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] [instance: cca3d7fe-2031-420b-9848-8d65b1058b44] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:11.313883 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-822efa30-b70d-45c0-b341-a2f9feaf9d56 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:11.314372 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-822efa30-b70d-45c0-b341-a2f9feaf9d56 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:11.315762 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-822efa30-b70d-45c0-b341-a2f9feaf9d56 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:11.316101 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-822efa30-b70d-45c0-b341-a2f9feaf9d56 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:11.456346 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-822efa30-b70d-45c0-b341-a2f9feaf9d56 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb5f67687dc4e9892e8ddd5c0aca940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e945e64844205b1df851fb73e1ea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:11.467138 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-822efa30-b70d-45c0-b341-a2f9feaf9d56 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] 10.222.0.30 "GET /compute/v2.1/servers/cca3d7fe-2031-420b-9848-8d65b1058b44" status: 200 len: 1503 microversion: 2.1 time: 0.164491 Mar 08 14:52:11.467783 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 84/155] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:11 2022] GET /compute/v2.1/servers/cca3d7fe-2031-420b-9848-8d65b1058b44 => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:52:12.319541 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3b9212d8-4f72-41c8-8dbf-a74fc4f24cd2 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:12.320157 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-3b9212d8-4f72-41c8-8dbf-a74fc4f24cd2 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:12.325844 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3b9212d8-4f72-41c8-8dbf-a74fc4f24cd2 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:12.326338 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3b9212d8-4f72-41c8-8dbf-a74fc4f24cd2 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:12.338156 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3b9212d8-4f72-41c8-8dbf-a74fc4f24cd2 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:12.338709 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3b9212d8-4f72-41c8-8dbf-a74fc4f24cd2 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:12.492350 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-66e69d13-f871-409c-bbf7-e6e695b44be2 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:12.492978 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-66e69d13-f871-409c-bbf7-e6e695b44be2 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] [instance: cca3d7fe-2031-420b-9848-8d65b1058b44] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:12.501577 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-66e69d13-f871-409c-bbf7-e6e695b44be2 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:12.502306 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-66e69d13-f871-409c-bbf7-e6e695b44be2 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:12.503138 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-66e69d13-f871-409c-bbf7-e6e695b44be2 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:12.503709 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-66e69d13-f871-409c-bbf7-e6e695b44be2 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:12.520762 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-3b9212d8-4f72-41c8-8dbf-a74fc4f24cd2 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:12.528630 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-3b9212d8-4f72-41c8-8dbf-a74fc4f24cd2 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1523 microversion: 2.1 time: 0.212777 Mar 08 14:52:12.540360 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 72/156] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:12 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1523 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:12.672042 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-66e69d13-f871-409c-bbf7-e6e695b44be2 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb5f67687dc4e9892e8ddd5c0aca940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e945e64844205b1df851fb73e1ea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:12.680784 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-66e69d13-f871-409c-bbf7-e6e695b44be2 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] 10.222.0.30 "GET /compute/v2.1/servers/cca3d7fe-2031-420b-9848-8d65b1058b44" status: 200 len: 1503 microversion: 2.1 time: 0.192961 Mar 08 14:52:12.681517 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 85/157] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:12 2022] GET /compute/v2.1/servers/cca3d7fe-2031-420b-9848-8d65b1058b44 => generated 1503 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:13.546937 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-cba6a8e8-12a1-4045-b674-b84cf69e1744 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:13.548090 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-cba6a8e8-12a1-4045-b674-b84cf69e1744 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:13.554817 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cba6a8e8-12a1-4045-b674-b84cf69e1744 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:13.555470 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cba6a8e8-12a1-4045-b674-b84cf69e1744 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:13.556435 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cba6a8e8-12a1-4045-b674-b84cf69e1744 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:13.557017 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cba6a8e8-12a1-4045-b674-b84cf69e1744 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:13.699897 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-17b8ed52-a363-47c9-a2f1-3364fc697753 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:13.701145 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-17b8ed52-a363-47c9-a2f1-3364fc697753 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] [instance: cca3d7fe-2031-420b-9848-8d65b1058b44] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:13.709063 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-17b8ed52-a363-47c9-a2f1-3364fc697753 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:13.709820 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-17b8ed52-a363-47c9-a2f1-3364fc697753 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:13.711575 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-17b8ed52-a363-47c9-a2f1-3364fc697753 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:13.712009 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-17b8ed52-a363-47c9-a2f1-3364fc697753 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:13.825875 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-17b8ed52-a363-47c9-a2f1-3364fc697753 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb5f67687dc4e9892e8ddd5c0aca940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e945e64844205b1df851fb73e1ea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:13.835308 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-17b8ed52-a363-47c9-a2f1-3364fc697753 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] 10.222.0.30 "GET /compute/v2.1/servers/cca3d7fe-2031-420b-9848-8d65b1058b44" status: 200 len: 1461 microversion: 2.1 time: 0.140701 Mar 08 14:52:13.836539 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 86/158] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:13 2022] GET /compute/v2.1/servers/cca3d7fe-2031-420b-9848-8d65b1058b44 => generated 1461 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:13.841719 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [req-5533dc43-9da1-4a6b-beb5-8ec1d0fe34ac req-6a2aa57b-9d30-4d65-ab0c-6f0bfdbf9ce1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca3d7fe-2031-420b-9848-8d65b1058b44", "name": "network-vif-deleted", "tag": "26aeb493-2f19-4e7c-9bc3-1bc59b4e0ef0"}]} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:52:13.849894 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-cba6a8e8-12a1-4045-b674-b84cf69e1744 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:13.853912 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-5533dc43-9da1-4a6b-beb5-8ec1d0fe34ac req-6a2aa57b-9d30-4d65-ab0c-6f0bfdbf9ce1 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:13.854552 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-5533dc43-9da1-4a6b-beb5-8ec1d0fe34ac req-6a2aa57b-9d30-4d65-ab0c-6f0bfdbf9ce1 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:13.858845 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-cba6a8e8-12a1-4045-b674-b84cf69e1744 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1523 microversion: 2.1 time: 0.315828 Mar 08 14:52:13.859431 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 73/159] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:13 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1523 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:13.879958 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.compute.server_external_events [req-5533dc43-9da1-4a6b-beb5-8ec1d0fe34ac req-6a2aa57b-9d30-4d65-ab0c-6f0bfdbf9ce1 service nova] Creating event network-vif-deleted:26aeb493-2f19-4e7c-9bc3-1bc59b4e0ef0 for instance cca3d7fe-2031-420b-9848-8d65b1058b44 on hv-cinder-83009 Mar 08 14:52:13.885625 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [req-5533dc43-9da1-4a6b-beb5-8ec1d0fe34ac req-6a2aa57b-9d30-4d65-ab0c-6f0bfdbf9ce1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047791 Mar 08 14:52:13.886270 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 87/160] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 14:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:52:14.852611 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ce0e7f2c-cb80-4f2f-b3d0-3420214f95a9 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:14.853755 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ce0e7f2c-cb80-4f2f-b3d0-3420214f95a9 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] [instance: cca3d7fe-2031-420b-9848-8d65b1058b44] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:14.862581 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ce0e7f2c-cb80-4f2f-b3d0-3420214f95a9 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:14.863069 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ce0e7f2c-cb80-4f2f-b3d0-3420214f95a9 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:14.864402 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ce0e7f2c-cb80-4f2f-b3d0-3420214f95a9 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:14.864488 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ce0e7f2c-cb80-4f2f-b3d0-3420214f95a9 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:14.880192 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-ce0e7f2c-cb80-4f2f-b3d0-3420214f95a9 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] HTTP exception thrown: Instance cca3d7fe-2031-420b-9848-8d65b1058b44 could not be found. Mar 08 14:52:14.880952 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ce0e7f2c-cb80-4f2f-b3d0-3420214f95a9 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Returning 404 to user: Instance cca3d7fe-2031-420b-9848-8d65b1058b44 could not be found. {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 14:52:14.881960 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ce0e7f2c-cb80-4f2f-b3d0-3420214f95a9 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] 10.222.0.30 "GET /compute/v2.1/servers/cca3d7fe-2031-420b-9848-8d65b1058b44" status: 404 len: 111 microversion: 2.1 time: 0.033328 Mar 08 14:52:14.889989 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 74/161] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:14 2022] GET /compute/v2.1/servers/cca3d7fe-2031-420b-9848-8d65b1058b44 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 14:52:14.900513 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-d7b6d4d0-372a-4a74-b598-d59c411182a9 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:14.902890 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-d7b6d4d0-372a-4a74-b598-d59c411182a9 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:14.925114 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d7b6d4d0-372a-4a74-b598-d59c411182a9 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:14.925274 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d7b6d4d0-372a-4a74-b598-d59c411182a9 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:14.929946 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d7b6d4d0-372a-4a74-b598-d59c411182a9 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:14.930566 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d7b6d4d0-372a-4a74-b598-d59c411182a9 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:15.010758 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f483b3ee-23cc-47bf-aef5-8fca47108870 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1346648109", "imageRef": "7541d53b-003d-4f1a-8d76-fc5f4bd8dabf", "flavorRef": "452", "networks": [{"uuid": "bdbc59ae-a037-4071-94d0-6d42a3375e97"}]}} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:52:15.076006 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.network.neutron [None req-f483b3ee-23cc-47bf-aef5-8fca47108870 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] validate_networks() for [('bdbc59ae-a037-4071-94d0-6d42a3375e97', None, None, None, None, None)] {{(pid=128352) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 14:52:15.126072 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-d7b6d4d0-372a-4a74-b598-d59c411182a9 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:15.134901 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-d7b6d4d0-372a-4a74-b598-d59c411182a9 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1523 microversion: 2.1 time: 0.259978 Mar 08 14:52:15.137142 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 88/162] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:14 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1523 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:15.527250 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.virt.hardware [None req-f483b3ee-23cc-47bf-aef5-8fca47108870 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Flavor limits 0:0:0 {{(pid=128352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 14:52:15.527788 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.virt.hardware [None req-f483b3ee-23cc-47bf-aef5-8fca47108870 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Image limits 0:0:0 {{(pid=128352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 14:52:15.528332 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.virt.hardware [None req-f483b3ee-23cc-47bf-aef5-8fca47108870 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Flavor pref 0:0:0 {{(pid=128352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 14:52:15.528956 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.virt.hardware [None req-f483b3ee-23cc-47bf-aef5-8fca47108870 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Image pref 0:0:0 {{(pid=128352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 14:52:15.529492 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.virt.hardware [None req-f483b3ee-23cc-47bf-aef5-8fca47108870 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 14:52:15.541606 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f483b3ee-23cc-47bf-aef5-8fca47108870 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:15.542831 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f483b3ee-23cc-47bf-aef5-8fca47108870 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:15.543709 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f483b3ee-23cc-47bf-aef5-8fca47108870 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:15.544271 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f483b3ee-23cc-47bf-aef5-8fca47108870 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:15.565256 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.quota [None req-f483b3ee-23cc-47bf-aef5-8fca47108870 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Getting quotas for project 4c0e945e64844205b1df851fb73e1ea2. Resources: {'instances', 'ram', 'cores'} {{(pid=128352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 14:52:15.572216 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.quota [None req-f483b3ee-23cc-47bf-aef5-8fca47108870 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Getting quotas for user 6cb5f67687dc4e9892e8ddd5c0aca940 and project 4c0e945e64844205b1df851fb73e1ea2. Resources: {'instances', 'ram', 'cores'} {{(pid=128352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 14:52:15.585693 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f483b3ee-23cc-47bf-aef5-8fca47108870 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Going to run 1 instances... {{(pid=128352) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 14:52:15.594300 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f483b3ee-23cc-47bf-aef5-8fca47108870 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] [instance: c9829431-dda3-4e64-a11f-09ca52fc26ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7541d53b-003d-4f1a-8d76-fc5f4bd8dabf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 14:52:15.681992 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f483b3ee-23cc-47bf-aef5-8fca47108870 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.675121 Mar 08 14:52:15.688164 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 75/163] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Mar 8 14:52:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 14:52:15.695579 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-72cc8e65-36fa-4398-aad3-ec018178826f tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:15.696346 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-72cc8e65-36fa-4398-aad3-ec018178826f tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] [instance: c9829431-dda3-4e64-a11f-09ca52fc26ec] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:15.754245 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-72cc8e65-36fa-4398-aad3-ec018178826f tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb5f67687dc4e9892e8ddd5c0aca940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e945e64844205b1df851fb73e1ea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:15.766126 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-72cc8e65-36fa-4398-aad3-ec018178826f tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] 10.222.0.30 "GET /compute/v2.1/servers/c9829431-dda3-4e64-a11f-09ca52fc26ec" status: 200 len: 1214 microversion: 2.1 time: 0.074249 Mar 08 14:52:15.768376 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 89/164] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:15 2022] GET /compute/v2.1/servers/c9829431-dda3-4e64-a11f-09ca52fc26ec => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:16.152480 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-54a9e011-bc60-4169-b52b-cdddaffa8a01 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:16.153297 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-54a9e011-bc60-4169-b52b-cdddaffa8a01 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:16.161457 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-54a9e011-bc60-4169-b52b-cdddaffa8a01 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:16.161932 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-54a9e011-bc60-4169-b52b-cdddaffa8a01 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:16.162744 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-54a9e011-bc60-4169-b52b-cdddaffa8a01 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:16.163439 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-54a9e011-bc60-4169-b52b-cdddaffa8a01 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:16.320860 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-54a9e011-bc60-4169-b52b-cdddaffa8a01 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:16.328336 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-54a9e011-bc60-4169-b52b-cdddaffa8a01 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1523 microversion: 2.1 time: 0.179727 Mar 08 14:52:16.329181 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 76/165] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:16 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:16.783867 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-9907b122-0733-46c9-86d9-9a9b2bb18601 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:16.784724 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-9907b122-0733-46c9-86d9-9a9b2bb18601 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] [instance: c9829431-dda3-4e64-a11f-09ca52fc26ec] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:16.791500 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9907b122-0733-46c9-86d9-9a9b2bb18601 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:16.791994 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9907b122-0733-46c9-86d9-9a9b2bb18601 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:16.792847 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9907b122-0733-46c9-86d9-9a9b2bb18601 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:16.793320 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9907b122-0733-46c9-86d9-9a9b2bb18601 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:16.857243 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-9907b122-0733-46c9-86d9-9a9b2bb18601 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb5f67687dc4e9892e8ddd5c0aca940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e945e64844205b1df851fb73e1ea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:16.866583 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-9907b122-0733-46c9-86d9-9a9b2bb18601 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] 10.222.0.30 "GET /compute/v2.1/servers/c9829431-dda3-4e64-a11f-09ca52fc26ec" status: 200 len: 1218 microversion: 2.1 time: 0.087068 Mar 08 14:52:16.867571 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 90/166] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:16 2022] GET /compute/v2.1/servers/c9829431-dda3-4e64-a11f-09ca52fc26ec => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:17.350760 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f829b311-b699-4a8a-a30f-1956890e1361 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:17.351903 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f829b311-b699-4a8a-a30f-1956890e1361 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:17.362481 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f829b311-b699-4a8a-a30f-1956890e1361 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:17.363629 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f829b311-b699-4a8a-a30f-1956890e1361 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:17.365278 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f829b311-b699-4a8a-a30f-1956890e1361 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:17.366293 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f829b311-b699-4a8a-a30f-1956890e1361 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:17.518872 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f829b311-b699-4a8a-a30f-1956890e1361 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:17.526549 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f829b311-b699-4a8a-a30f-1956890e1361 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1523 microversion: 2.1 time: 0.183408 Mar 08 14:52:17.527221 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 77/167] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:17 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:17.884851 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-8eb02ed6-bab7-4d61-83ab-aed2f0ad8f1e tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:17.886241 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-8eb02ed6-bab7-4d61-83ab-aed2f0ad8f1e tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] [instance: c9829431-dda3-4e64-a11f-09ca52fc26ec] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:17.894369 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8eb02ed6-bab7-4d61-83ab-aed2f0ad8f1e tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:17.895047 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8eb02ed6-bab7-4d61-83ab-aed2f0ad8f1e tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:17.895964 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8eb02ed6-bab7-4d61-83ab-aed2f0ad8f1e tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:17.896671 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8eb02ed6-bab7-4d61-83ab-aed2f0ad8f1e tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:18.197603 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-8eb02ed6-bab7-4d61-83ab-aed2f0ad8f1e tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb5f67687dc4e9892e8ddd5c0aca940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e945e64844205b1df851fb73e1ea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:18.206521 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-8eb02ed6-bab7-4d61-83ab-aed2f0ad8f1e tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] 10.222.0.30 "GET /compute/v2.1/servers/c9829431-dda3-4e64-a11f-09ca52fc26ec" status: 200 len: 1210 microversion: 2.1 time: 0.326293 Mar 08 14:52:18.207294 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 91/168] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:17 2022] GET /compute/v2.1/servers/c9829431-dda3-4e64-a11f-09ca52fc26ec => generated 1210 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:18.544070 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c022fc4f-cc1d-4a3f-93f0-aa35e3bc6a6a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:18.544679 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-c022fc4f-cc1d-4a3f-93f0-aa35e3bc6a6a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:18.551863 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c022fc4f-cc1d-4a3f-93f0-aa35e3bc6a6a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:18.552334 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c022fc4f-cc1d-4a3f-93f0-aa35e3bc6a6a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:18.553209 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c022fc4f-cc1d-4a3f-93f0-aa35e3bc6a6a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:18.553615 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c022fc4f-cc1d-4a3f-93f0-aa35e3bc6a6a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:18.815753 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-c022fc4f-cc1d-4a3f-93f0-aa35e3bc6a6a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:18.823151 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-c022fc4f-cc1d-4a3f-93f0-aa35e3bc6a6a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1523 microversion: 2.1 time: 0.283407 Mar 08 14:52:18.823716 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 78/169] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:18 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1523 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:19.224008 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-1d6dfe0a-41b1-401e-ad33-912fc95a9cc7 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:19.224719 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-1d6dfe0a-41b1-401e-ad33-912fc95a9cc7 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] [instance: c9829431-dda3-4e64-a11f-09ca52fc26ec] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:19.232134 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1d6dfe0a-41b1-401e-ad33-912fc95a9cc7 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:19.232779 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1d6dfe0a-41b1-401e-ad33-912fc95a9cc7 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:19.233730 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1d6dfe0a-41b1-401e-ad33-912fc95a9cc7 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:19.234331 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1d6dfe0a-41b1-401e-ad33-912fc95a9cc7 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:19.405530 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-1d6dfe0a-41b1-401e-ad33-912fc95a9cc7 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb5f67687dc4e9892e8ddd5c0aca940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e945e64844205b1df851fb73e1ea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:19.414434 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-1d6dfe0a-41b1-401e-ad33-912fc95a9cc7 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] 10.222.0.30 "GET /compute/v2.1/servers/c9829431-dda3-4e64-a11f-09ca52fc26ec" status: 200 len: 1314 microversion: 2.1 time: 0.195158 Mar 08 14:52:19.415002 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 92/170] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:19 2022] GET /compute/v2.1/servers/c9829431-dda3-4e64-a11f-09ca52fc26ec => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:19.841913 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-44f62a7d-06d4-42dd-b510-a42159ee91bf tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:19.842880 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-44f62a7d-06d4-42dd-b510-a42159ee91bf tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:19.849438 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-44f62a7d-06d4-42dd-b510-a42159ee91bf tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:19.849969 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-44f62a7d-06d4-42dd-b510-a42159ee91bf tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:19.850973 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-44f62a7d-06d4-42dd-b510-a42159ee91bf tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:19.851445 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-44f62a7d-06d4-42dd-b510-a42159ee91bf tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:20.082461 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-44f62a7d-06d4-42dd-b510-a42159ee91bf tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:20.091719 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-44f62a7d-06d4-42dd-b510-a42159ee91bf tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1523 microversion: 2.1 time: 0.253159 Mar 08 14:52:20.099574 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 79/171] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:19 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1523 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:20.232358 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [req-9f31bbc4-6149-43ec-bc3d-97d1af0d7440 req-ce01d575-675e-49f7-b0e7-3fd91c460f84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9829431-dda3-4e64-a11f-09ca52fc26ec", "tag": "deae0128-4e3f-42c4-a324-0768dd72680a"}]} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:52:20.242586 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-9f31bbc4-6149-43ec-bc3d-97d1af0d7440 req-ce01d575-675e-49f7-b0e7-3fd91c460f84 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:20.243031 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-9f31bbc4-6149-43ec-bc3d-97d1af0d7440 req-ce01d575-675e-49f7-b0e7-3fd91c460f84 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:20.255839 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.compute.server_external_events [req-9f31bbc4-6149-43ec-bc3d-97d1af0d7440 req-ce01d575-675e-49f7-b0e7-3fd91c460f84 service nova] Creating event network-changed:deae0128-4e3f-42c4-a324-0768dd72680a for instance c9829431-dda3-4e64-a11f-09ca52fc26ec on hv-cinder-83009 Mar 08 14:52:20.261518 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [req-9f31bbc4-6149-43ec-bc3d-97d1af0d7440 req-ce01d575-675e-49f7-b0e7-3fd91c460f84 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032777 Mar 08 14:52:20.262442 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 93/172] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 14:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:52:20.432664 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-80d074f2-63c3-4fc4-b8a8-967c683c88e1 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:20.433307 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-80d074f2-63c3-4fc4-b8a8-967c683c88e1 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] [instance: c9829431-dda3-4e64-a11f-09ca52fc26ec] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:20.439704 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-80d074f2-63c3-4fc4-b8a8-967c683c88e1 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:20.440174 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-80d074f2-63c3-4fc4-b8a8-967c683c88e1 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:20.440949 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-80d074f2-63c3-4fc4-b8a8-967c683c88e1 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:20.441414 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-80d074f2-63c3-4fc4-b8a8-967c683c88e1 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:20.609459 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-80d074f2-63c3-4fc4-b8a8-967c683c88e1 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb5f67687dc4e9892e8ddd5c0aca940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e945e64844205b1df851fb73e1ea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:20.620568 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-80d074f2-63c3-4fc4-b8a8-967c683c88e1 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] 10.222.0.30 "GET /compute/v2.1/servers/c9829431-dda3-4e64-a11f-09ca52fc26ec" status: 200 len: 1314 microversion: 2.1 time: 0.190208 Mar 08 14:52:20.620568 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 80/173] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:20 2022] GET /compute/v2.1/servers/c9829431-dda3-4e64-a11f-09ca52fc26ec => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:21.110178 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-d59f829e-ce31-4f7c-b495-90d459eb9f2e tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:21.110908 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-d59f829e-ce31-4f7c-b495-90d459eb9f2e tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:21.116829 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d59f829e-ce31-4f7c-b495-90d459eb9f2e tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:21.117286 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d59f829e-ce31-4f7c-b495-90d459eb9f2e tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:21.118092 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d59f829e-ce31-4f7c-b495-90d459eb9f2e tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:21.118538 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d59f829e-ce31-4f7c-b495-90d459eb9f2e tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:21.260338 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-d59f829e-ce31-4f7c-b495-90d459eb9f2e tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:21.268275 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-d59f829e-ce31-4f7c-b495-90d459eb9f2e tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1523 microversion: 2.1 time: 0.161788 Mar 08 14:52:21.268844 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 94/174] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:21 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:21.636194 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-4b48a979-e555-494b-9071-963c308f8430 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:21.636794 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-4b48a979-e555-494b-9071-963c308f8430 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] [instance: c9829431-dda3-4e64-a11f-09ca52fc26ec] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:21.643387 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4b48a979-e555-494b-9071-963c308f8430 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:21.643836 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4b48a979-e555-494b-9071-963c308f8430 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:21.644597 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4b48a979-e555-494b-9071-963c308f8430 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:21.645023 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4b48a979-e555-494b-9071-963c308f8430 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:21.806198 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-4b48a979-e555-494b-9071-963c308f8430 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb5f67687dc4e9892e8ddd5c0aca940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e945e64844205b1df851fb73e1ea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:21.814902 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-4b48a979-e555-494b-9071-963c308f8430 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] 10.222.0.30 "GET /compute/v2.1/servers/c9829431-dda3-4e64-a11f-09ca52fc26ec" status: 200 len: 1314 microversion: 2.1 time: 0.181544 Mar 08 14:52:21.816053 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 81/175] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:21 2022] GET /compute/v2.1/servers/c9829431-dda3-4e64-a11f-09ca52fc26ec => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:22.285652 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-f78e2d00-0717-4dde-bec2-a60f78d5f289 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:22.286296 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-f78e2d00-0717-4dde-bec2-a60f78d5f289 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:22.292543 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f78e2d00-0717-4dde-bec2-a60f78d5f289 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:22.292991 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f78e2d00-0717-4dde-bec2-a60f78d5f289 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:22.293752 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f78e2d00-0717-4dde-bec2-a60f78d5f289 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:22.294237 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f78e2d00-0717-4dde-bec2-a60f78d5f289 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:22.428427 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-f78e2d00-0717-4dde-bec2-a60f78d5f289 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:22.435779 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-f78e2d00-0717-4dde-bec2-a60f78d5f289 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1523 microversion: 2.1 time: 0.154109 Mar 08 14:52:22.436602 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 95/176] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:22 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:22.832118 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-6856ff98-2e7c-47f6-a106-acecfa00c8af tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:22.833461 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-6856ff98-2e7c-47f6-a106-acecfa00c8af tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] [instance: c9829431-dda3-4e64-a11f-09ca52fc26ec] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:22.839556 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6856ff98-2e7c-47f6-a106-acecfa00c8af tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:22.840069 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6856ff98-2e7c-47f6-a106-acecfa00c8af tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:22.841008 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6856ff98-2e7c-47f6-a106-acecfa00c8af tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:22.841504 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6856ff98-2e7c-47f6-a106-acecfa00c8af tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:23.297989 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-6856ff98-2e7c-47f6-a106-acecfa00c8af tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb5f67687dc4e9892e8ddd5c0aca940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e945e64844205b1df851fb73e1ea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:23.305982 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-6856ff98-2e7c-47f6-a106-acecfa00c8af tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] 10.222.0.30 "GET /compute/v2.1/servers/c9829431-dda3-4e64-a11f-09ca52fc26ec" status: 200 len: 1314 microversion: 2.1 time: 0.477729 Mar 08 14:52:23.306527 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 82/177] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:22 2022] GET /compute/v2.1/servers/c9829431-dda3-4e64-a11f-09ca52fc26ec => generated 1314 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:23.452342 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b42c455a-2fe1-48fa-bb63-44492c43b722 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:23.452991 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-b42c455a-2fe1-48fa-bb63-44492c43b722 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:23.459943 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b42c455a-2fe1-48fa-bb63-44492c43b722 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:23.460397 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b42c455a-2fe1-48fa-bb63-44492c43b722 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:23.461186 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b42c455a-2fe1-48fa-bb63-44492c43b722 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:23.461627 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b42c455a-2fe1-48fa-bb63-44492c43b722 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:23.594465 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-b42c455a-2fe1-48fa-bb63-44492c43b722 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:23.602484 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-b42c455a-2fe1-48fa-bb63-44492c43b722 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1523 microversion: 2.1 time: 0.153936 Mar 08 14:52:23.603055 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 96/178] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:23 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:24.323180 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-71d46a74-e6f4-413c-9e40-90ee4b7eefdb tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:24.323863 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-71d46a74-e6f4-413c-9e40-90ee4b7eefdb tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] [instance: c9829431-dda3-4e64-a11f-09ca52fc26ec] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:24.331157 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-71d46a74-e6f4-413c-9e40-90ee4b7eefdb tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:24.331678 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-71d46a74-e6f4-413c-9e40-90ee4b7eefdb tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:24.332546 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-71d46a74-e6f4-413c-9e40-90ee4b7eefdb tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:24.333047 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-71d46a74-e6f4-413c-9e40-90ee4b7eefdb tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:24.476412 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-71d46a74-e6f4-413c-9e40-90ee4b7eefdb tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb5f67687dc4e9892e8ddd5c0aca940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e945e64844205b1df851fb73e1ea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:24.483588 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-71d46a74-e6f4-413c-9e40-90ee4b7eefdb tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] 10.222.0.30 "GET /compute/v2.1/servers/c9829431-dda3-4e64-a11f-09ca52fc26ec" status: 200 len: 1314 microversion: 2.1 time: 0.164392 Mar 08 14:52:24.484139 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 83/179] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:24 2022] GET /compute/v2.1/servers/c9829431-dda3-4e64-a11f-09ca52fc26ec => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:24.620462 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b4c2b7ee-c5ad-4a54-aa73-2537eb6b7318 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:24.620999 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-b4c2b7ee-c5ad-4a54-aa73-2537eb6b7318 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:24.627517 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b4c2b7ee-c5ad-4a54-aa73-2537eb6b7318 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:24.627974 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b4c2b7ee-c5ad-4a54-aa73-2537eb6b7318 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:24.628740 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b4c2b7ee-c5ad-4a54-aa73-2537eb6b7318 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:24.629179 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b4c2b7ee-c5ad-4a54-aa73-2537eb6b7318 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:24.760491 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-b4c2b7ee-c5ad-4a54-aa73-2537eb6b7318 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:24.768647 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-b4c2b7ee-c5ad-4a54-aa73-2537eb6b7318 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1523 microversion: 2.1 time: 0.152075 Mar 08 14:52:24.769208 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 97/180] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:24 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:25.500795 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3327ff29-540a-44aa-8817-a03d9b702f88 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:25.502055 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-3327ff29-540a-44aa-8817-a03d9b702f88 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] [instance: c9829431-dda3-4e64-a11f-09ca52fc26ec] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:25.507754 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3327ff29-540a-44aa-8817-a03d9b702f88 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:25.508200 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3327ff29-540a-44aa-8817-a03d9b702f88 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:25.508956 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3327ff29-540a-44aa-8817-a03d9b702f88 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:25.509385 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3327ff29-540a-44aa-8817-a03d9b702f88 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:25.643962 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-3327ff29-540a-44aa-8817-a03d9b702f88 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb5f67687dc4e9892e8ddd5c0aca940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e945e64844205b1df851fb73e1ea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:25.651062 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-3327ff29-540a-44aa-8817-a03d9b702f88 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] 10.222.0.30 "GET /compute/v2.1/servers/c9829431-dda3-4e64-a11f-09ca52fc26ec" status: 200 len: 1314 microversion: 2.1 time: 0.154064 Mar 08 14:52:25.651615 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 84/181] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:25 2022] GET /compute/v2.1/servers/c9829431-dda3-4e64-a11f-09ca52fc26ec => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:25.785658 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-43cfc073-89ef-41e4-8935-c23a86a309cc tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:25.786309 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-43cfc073-89ef-41e4-8935-c23a86a309cc tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:25.792636 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-43cfc073-89ef-41e4-8935-c23a86a309cc tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:25.793091 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-43cfc073-89ef-41e4-8935-c23a86a309cc tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:25.793872 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-43cfc073-89ef-41e4-8935-c23a86a309cc tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:25.794325 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-43cfc073-89ef-41e4-8935-c23a86a309cc tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:25.926506 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-43cfc073-89ef-41e4-8935-c23a86a309cc tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:25.933630 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-43cfc073-89ef-41e4-8935-c23a86a309cc tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1523 microversion: 2.1 time: 0.152038 Mar 08 14:52:25.934238 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 98/182] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:25 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:26.668466 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-8fbd1e28-5021-4f1e-b47d-1c1f1c19ab7b tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:26.669083 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-8fbd1e28-5021-4f1e-b47d-1c1f1c19ab7b tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] [instance: c9829431-dda3-4e64-a11f-09ca52fc26ec] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:26.675419 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8fbd1e28-5021-4f1e-b47d-1c1f1c19ab7b tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:26.675876 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8fbd1e28-5021-4f1e-b47d-1c1f1c19ab7b tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:26.676644 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8fbd1e28-5021-4f1e-b47d-1c1f1c19ab7b tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:26.677077 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8fbd1e28-5021-4f1e-b47d-1c1f1c19ab7b tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:26.810750 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-8fbd1e28-5021-4f1e-b47d-1c1f1c19ab7b tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb5f67687dc4e9892e8ddd5c0aca940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e945e64844205b1df851fb73e1ea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:26.818855 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-8fbd1e28-5021-4f1e-b47d-1c1f1c19ab7b tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] 10.222.0.30 "GET /compute/v2.1/servers/c9829431-dda3-4e64-a11f-09ca52fc26ec" status: 200 len: 1314 microversion: 2.1 time: 0.154582 Mar 08 14:52:26.819419 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 85/183] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:26 2022] GET /compute/v2.1/servers/c9829431-dda3-4e64-a11f-09ca52fc26ec => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:26.950762 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-1d093636-b117-402e-85e8-d688cc2f5b07 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:26.951389 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-1d093636-b117-402e-85e8-d688cc2f5b07 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:26.959391 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1d093636-b117-402e-85e8-d688cc2f5b07 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:26.960453 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1d093636-b117-402e-85e8-d688cc2f5b07 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:26.961460 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1d093636-b117-402e-85e8-d688cc2f5b07 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:26.961938 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1d093636-b117-402e-85e8-d688cc2f5b07 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:27.105604 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-1d093636-b117-402e-85e8-d688cc2f5b07 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:27.113988 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-1d093636-b117-402e-85e8-d688cc2f5b07 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1523 microversion: 2.1 time: 0.167132 Mar 08 14:52:27.114566 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 99/184] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:26 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:27.836357 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-a242f926-fc87-4422-b09f-0c3b0379cc35 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:27.836960 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-a242f926-fc87-4422-b09f-0c3b0379cc35 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] [instance: c9829431-dda3-4e64-a11f-09ca52fc26ec] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:27.843577 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a242f926-fc87-4422-b09f-0c3b0379cc35 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:27.844026 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a242f926-fc87-4422-b09f-0c3b0379cc35 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:27.844789 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a242f926-fc87-4422-b09f-0c3b0379cc35 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:27.845462 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a242f926-fc87-4422-b09f-0c3b0379cc35 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:27.992477 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-a242f926-fc87-4422-b09f-0c3b0379cc35 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb5f67687dc4e9892e8ddd5c0aca940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e945e64844205b1df851fb73e1ea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:28.000652 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-a242f926-fc87-4422-b09f-0c3b0379cc35 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] 10.222.0.30 "GET /compute/v2.1/servers/c9829431-dda3-4e64-a11f-09ca52fc26ec" status: 200 len: 1314 microversion: 2.1 time: 0.167959 Mar 08 14:52:28.002217 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 86/185] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:27 2022] GET /compute/v2.1/servers/c9829431-dda3-4e64-a11f-09ca52fc26ec => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:28.131741 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-ed7a4432-cbf5-4f1e-b7bc-0b277158fbec tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:28.132689 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-ed7a4432-cbf5-4f1e-b7bc-0b277158fbec tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:28.140164 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ed7a4432-cbf5-4f1e-b7bc-0b277158fbec tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:28.141128 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ed7a4432-cbf5-4f1e-b7bc-0b277158fbec tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:28.142501 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ed7a4432-cbf5-4f1e-b7bc-0b277158fbec tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:28.143274 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ed7a4432-cbf5-4f1e-b7bc-0b277158fbec tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:28.304277 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-ed7a4432-cbf5-4f1e-b7bc-0b277158fbec tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:28.324114 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-ed7a4432-cbf5-4f1e-b7bc-0b277158fbec tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1523 microversion: 2.1 time: 0.196302 Mar 08 14:52:28.325326 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 100/186] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:28 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1523 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:29.018848 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b208bc64-46b2-4e13-906b-66cfd58d9275 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:29.020711 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b208bc64-46b2-4e13-906b-66cfd58d9275 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] [instance: c9829431-dda3-4e64-a11f-09ca52fc26ec] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:29.030036 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b208bc64-46b2-4e13-906b-66cfd58d9275 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:29.030929 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b208bc64-46b2-4e13-906b-66cfd58d9275 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:29.031935 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b208bc64-46b2-4e13-906b-66cfd58d9275 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:29.033591 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b208bc64-46b2-4e13-906b-66cfd58d9275 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:29.191357 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b208bc64-46b2-4e13-906b-66cfd58d9275 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb5f67687dc4e9892e8ddd5c0aca940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e945e64844205b1df851fb73e1ea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:29.198811 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b208bc64-46b2-4e13-906b-66cfd58d9275 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] 10.222.0.30 "GET /compute/v2.1/servers/c9829431-dda3-4e64-a11f-09ca52fc26ec" status: 200 len: 1314 microversion: 2.1 time: 0.185102 Mar 08 14:52:29.199380 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 87/187] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:29 2022] GET /compute/v2.1/servers/c9829431-dda3-4e64-a11f-09ca52fc26ec => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:29.340963 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-419bfaac-38d7-426a-9500-931e0cbe35fc tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:29.341721 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-419bfaac-38d7-426a-9500-931e0cbe35fc tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:29.349896 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-419bfaac-38d7-426a-9500-931e0cbe35fc tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:29.350661 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-419bfaac-38d7-426a-9500-931e0cbe35fc tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:29.351498 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-419bfaac-38d7-426a-9500-931e0cbe35fc tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:29.352083 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-419bfaac-38d7-426a-9500-931e0cbe35fc tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:29.524172 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-419bfaac-38d7-426a-9500-931e0cbe35fc tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:29.531757 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-419bfaac-38d7-426a-9500-931e0cbe35fc tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1523 microversion: 2.1 time: 0.194674 Mar 08 14:52:29.546153 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 101/188] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:29 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1523 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:30.215967 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-419818bb-a89c-4bb1-af68-e4d9094584cf tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:30.216574 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-419818bb-a89c-4bb1-af68-e4d9094584cf tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] [instance: c9829431-dda3-4e64-a11f-09ca52fc26ec] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:30.223386 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-419818bb-a89c-4bb1-af68-e4d9094584cf tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:30.224076 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-419818bb-a89c-4bb1-af68-e4d9094584cf tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:30.225075 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-419818bb-a89c-4bb1-af68-e4d9094584cf tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:30.225515 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-419818bb-a89c-4bb1-af68-e4d9094584cf tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:30.419143 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-419818bb-a89c-4bb1-af68-e4d9094584cf tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb5f67687dc4e9892e8ddd5c0aca940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e945e64844205b1df851fb73e1ea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:30.424732 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-419818bb-a89c-4bb1-af68-e4d9094584cf tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] 10.222.0.30 "GET /compute/v2.1/servers/c9829431-dda3-4e64-a11f-09ca52fc26ec" status: 200 len: 1314 microversion: 2.1 time: 0.211416 Mar 08 14:52:30.425527 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 88/189] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:30 2022] GET /compute/v2.1/servers/c9829431-dda3-4e64-a11f-09ca52fc26ec => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:30.549086 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-866035dd-7627-40d4-85e0-0a63e1e43b10 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:30.549799 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-866035dd-7627-40d4-85e0-0a63e1e43b10 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:30.556121 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-866035dd-7627-40d4-85e0-0a63e1e43b10 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:30.556577 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-866035dd-7627-40d4-85e0-0a63e1e43b10 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:30.557355 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-866035dd-7627-40d4-85e0-0a63e1e43b10 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:30.557794 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-866035dd-7627-40d4-85e0-0a63e1e43b10 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:30.752720 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-866035dd-7627-40d4-85e0-0a63e1e43b10 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:30.761456 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-866035dd-7627-40d4-85e0-0a63e1e43b10 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1523 microversion: 2.1 time: 0.216839 Mar 08 14:52:30.762900 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 102/190] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:30 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1523 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:31.366940 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [req-5e5d7608-47b1-417b-8b22-11725d1c550b req-cae954c6-3bd7-47d2-9d03-240b3dfcb64f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9829431-dda3-4e64-a11f-09ca52fc26ec", "name": "network-vif-plugged", "status": "completed", "tag": "deae0128-4e3f-42c4-a324-0768dd72680a"}]} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:52:31.378861 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-5e5d7608-47b1-417b-8b22-11725d1c550b req-cae954c6-3bd7-47d2-9d03-240b3dfcb64f service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:31.380289 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-5e5d7608-47b1-417b-8b22-11725d1c550b req-cae954c6-3bd7-47d2-9d03-240b3dfcb64f service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:31.396432 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.compute.server_external_events [req-5e5d7608-47b1-417b-8b22-11725d1c550b req-cae954c6-3bd7-47d2-9d03-240b3dfcb64f service nova] Creating event network-vif-plugged:deae0128-4e3f-42c4-a324-0768dd72680a for instance c9829431-dda3-4e64-a11f-09ca52fc26ec on hv-cinder-83009 Mar 08 14:52:31.404803 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [req-5e5d7608-47b1-417b-8b22-11725d1c550b req-cae954c6-3bd7-47d2-9d03-240b3dfcb64f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040822 Mar 08 14:52:31.405764 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 89/191] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 14:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:52:31.444845 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-6f800f79-9bd7-4dc0-a79b-b4928cd4d235 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:31.445762 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-6f800f79-9bd7-4dc0-a79b-b4928cd4d235 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] [instance: c9829431-dda3-4e64-a11f-09ca52fc26ec] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:31.463399 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6f800f79-9bd7-4dc0-a79b-b4928cd4d235 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:31.464149 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6f800f79-9bd7-4dc0-a79b-b4928cd4d235 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:31.464940 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6f800f79-9bd7-4dc0-a79b-b4928cd4d235 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:31.465371 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6f800f79-9bd7-4dc0-a79b-b4928cd4d235 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:31.674165 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-6f800f79-9bd7-4dc0-a79b-b4928cd4d235 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb5f67687dc4e9892e8ddd5c0aca940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e945e64844205b1df851fb73e1ea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:31.684400 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-6f800f79-9bd7-4dc0-a79b-b4928cd4d235 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] 10.222.0.30 "GET /compute/v2.1/servers/c9829431-dda3-4e64-a11f-09ca52fc26ec" status: 200 len: 1314 microversion: 2.1 time: 0.244996 Mar 08 14:52:31.685065 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 103/192] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:31 2022] GET /compute/v2.1/servers/c9829431-dda3-4e64-a11f-09ca52fc26ec => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:52:31.779225 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-471f4c70-809d-4ac8-aea6-bdc1fba64d42 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:31.779912 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-471f4c70-809d-4ac8-aea6-bdc1fba64d42 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:31.787566 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-471f4c70-809d-4ac8-aea6-bdc1fba64d42 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:31.788173 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-471f4c70-809d-4ac8-aea6-bdc1fba64d42 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:31.789012 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-471f4c70-809d-4ac8-aea6-bdc1fba64d42 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:31.789585 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-471f4c70-809d-4ac8-aea6-bdc1fba64d42 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:31.967697 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-471f4c70-809d-4ac8-aea6-bdc1fba64d42 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:31.976793 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-471f4c70-809d-4ac8-aea6-bdc1fba64d42 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1523 microversion: 2.1 time: 0.201592 Mar 08 14:52:31.977760 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 90/193] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:31 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1523 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:52:32.702398 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-686ede0a-bb97-471e-a510-179fc39c6e4b tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:32.703765 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-686ede0a-bb97-471e-a510-179fc39c6e4b tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] [instance: c9829431-dda3-4e64-a11f-09ca52fc26ec] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:32.722312 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-686ede0a-bb97-471e-a510-179fc39c6e4b tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:32.723008 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-686ede0a-bb97-471e-a510-179fc39c6e4b tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:32.724200 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-686ede0a-bb97-471e-a510-179fc39c6e4b tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:32.727479 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-686ede0a-bb97-471e-a510-179fc39c6e4b tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:32.888957 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-686ede0a-bb97-471e-a510-179fc39c6e4b tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb5f67687dc4e9892e8ddd5c0aca940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e945e64844205b1df851fb73e1ea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:32.897847 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-686ede0a-bb97-471e-a510-179fc39c6e4b tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] 10.222.0.30 "GET /compute/v2.1/servers/c9829431-dda3-4e64-a11f-09ca52fc26ec" status: 200 len: 1314 microversion: 2.1 time: 0.199637 Mar 08 14:52:32.898750 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 104/194] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:32 2022] GET /compute/v2.1/servers/c9829431-dda3-4e64-a11f-09ca52fc26ec => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:32.996823 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-acd0b966-d114-48d6-9aec-1427e0d4fe1b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:32.999068 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-acd0b966-d114-48d6-9aec-1427e0d4fe1b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:33.016287 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-acd0b966-d114-48d6-9aec-1427e0d4fe1b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:33.019803 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-acd0b966-d114-48d6-9aec-1427e0d4fe1b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:33.022969 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-acd0b966-d114-48d6-9aec-1427e0d4fe1b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:33.024554 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-acd0b966-d114-48d6-9aec-1427e0d4fe1b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:33.298328 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-acd0b966-d114-48d6-9aec-1427e0d4fe1b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:33.306585 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-acd0b966-d114-48d6-9aec-1427e0d4fe1b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1523 microversion: 2.1 time: 0.315833 Mar 08 14:52:33.309224 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 91/195] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:32 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1523 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:33.915235 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-70fe766f-6974-447a-8448-1e6db5fee459 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:33.915844 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-70fe766f-6974-447a-8448-1e6db5fee459 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] [instance: c9829431-dda3-4e64-a11f-09ca52fc26ec] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:33.923386 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-70fe766f-6974-447a-8448-1e6db5fee459 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:33.924078 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-70fe766f-6974-447a-8448-1e6db5fee459 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:33.924870 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-70fe766f-6974-447a-8448-1e6db5fee459 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:33.925306 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-70fe766f-6974-447a-8448-1e6db5fee459 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:34.152391 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-70fe766f-6974-447a-8448-1e6db5fee459 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb5f67687dc4e9892e8ddd5c0aca940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e945e64844205b1df851fb73e1ea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:34.178825 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-70fe766f-6974-447a-8448-1e6db5fee459 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] 10.222.0.30 "GET /compute/v2.1/servers/c9829431-dda3-4e64-a11f-09ca52fc26ec" status: 200 len: 1498 microversion: 2.1 time: 0.267313 Mar 08 14:52:34.180993 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 105/196] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:33 2022] GET /compute/v2.1/servers/c9829431-dda3-4e64-a11f-09ca52fc26ec => generated 1498 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:34.328761 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f912c627-a481-4bda-889d-bb9afb74a5d3 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:34.330659 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f912c627-a481-4bda-889d-bb9afb74a5d3 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:34.337577 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f912c627-a481-4bda-889d-bb9afb74a5d3 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:34.338064 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f912c627-a481-4bda-889d-bb9afb74a5d3 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:34.338841 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f912c627-a481-4bda-889d-bb9afb74a5d3 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:34.339269 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f912c627-a481-4bda-889d-bb9afb74a5d3 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:34.765595 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f912c627-a481-4bda-889d-bb9afb74a5d3 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:34.781980 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f912c627-a481-4bda-889d-bb9afb74a5d3 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1523 microversion: 2.1 time: 0.458285 Mar 08 14:52:34.792961 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 92/197] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:34 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1523 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:34.824701 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-e3d6817c-6f0b-404a-ae57-5059f0caf592 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:34.825209 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-e3d6817c-6f0b-404a-ae57-5059f0caf592 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] [instance: c9829431-dda3-4e64-a11f-09ca52fc26ec] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:34.832072 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e3d6817c-6f0b-404a-ae57-5059f0caf592 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:34.832521 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e3d6817c-6f0b-404a-ae57-5059f0caf592 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:34.833296 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e3d6817c-6f0b-404a-ae57-5059f0caf592 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:34.833728 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e3d6817c-6f0b-404a-ae57-5059f0caf592 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:34.863259 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-e3d6817c-6f0b-404a-ae57-5059f0caf592 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] [instance: c9829431-dda3-4e64-a11f-09ca52fc26ec] Going to try to terminate instance {{(pid=128351) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 14:52:34.969057 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-e3d6817c-6f0b-404a-ae57-5059f0caf592 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c9829431-dda3-4e64-a11f-09ca52fc26ec" status: 204 len: 0 microversion: 2.1 time: 0.147653 Mar 08 14:52:34.975875 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 106/198] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 14:52:34 2022] DELETE /compute/v2.1/servers/c9829431-dda3-4e64-a11f-09ca52fc26ec => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 14:52:34.988461 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-88b90ec9-b772-4a90-80df-dadf1d75dff6 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:34.992675 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-88b90ec9-b772-4a90-80df-dadf1d75dff6 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] [instance: c9829431-dda3-4e64-a11f-09ca52fc26ec] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:35.003806 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-88b90ec9-b772-4a90-80df-dadf1d75dff6 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:35.005107 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-88b90ec9-b772-4a90-80df-dadf1d75dff6 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:35.006795 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-88b90ec9-b772-4a90-80df-dadf1d75dff6 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:35.007820 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-88b90ec9-b772-4a90-80df-dadf1d75dff6 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:35.259875 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-88b90ec9-b772-4a90-80df-dadf1d75dff6 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb5f67687dc4e9892e8ddd5c0aca940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e945e64844205b1df851fb73e1ea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:35.270735 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-88b90ec9-b772-4a90-80df-dadf1d75dff6 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] 10.222.0.30 "GET /compute/v2.1/servers/c9829431-dda3-4e64-a11f-09ca52fc26ec" status: 200 len: 1504 microversion: 2.1 time: 0.294428 Mar 08 14:52:35.283754 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 93/199] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:34 2022] GET /compute/v2.1/servers/c9829431-dda3-4e64-a11f-09ca52fc26ec => generated 1504 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:35.810362 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-31ee693d-49ce-4db5-8f2b-7ab1c0b02ade tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:35.810362 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-31ee693d-49ce-4db5-8f2b-7ab1c0b02ade tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:35.822213 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-31ee693d-49ce-4db5-8f2b-7ab1c0b02ade tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:35.823034 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-31ee693d-49ce-4db5-8f2b-7ab1c0b02ade tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:35.825449 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-31ee693d-49ce-4db5-8f2b-7ab1c0b02ade tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:35.826089 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-31ee693d-49ce-4db5-8f2b-7ab1c0b02ade tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:36.117737 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-31ee693d-49ce-4db5-8f2b-7ab1c0b02ade tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:36.128118 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-31ee693d-49ce-4db5-8f2b-7ab1c0b02ade tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1523 microversion: 2.1 time: 0.330924 Mar 08 14:52:36.130312 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 107/200] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:35 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1523 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:36.303226 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f1ad4021-9008-4478-9b59-2c5dc281f35a tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:36.303981 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f1ad4021-9008-4478-9b59-2c5dc281f35a tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] [instance: c9829431-dda3-4e64-a11f-09ca52fc26ec] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:36.311066 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f1ad4021-9008-4478-9b59-2c5dc281f35a tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:36.311662 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f1ad4021-9008-4478-9b59-2c5dc281f35a tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:36.312899 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f1ad4021-9008-4478-9b59-2c5dc281f35a tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:36.314286 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f1ad4021-9008-4478-9b59-2c5dc281f35a tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:36.480653 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f1ad4021-9008-4478-9b59-2c5dc281f35a tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb5f67687dc4e9892e8ddd5c0aca940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e945e64844205b1df851fb73e1ea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:36.491238 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f1ad4021-9008-4478-9b59-2c5dc281f35a tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] 10.222.0.30 "GET /compute/v2.1/servers/c9829431-dda3-4e64-a11f-09ca52fc26ec" status: 200 len: 1504 microversion: 2.1 time: 0.192257 Mar 08 14:52:36.491809 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 94/201] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:36 2022] GET /compute/v2.1/servers/c9829431-dda3-4e64-a11f-09ca52fc26ec => generated 1504 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:37.148434 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-4d7c10a1-31e4-44ce-9858-41f923b2ba8c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:37.149048 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-4d7c10a1-31e4-44ce-9858-41f923b2ba8c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:37.158144 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4d7c10a1-31e4-44ce-9858-41f923b2ba8c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:37.158947 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4d7c10a1-31e4-44ce-9858-41f923b2ba8c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:37.160027 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4d7c10a1-31e4-44ce-9858-41f923b2ba8c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:37.160740 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4d7c10a1-31e4-44ce-9858-41f923b2ba8c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:37.431023 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-2edfdf55-bed6-4ae2-99fd-4d689822d335 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1017418602", "imageRef": "7541d53b-003d-4f1a-8d76-fc5f4bd8dabf", "flavorRef": "452", "networks": [{"uuid": "2caa43d2-21a1-44c8-a1ce-546588a7a2ce"}]}} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:52:37.523173 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.network.neutron [None req-2edfdf55-bed6-4ae2-99fd-4d689822d335 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] validate_networks() for [('2caa43d2-21a1-44c8-a1ce-546588a7a2ce', None, None, None, None, None)] {{(pid=128352) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 14:52:37.601239 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-4d7c10a1-31e4-44ce-9858-41f923b2ba8c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:37.609002 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-4d7c10a1-31e4-44ce-9858-41f923b2ba8c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1503 microversion: 2.1 time: 0.465135 Mar 08 14:52:37.613749 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 108/202] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:37 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1503 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:37.618567 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-f99102b8-72ef-4ab8-87c7-e5d4c94d51b9 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:37.625648 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-f99102b8-72ef-4ab8-87c7-e5d4c94d51b9 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] [instance: c9829431-dda3-4e64-a11f-09ca52fc26ec] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:37.633062 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f99102b8-72ef-4ab8-87c7-e5d4c94d51b9 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:37.633809 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f99102b8-72ef-4ab8-87c7-e5d4c94d51b9 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:37.634903 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f99102b8-72ef-4ab8-87c7-e5d4c94d51b9 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:37.635492 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f99102b8-72ef-4ab8-87c7-e5d4c94d51b9 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:37.671381 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f99102b8-72ef-4ab8-87c7-e5d4c94d51b9 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:37.671835 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f99102b8-72ef-4ab8-87c7-e5d4c94d51b9 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:37.672296 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.objects.instance [None req-f99102b8-72ef-4ab8-87c7-e5d4c94d51b9 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lazy-loading 'fault' on Instance uuid c9829431-dda3-4e64-a11f-09ca52fc26ec {{(pid=128351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 14:52:37.732720 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-f99102b8-72ef-4ab8-87c7-e5d4c94d51b9 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb5f67687dc4e9892e8ddd5c0aca940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e945e64844205b1df851fb73e1ea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:37.742074 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-f99102b8-72ef-4ab8-87c7-e5d4c94d51b9 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] 10.222.0.30 "GET /compute/v2.1/servers/c9829431-dda3-4e64-a11f-09ca52fc26ec" status: 200 len: 1304 microversion: 2.1 time: 0.127125 Mar 08 14:52:37.742657 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 109/203] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:37 2022] GET /compute/v2.1/servers/c9829431-dda3-4e64-a11f-09ca52fc26ec => generated 1304 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:37.747322 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [req-71d0cb45-302c-47c3-89ab-2a1585ae994c req-08653aa3-d1da-4b23-9366-7eabc286126f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9829431-dda3-4e64-a11f-09ca52fc26ec", "name": "network-vif-deleted", "tag": "deae0128-4e3f-42c4-a324-0768dd72680a"}]} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:52:37.756297 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-71d0cb45-302c-47c3-89ab-2a1585ae994c req-08653aa3-d1da-4b23-9366-7eabc286126f service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:37.756739 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-71d0cb45-302c-47c3-89ab-2a1585ae994c req-08653aa3-d1da-4b23-9366-7eabc286126f service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:37.779352 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.compute.server_external_events [req-71d0cb45-302c-47c3-89ab-2a1585ae994c req-08653aa3-d1da-4b23-9366-7eabc286126f service nova] Creating event network-vif-deleted:deae0128-4e3f-42c4-a324-0768dd72680a for instance c9829431-dda3-4e64-a11f-09ca52fc26ec on hv-cinder-83009 Mar 08 14:52:37.786230 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [req-71d0cb45-302c-47c3-89ab-2a1585ae994c req-08653aa3-d1da-4b23-9366-7eabc286126f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041757 Mar 08 14:52:37.787885 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 110/204] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 14:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:52:37.794151 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-8682470f-06af-48b9-8a43-193404d1ee4a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:37.795305 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-8682470f-06af-48b9-8a43-193404d1ee4a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:37.802840 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8682470f-06af-48b9-8a43-193404d1ee4a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:37.803543 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8682470f-06af-48b9-8a43-193404d1ee4a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:37.804527 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8682470f-06af-48b9-8a43-193404d1ee4a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:37.805125 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8682470f-06af-48b9-8a43-193404d1ee4a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:38.003290 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-8682470f-06af-48b9-8a43-193404d1ee4a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:38.011461 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-8682470f-06af-48b9-8a43-193404d1ee4a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1516 microversion: 2.1 time: 0.222102 Mar 08 14:52:38.012409 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 111/205] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:37 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1516 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:38.023320 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.virt.hardware [None req-2edfdf55-bed6-4ae2-99fd-4d689822d335 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Flavor limits 0:0:0 {{(pid=128352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 14:52:38.024038 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.virt.hardware [None req-2edfdf55-bed6-4ae2-99fd-4d689822d335 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Image limits 0:0:0 {{(pid=128352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 14:52:38.024903 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.virt.hardware [None req-2edfdf55-bed6-4ae2-99fd-4d689822d335 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Flavor pref 0:0:0 {{(pid=128352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 14:52:38.025902 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.virt.hardware [None req-2edfdf55-bed6-4ae2-99fd-4d689822d335 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Image pref 0:0:0 {{(pid=128352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 14:52:38.028246 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.virt.hardware [None req-2edfdf55-bed6-4ae2-99fd-4d689822d335 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 14:52:38.046096 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2edfdf55-bed6-4ae2-99fd-4d689822d335 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:38.046591 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2edfdf55-bed6-4ae2-99fd-4d689822d335 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:38.047470 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2edfdf55-bed6-4ae2-99fd-4d689822d335 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:38.049176 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2edfdf55-bed6-4ae2-99fd-4d689822d335 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:38.076881 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.quota [None req-2edfdf55-bed6-4ae2-99fd-4d689822d335 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Getting quotas for project 3d53fd1057c44dffb358b098d5f190fa. Resources: {'instances', 'ram', 'cores'} {{(pid=128352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 14:52:38.081796 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.quota [None req-2edfdf55-bed6-4ae2-99fd-4d689822d335 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Getting quotas for user 6d080fb7bd6049dea53fe1912d46b11b and project 3d53fd1057c44dffb358b098d5f190fa. Resources: {'instances', 'ram', 'cores'} {{(pid=128352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 14:52:38.095198 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-2edfdf55-bed6-4ae2-99fd-4d689822d335 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Going to run 1 instances... {{(pid=128352) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 14:52:38.097834 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-2edfdf55-bed6-4ae2-99fd-4d689822d335 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: 463a3a9d-f121-4ca8-81f7-d8e9be78888d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7541d53b-003d-4f1a-8d76-fc5f4bd8dabf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 14:52:38.146092 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-2edfdf55-bed6-4ae2-99fd-4d689822d335 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.725499 Mar 08 14:52:38.147067 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 95/206] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Mar 8 14:52:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 08 14:52:38.158007 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-eb1f3db1-9356-40b3-9714-eacc7416f142 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:38.159070 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-eb1f3db1-9356-40b3-9714-eacc7416f142 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: 463a3a9d-f121-4ca8-81f7-d8e9be78888d] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:38.239690 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-eb1f3db1-9356-40b3-9714-eacc7416f142 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d080fb7bd6049dea53fe1912d46b11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53fd1057c44dffb358b098d5f190fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:38.246204 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-eb1f3db1-9356-40b3-9714-eacc7416f142 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "GET /compute/v2.1/servers/463a3a9d-f121-4ca8-81f7-d8e9be78888d" status: 200 len: 1219 microversion: 2.1 time: 0.093037 Mar 08 14:52:38.246916 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 112/207] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:38 2022] GET /compute/v2.1/servers/463a3a9d-f121-4ca8-81f7-d8e9be78888d => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:38.760296 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-32e95eb9-2af5-494d-859c-1f7a5a8934d8 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:38.760907 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-32e95eb9-2af5-494d-859c-1f7a5a8934d8 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] [instance: c9829431-dda3-4e64-a11f-09ca52fc26ec] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:38.767534 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-32e95eb9-2af5-494d-859c-1f7a5a8934d8 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:38.768168 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-32e95eb9-2af5-494d-859c-1f7a5a8934d8 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:38.768934 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-32e95eb9-2af5-494d-859c-1f7a5a8934d8 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:38.769371 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-32e95eb9-2af5-494d-859c-1f7a5a8934d8 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:38.798199 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-32e95eb9-2af5-494d-859c-1f7a5a8934d8 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:38.798650 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-32e95eb9-2af5-494d-859c-1f7a5a8934d8 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:38.799094 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.objects.instance [None req-32e95eb9-2af5-494d-859c-1f7a5a8934d8 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lazy-loading 'fault' on Instance uuid c9829431-dda3-4e64-a11f-09ca52fc26ec {{(pid=128352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 14:52:38.839230 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-32e95eb9-2af5-494d-859c-1f7a5a8934d8 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb5f67687dc4e9892e8ddd5c0aca940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e945e64844205b1df851fb73e1ea2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:38.846643 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-32e95eb9-2af5-494d-859c-1f7a5a8934d8 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] 10.222.0.30 "GET /compute/v2.1/servers/c9829431-dda3-4e64-a11f-09ca52fc26ec" status: 200 len: 1304 microversion: 2.1 time: 0.090305 Mar 08 14:52:38.847210 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 96/208] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:38 2022] GET /compute/v2.1/servers/c9829431-dda3-4e64-a11f-09ca52fc26ec => generated 1304 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:39.263422 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-38e124de-fae5-4d51-9fd6-610d1e17e44d tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:39.264027 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-38e124de-fae5-4d51-9fd6-610d1e17e44d tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: 463a3a9d-f121-4ca8-81f7-d8e9be78888d] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:39.271157 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-38e124de-fae5-4d51-9fd6-610d1e17e44d tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:39.271608 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-38e124de-fae5-4d51-9fd6-610d1e17e44d tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:39.272398 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-38e124de-fae5-4d51-9fd6-610d1e17e44d tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:39.272835 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-38e124de-fae5-4d51-9fd6-610d1e17e44d tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:39.331681 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-38e124de-fae5-4d51-9fd6-610d1e17e44d tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d080fb7bd6049dea53fe1912d46b11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53fd1057c44dffb358b098d5f190fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:39.338848 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-38e124de-fae5-4d51-9fd6-610d1e17e44d tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "GET /compute/v2.1/servers/463a3a9d-f121-4ca8-81f7-d8e9be78888d" status: 200 len: 1223 microversion: 2.1 time: 0.079372 Mar 08 14:52:39.339415 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 113/209] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:39 2022] GET /compute/v2.1/servers/463a3a9d-f121-4ca8-81f7-d8e9be78888d => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:39.863803 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-e38c0b2f-ef42-4ec9-97c5-9ad8294a0e86 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:39.864338 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-e38c0b2f-ef42-4ec9-97c5-9ad8294a0e86 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] [instance: c9829431-dda3-4e64-a11f-09ca52fc26ec] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:39.870057 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e38c0b2f-ef42-4ec9-97c5-9ad8294a0e86 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:39.870502 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e38c0b2f-ef42-4ec9-97c5-9ad8294a0e86 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:39.871255 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e38c0b2f-ef42-4ec9-97c5-9ad8294a0e86 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:39.871685 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e38c0b2f-ef42-4ec9-97c5-9ad8294a0e86 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:39.884201 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-e38c0b2f-ef42-4ec9-97c5-9ad8294a0e86 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] HTTP exception thrown: Instance c9829431-dda3-4e64-a11f-09ca52fc26ec could not be found. Mar 08 14:52:39.884771 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-e38c0b2f-ef42-4ec9-97c5-9ad8294a0e86 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] Returning 404 to user: Instance c9829431-dda3-4e64-a11f-09ca52fc26ec could not be found. {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 14:52:39.885557 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-e38c0b2f-ef42-4ec9-97c5-9ad8294a0e86 tempest-VolumesActionsTest-1913083217 tempest-VolumesActionsTest-1913083217-project] 10.222.0.30 "GET /compute/v2.1/servers/c9829431-dda3-4e64-a11f-09ca52fc26ec" status: 404 len: 111 microversion: 2.1 time: 0.026065 Mar 08 14:52:39.886101 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 97/210] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:39 2022] GET /compute/v2.1/servers/c9829431-dda3-4e64-a11f-09ca52fc26ec => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 14:52:40.356102 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-5d746922-bc10-42c6-9629-db2ae5b652fc tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:40.356755 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-5d746922-bc10-42c6-9629-db2ae5b652fc tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: 463a3a9d-f121-4ca8-81f7-d8e9be78888d] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:40.362960 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5d746922-bc10-42c6-9629-db2ae5b652fc tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:40.363414 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5d746922-bc10-42c6-9629-db2ae5b652fc tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:40.364173 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5d746922-bc10-42c6-9629-db2ae5b652fc tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:40.364660 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5d746922-bc10-42c6-9629-db2ae5b652fc tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:40.426383 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-5d746922-bc10-42c6-9629-db2ae5b652fc tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d080fb7bd6049dea53fe1912d46b11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53fd1057c44dffb358b098d5f190fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:40.434254 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-5d746922-bc10-42c6-9629-db2ae5b652fc tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "GET /compute/v2.1/servers/463a3a9d-f121-4ca8-81f7-d8e9be78888d" status: 200 len: 1223 microversion: 2.1 time: 0.081732 Mar 08 14:52:40.434848 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 114/211] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:40 2022] GET /compute/v2.1/servers/463a3a9d-f121-4ca8-81f7-d8e9be78888d => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:41.453929 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-4600adff-7be7-4eee-aeec-88244c8e121f tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:41.458731 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-4600adff-7be7-4eee-aeec-88244c8e121f tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: 463a3a9d-f121-4ca8-81f7-d8e9be78888d] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:41.464616 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4600adff-7be7-4eee-aeec-88244c8e121f tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:41.465068 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4600adff-7be7-4eee-aeec-88244c8e121f tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:41.465868 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4600adff-7be7-4eee-aeec-88244c8e121f tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:41.466316 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4600adff-7be7-4eee-aeec-88244c8e121f tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:41.549804 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-7ef61b8f-0804-4cc4-ac4f-3b9b327f4a5d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:52:41.551934 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-7ef61b8f-0804-4cc4-ac4f-3b9b327f4a5d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:41.558411 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-4600adff-7be7-4eee-aeec-88244c8e121f tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d080fb7bd6049dea53fe1912d46b11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53fd1057c44dffb358b098d5f190fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:41.567491 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-4600adff-7be7-4eee-aeec-88244c8e121f tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "GET /compute/v2.1/servers/463a3a9d-f121-4ca8-81f7-d8e9be78888d" status: 200 len: 1289 microversion: 2.1 time: 0.119271 Mar 08 14:52:41.568069 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 98/212] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:41 2022] GET /compute/v2.1/servers/463a3a9d-f121-4ca8-81f7-d8e9be78888d => generated 1289 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:41.580082 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7ef61b8f-0804-4cc4-ac4f-3b9b327f4a5d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:41.580696 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7ef61b8f-0804-4cc4-ac4f-3b9b327f4a5d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:41.581558 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7ef61b8f-0804-4cc4-ac4f-3b9b327f4a5d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:41.582097 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7ef61b8f-0804-4cc4-ac4f-3b9b327f4a5d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:41.606493 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.objects.instance [None req-7ef61b8f-0804-4cc4-ac4f-3b9b327f4a5d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lazy-loading 'flavor' on Instance uuid f936e19e-08fe-43d1-8c05-2fc52d3a5a67 {{(pid=128351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 14:52:41.689776 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-7ef61b8f-0804-4cc4-ac4f-3b9b327f4a5d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "POST /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67/action" status: 200 len: 32 microversion: 2.1 time: 0.145092 Mar 08 14:52:41.690439 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 115/213] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Mar 8 14:52:41 2022] POST /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67/action => generated 32 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 08 14:52:41.706224 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-2934e7e8-bd2d-4ee4-ab0e-c1b39675aac0 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:41.706765 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-2934e7e8-bd2d-4ee4-ab0e-c1b39675aac0 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:41.712584 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2934e7e8-bd2d-4ee4-ab0e-c1b39675aac0 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:41.713031 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2934e7e8-bd2d-4ee4-ab0e-c1b39675aac0 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:41.713795 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2934e7e8-bd2d-4ee4-ab0e-c1b39675aac0 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:41.714251 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2934e7e8-bd2d-4ee4-ab0e-c1b39675aac0 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:41.940650 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-2934e7e8-bd2d-4ee4-ab0e-c1b39675aac0 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:41.948342 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-2934e7e8-bd2d-4ee4-ab0e-c1b39675aac0 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1522 microversion: 2.1 time: 0.246210 Mar 08 14:52:41.949107 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 99/214] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:41 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:42.584768 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-4edfdc75-b12d-4ecb-a631-47516b2397e4 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:42.585635 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-4edfdc75-b12d-4ecb-a631-47516b2397e4 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: 463a3a9d-f121-4ca8-81f7-d8e9be78888d] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:42.593097 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4edfdc75-b12d-4ecb-a631-47516b2397e4 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:42.593609 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4edfdc75-b12d-4ecb-a631-47516b2397e4 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:42.594940 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4edfdc75-b12d-4ecb-a631-47516b2397e4 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:42.595390 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4edfdc75-b12d-4ecb-a631-47516b2397e4 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:42.749810 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-4edfdc75-b12d-4ecb-a631-47516b2397e4 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d080fb7bd6049dea53fe1912d46b11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53fd1057c44dffb358b098d5f190fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:42.757426 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-4edfdc75-b12d-4ecb-a631-47516b2397e4 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "GET /compute/v2.1/servers/463a3a9d-f121-4ca8-81f7-d8e9be78888d" status: 200 len: 1319 microversion: 2.1 time: 0.177228 Mar 08 14:52:42.758016 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 116/215] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:42 2022] GET /compute/v2.1/servers/463a3a9d-f121-4ca8-81f7-d8e9be78888d => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:52:42.965884 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-faa1d06e-634b-4fb3-a5f7-9f931f47ebbd tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:42.966505 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-faa1d06e-634b-4fb3-a5f7-9f931f47ebbd tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:42.973819 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-faa1d06e-634b-4fb3-a5f7-9f931f47ebbd tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:42.974304 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-faa1d06e-634b-4fb3-a5f7-9f931f47ebbd tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:42.975069 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-faa1d06e-634b-4fb3-a5f7-9f931f47ebbd tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:42.975506 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-faa1d06e-634b-4fb3-a5f7-9f931f47ebbd tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:43.108437 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-faa1d06e-634b-4fb3-a5f7-9f931f47ebbd tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:43.116847 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-faa1d06e-634b-4fb3-a5f7-9f931f47ebbd tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1522 microversion: 2.1 time: 0.154748 Mar 08 14:52:43.117419 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 100/216] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:42 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:43.774949 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-0692a126-fc76-4ac4-9e71-0fe382284787 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:43.775554 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-0692a126-fc76-4ac4-9e71-0fe382284787 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: 463a3a9d-f121-4ca8-81f7-d8e9be78888d] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:43.781428 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0692a126-fc76-4ac4-9e71-0fe382284787 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:43.781983 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0692a126-fc76-4ac4-9e71-0fe382284787 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:43.782748 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0692a126-fc76-4ac4-9e71-0fe382284787 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:43.783184 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0692a126-fc76-4ac4-9e71-0fe382284787 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:43.923576 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-0692a126-fc76-4ac4-9e71-0fe382284787 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d080fb7bd6049dea53fe1912d46b11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53fd1057c44dffb358b098d5f190fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:43.930964 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-0692a126-fc76-4ac4-9e71-0fe382284787 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "GET /compute/v2.1/servers/463a3a9d-f121-4ca8-81f7-d8e9be78888d" status: 200 len: 1319 microversion: 2.1 time: 0.159817 Mar 08 14:52:43.931540 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 117/217] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:43 2022] GET /compute/v2.1/servers/463a3a9d-f121-4ca8-81f7-d8e9be78888d => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:44.133591 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-74deaedf-4e52-4746-ab8f-f260268a4500 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:44.134220 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-74deaedf-4e52-4746-ab8f-f260268a4500 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:44.140057 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-74deaedf-4e52-4746-ab8f-f260268a4500 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:44.140506 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-74deaedf-4e52-4746-ab8f-f260268a4500 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:44.141750 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-74deaedf-4e52-4746-ab8f-f260268a4500 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:44.142230 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-74deaedf-4e52-4746-ab8f-f260268a4500 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:44.279828 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-74deaedf-4e52-4746-ab8f-f260268a4500 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:44.287532 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-74deaedf-4e52-4746-ab8f-f260268a4500 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1522 microversion: 2.1 time: 0.157885 Mar 08 14:52:44.288095 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 101/218] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:44 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:44.948397 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-e3cab047-66ac-4736-8659-ba5865a3c003 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:44.949543 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-e3cab047-66ac-4736-8659-ba5865a3c003 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: 463a3a9d-f121-4ca8-81f7-d8e9be78888d] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:44.956401 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e3cab047-66ac-4736-8659-ba5865a3c003 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:44.956858 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e3cab047-66ac-4736-8659-ba5865a3c003 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:44.957644 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e3cab047-66ac-4736-8659-ba5865a3c003 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:44.958111 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e3cab047-66ac-4736-8659-ba5865a3c003 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:45.096480 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-e3cab047-66ac-4736-8659-ba5865a3c003 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d080fb7bd6049dea53fe1912d46b11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53fd1057c44dffb358b098d5f190fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:45.103907 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-e3cab047-66ac-4736-8659-ba5865a3c003 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "GET /compute/v2.1/servers/463a3a9d-f121-4ca8-81f7-d8e9be78888d" status: 200 len: 1319 microversion: 2.1 time: 0.159302 Mar 08 14:52:45.104480 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 118/219] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:44 2022] GET /compute/v2.1/servers/463a3a9d-f121-4ca8-81f7-d8e9be78888d => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:45.304047 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-a40090a7-c97c-4b0e-a29c-45caf147cdad tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:45.304767 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-a40090a7-c97c-4b0e-a29c-45caf147cdad tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:45.310597 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a40090a7-c97c-4b0e-a29c-45caf147cdad tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:45.311137 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a40090a7-c97c-4b0e-a29c-45caf147cdad tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:45.311965 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a40090a7-c97c-4b0e-a29c-45caf147cdad tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:45.312736 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a40090a7-c97c-4b0e-a29c-45caf147cdad tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:45.592219 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-a40090a7-c97c-4b0e-a29c-45caf147cdad tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:45.601026 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-a40090a7-c97c-4b0e-a29c-45caf147cdad tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1522 microversion: 2.1 time: 0.300684 Mar 08 14:52:45.611385 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 102/220] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:45 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1522 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:45.669207 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [req-cc26d203-8990-4e93-8de7-085f0946f043 req-328558ec-71dd-4784-b343-06ae64e7bf7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "463a3a9d-f121-4ca8-81f7-d8e9be78888d", "tag": "d493f362-caab-4ded-95a0-670d3d821f36"}]} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:52:45.684586 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-cc26d203-8990-4e93-8de7-085f0946f043 req-328558ec-71dd-4784-b343-06ae64e7bf7d service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:45.685366 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-cc26d203-8990-4e93-8de7-085f0946f043 req-328558ec-71dd-4784-b343-06ae64e7bf7d service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:45.701217 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.compute.server_external_events [req-cc26d203-8990-4e93-8de7-085f0946f043 req-328558ec-71dd-4784-b343-06ae64e7bf7d service nova] Creating event network-changed:d493f362-caab-4ded-95a0-670d3d821f36 for instance 463a3a9d-f121-4ca8-81f7-d8e9be78888d on hv-cinder-83009 Mar 08 14:52:45.706403 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [req-cc26d203-8990-4e93-8de7-085f0946f043 req-328558ec-71dd-4784-b343-06ae64e7bf7d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044088 Mar 08 14:52:45.707816 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 119/221] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 14:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:52:46.124357 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-0dad0553-9ddb-4c3b-b560-2efe2dabd245 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:46.124357 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-0dad0553-9ddb-4c3b-b560-2efe2dabd245 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: 463a3a9d-f121-4ca8-81f7-d8e9be78888d] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:46.137342 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0dad0553-9ddb-4c3b-b560-2efe2dabd245 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:46.138989 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0dad0553-9ddb-4c3b-b560-2efe2dabd245 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:46.143137 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0dad0553-9ddb-4c3b-b560-2efe2dabd245 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:46.145174 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0dad0553-9ddb-4c3b-b560-2efe2dabd245 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:46.385949 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-0dad0553-9ddb-4c3b-b560-2efe2dabd245 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d080fb7bd6049dea53fe1912d46b11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53fd1057c44dffb358b098d5f190fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:46.395674 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-0dad0553-9ddb-4c3b-b560-2efe2dabd245 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "GET /compute/v2.1/servers/463a3a9d-f121-4ca8-81f7-d8e9be78888d" status: 200 len: 1319 microversion: 2.1 time: 0.278910 Mar 08 14:52:46.405878 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 103/222] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:46 2022] GET /compute/v2.1/servers/463a3a9d-f121-4ca8-81f7-d8e9be78888d => generated 1319 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:46.623739 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-d915d197-6dee-48b1-b9b4-29c3433ab365 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:46.625873 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-d915d197-6dee-48b1-b9b4-29c3433ab365 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:46.642225 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d915d197-6dee-48b1-b9b4-29c3433ab365 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:46.642716 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d915d197-6dee-48b1-b9b4-29c3433ab365 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:46.643546 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d915d197-6dee-48b1-b9b4-29c3433ab365 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:46.643987 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d915d197-6dee-48b1-b9b4-29c3433ab365 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:46.791862 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-d915d197-6dee-48b1-b9b4-29c3433ab365 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:46.801024 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-d915d197-6dee-48b1-b9b4-29c3433ab365 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1522 microversion: 2.1 time: 0.186056 Mar 08 14:52:46.801602 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 120/223] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:46 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:47.414021 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-eefdc8de-5d84-46d8-b770-8e496106540c tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:47.415268 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-eefdc8de-5d84-46d8-b770-8e496106540c tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: 463a3a9d-f121-4ca8-81f7-d8e9be78888d] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:47.421284 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-eefdc8de-5d84-46d8-b770-8e496106540c tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:47.421813 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-eefdc8de-5d84-46d8-b770-8e496106540c tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:47.423255 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-eefdc8de-5d84-46d8-b770-8e496106540c tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:47.423879 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-eefdc8de-5d84-46d8-b770-8e496106540c tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:47.612704 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-eefdc8de-5d84-46d8-b770-8e496106540c tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d080fb7bd6049dea53fe1912d46b11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53fd1057c44dffb358b098d5f190fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:47.623521 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-eefdc8de-5d84-46d8-b770-8e496106540c tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "GET /compute/v2.1/servers/463a3a9d-f121-4ca8-81f7-d8e9be78888d" status: 200 len: 1319 microversion: 2.1 time: 0.214028 Mar 08 14:52:47.624234 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 104/224] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:47 2022] GET /compute/v2.1/servers/463a3a9d-f121-4ca8-81f7-d8e9be78888d => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:47.818807 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-561e7e49-9aca-4bc6-84e9-3a06b487938c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:47.820166 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-561e7e49-9aca-4bc6-84e9-3a06b487938c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:47.826429 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-561e7e49-9aca-4bc6-84e9-3a06b487938c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:47.826882 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-561e7e49-9aca-4bc6-84e9-3a06b487938c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:47.827685 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-561e7e49-9aca-4bc6-84e9-3a06b487938c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:47.828368 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-561e7e49-9aca-4bc6-84e9-3a06b487938c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:47.974414 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-561e7e49-9aca-4bc6-84e9-3a06b487938c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:47.982564 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-561e7e49-9aca-4bc6-84e9-3a06b487938c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1522 microversion: 2.1 time: 0.168327 Mar 08 14:52:47.983126 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 121/225] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:47 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:48.640110 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-28bbdd54-3a2e-4492-a9a7-9c580c8ba3bb tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:48.640698 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-28bbdd54-3a2e-4492-a9a7-9c580c8ba3bb tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: 463a3a9d-f121-4ca8-81f7-d8e9be78888d] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:48.647609 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-28bbdd54-3a2e-4492-a9a7-9c580c8ba3bb tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:48.648072 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-28bbdd54-3a2e-4492-a9a7-9c580c8ba3bb tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:48.648844 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-28bbdd54-3a2e-4492-a9a7-9c580c8ba3bb tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:48.649285 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-28bbdd54-3a2e-4492-a9a7-9c580c8ba3bb tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:48.818233 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-28bbdd54-3a2e-4492-a9a7-9c580c8ba3bb tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d080fb7bd6049dea53fe1912d46b11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53fd1057c44dffb358b098d5f190fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:48.826541 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-28bbdd54-3a2e-4492-a9a7-9c580c8ba3bb tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "GET /compute/v2.1/servers/463a3a9d-f121-4ca8-81f7-d8e9be78888d" status: 200 len: 1319 microversion: 2.1 time: 0.190284 Mar 08 14:52:48.827102 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 105/226] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:48 2022] GET /compute/v2.1/servers/463a3a9d-f121-4ca8-81f7-d8e9be78888d => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:48.871053 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-bae9e752-d145-434b-80fa-97bee287d6d4 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:48.871617 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-bae9e752-d145-434b-80fa-97bee287d6d4 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:48.883602 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bae9e752-d145-434b-80fa-97bee287d6d4 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:48.884548 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bae9e752-d145-434b-80fa-97bee287d6d4 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:48.885370 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bae9e752-d145-434b-80fa-97bee287d6d4 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:48.886010 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bae9e752-d145-434b-80fa-97bee287d6d4 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:48.925585 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-bae9e752-d145-434b-80fa-97bee287d6d4 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e/ips" status: 200 len: 146 microversion: 2.1 time: 0.059333 Mar 08 14:52:48.926328 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 122/227] 10.222.0.30 () {58 vars in 1247 bytes} [Tue Mar 8 14:52:48 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e/ips => generated 146 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:52:49.002090 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-9299f87b-eaa7-4ade-8a26-6d148d1d2627 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:49.002950 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-9299f87b-eaa7-4ade-8a26-6d148d1d2627 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:49.008854 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9299f87b-eaa7-4ade-8a26-6d148d1d2627 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:49.009301 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9299f87b-eaa7-4ade-8a26-6d148d1d2627 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:49.010284 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9299f87b-eaa7-4ade-8a26-6d148d1d2627 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:49.010719 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9299f87b-eaa7-4ade-8a26-6d148d1d2627 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:49.162928 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-9299f87b-eaa7-4ade-8a26-6d148d1d2627 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:49.170774 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-9299f87b-eaa7-4ade-8a26-6d148d1d2627 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1522 microversion: 2.1 time: 0.173584 Mar 08 14:52:49.171600 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 106/228] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:48 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:49.844421 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-a63bc259-97ce-4661-ae39-c4ad8787b533 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:49.845038 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-a63bc259-97ce-4661-ae39-c4ad8787b533 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: 463a3a9d-f121-4ca8-81f7-d8e9be78888d] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:49.851370 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a63bc259-97ce-4661-ae39-c4ad8787b533 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:49.851825 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a63bc259-97ce-4661-ae39-c4ad8787b533 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:49.852648 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a63bc259-97ce-4661-ae39-c4ad8787b533 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:49.853085 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a63bc259-97ce-4661-ae39-c4ad8787b533 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:50.069910 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-a63bc259-97ce-4661-ae39-c4ad8787b533 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d080fb7bd6049dea53fe1912d46b11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53fd1057c44dffb358b098d5f190fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:50.078440 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-a63bc259-97ce-4661-ae39-c4ad8787b533 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "GET /compute/v2.1/servers/463a3a9d-f121-4ca8-81f7-d8e9be78888d" status: 200 len: 1319 microversion: 2.1 time: 0.237784 Mar 08 14:52:50.080505 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 123/229] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:49 2022] GET /compute/v2.1/servers/463a3a9d-f121-4ca8-81f7-d8e9be78888d => generated 1319 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:50.189592 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-fdf85161-3a66-4a8a-83d5-62a41abadff5 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:50.190274 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-fdf85161-3a66-4a8a-83d5-62a41abadff5 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:50.196525 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fdf85161-3a66-4a8a-83d5-62a41abadff5 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:50.196980 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fdf85161-3a66-4a8a-83d5-62a41abadff5 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:50.197766 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fdf85161-3a66-4a8a-83d5-62a41abadff5 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:50.198297 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fdf85161-3a66-4a8a-83d5-62a41abadff5 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:50.342861 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-fdf85161-3a66-4a8a-83d5-62a41abadff5 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:50.350580 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-fdf85161-3a66-4a8a-83d5-62a41abadff5 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1522 microversion: 2.1 time: 0.166828 Mar 08 14:52:50.351148 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 107/230] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:50 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:51.096832 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-d04c6ef7-d309-447a-acbe-f3670d759654 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:51.097616 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-d04c6ef7-d309-447a-acbe-f3670d759654 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: 463a3a9d-f121-4ca8-81f7-d8e9be78888d] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:51.104428 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d04c6ef7-d309-447a-acbe-f3670d759654 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:51.104911 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d04c6ef7-d309-447a-acbe-f3670d759654 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:51.105724 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d04c6ef7-d309-447a-acbe-f3670d759654 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:51.106199 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d04c6ef7-d309-447a-acbe-f3670d759654 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:51.283415 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-d04c6ef7-d309-447a-acbe-f3670d759654 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d080fb7bd6049dea53fe1912d46b11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53fd1057c44dffb358b098d5f190fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:51.290799 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-d04c6ef7-d309-447a-acbe-f3670d759654 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "GET /compute/v2.1/servers/463a3a9d-f121-4ca8-81f7-d8e9be78888d" status: 200 len: 1319 microversion: 2.1 time: 0.197898 Mar 08 14:52:51.291371 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 124/231] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:51 2022] GET /compute/v2.1/servers/463a3a9d-f121-4ca8-81f7-d8e9be78888d => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:51.368873 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-6321db25-4a43-4913-989c-3d2341379ec1 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:51.369489 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-6321db25-4a43-4913-989c-3d2341379ec1 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:51.380084 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6321db25-4a43-4913-989c-3d2341379ec1 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:51.381793 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6321db25-4a43-4913-989c-3d2341379ec1 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:51.383284 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6321db25-4a43-4913-989c-3d2341379ec1 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:51.384007 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6321db25-4a43-4913-989c-3d2341379ec1 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:51.608021 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-6321db25-4a43-4913-989c-3d2341379ec1 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:51.623862 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-6321db25-4a43-4913-989c-3d2341379ec1 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1522 microversion: 2.1 time: 0.254254 Mar 08 14:52:51.627047 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 108/232] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:51 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:51.738508 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [req-a71b1810-8c93-4090-bc83-501bb581889c req-f98f0977-9e93-4d44-804f-9a020d4ade13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "463a3a9d-f121-4ca8-81f7-d8e9be78888d", "name": "network-vif-plugged", "status": "completed", "tag": "d493f362-caab-4ded-95a0-670d3d821f36"}]} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:52:51.746942 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-a71b1810-8c93-4090-bc83-501bb581889c req-f98f0977-9e93-4d44-804f-9a020d4ade13 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:51.747404 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-a71b1810-8c93-4090-bc83-501bb581889c req-f98f0977-9e93-4d44-804f-9a020d4ade13 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:51.760707 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.compute.server_external_events [req-a71b1810-8c93-4090-bc83-501bb581889c req-f98f0977-9e93-4d44-804f-9a020d4ade13 service nova] Creating event network-vif-plugged:d493f362-caab-4ded-95a0-670d3d821f36 for instance 463a3a9d-f121-4ca8-81f7-d8e9be78888d on hv-cinder-83009 Mar 08 14:52:51.765876 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [req-a71b1810-8c93-4090-bc83-501bb581889c req-f98f0977-9e93-4d44-804f-9a020d4ade13 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031124 Mar 08 14:52:51.767167 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 125/233] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 14:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:52:51.829764 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-8065d843-c5d9-4be0-b855-194c8f4b08a2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:51.830494 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-8065d843-c5d9-4be0-b855-194c8f4b08a2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:51.837317 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8065d843-c5d9-4be0-b855-194c8f4b08a2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:51.837994 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8065d843-c5d9-4be0-b855-194c8f4b08a2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:51.839415 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8065d843-c5d9-4be0-b855-194c8f4b08a2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:51.839863 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8065d843-c5d9-4be0-b855-194c8f4b08a2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:51.874602 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-8065d843-c5d9-4be0-b855-194c8f4b08a2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/ips" status: 200 len: 153 microversion: 2.20 time: 0.049146 Mar 08 14:52:51.875180 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 109/234] 10.222.0.30 () {60 vars in 1288 bytes} [Tue Mar 8 14:52:51 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/ips => generated 153 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:52:52.310758 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-3eb7043e-be52-442a-a07d-bd3db0415a86 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:52.311477 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-3eb7043e-be52-442a-a07d-bd3db0415a86 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: 463a3a9d-f121-4ca8-81f7-d8e9be78888d] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:52.317766 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3eb7043e-be52-442a-a07d-bd3db0415a86 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:52.318256 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3eb7043e-be52-442a-a07d-bd3db0415a86 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:52.319024 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3eb7043e-be52-442a-a07d-bd3db0415a86 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:52.319463 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3eb7043e-be52-442a-a07d-bd3db0415a86 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:52.455293 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-3eb7043e-be52-442a-a07d-bd3db0415a86 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d080fb7bd6049dea53fe1912d46b11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53fd1057c44dffb358b098d5f190fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:52.463284 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-3eb7043e-be52-442a-a07d-bd3db0415a86 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "GET /compute/v2.1/servers/463a3a9d-f121-4ca8-81f7-d8e9be78888d" status: 200 len: 1319 microversion: 2.1 time: 0.157237 Mar 08 14:52:52.463880 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 126/235] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:52 2022] GET /compute/v2.1/servers/463a3a9d-f121-4ca8-81f7-d8e9be78888d => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:52.644439 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ecf271ab-9324-4d3f-a129-b0cb9e9bf7f3 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:52.644968 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ecf271ab-9324-4d3f-a129-b0cb9e9bf7f3 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:52.651495 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ecf271ab-9324-4d3f-a129-b0cb9e9bf7f3 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:52.652466 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ecf271ab-9324-4d3f-a129-b0cb9e9bf7f3 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:52.653537 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ecf271ab-9324-4d3f-a129-b0cb9e9bf7f3 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:52.654282 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ecf271ab-9324-4d3f-a129-b0cb9e9bf7f3 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:52.705550 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-048b961f-f37c-413c-a436-8c0e75e79922 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e68d3edf-20ac-4867-9f6c-854a014458ee"}} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:52:52.706672 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-048b961f-f37c-413c-a436-8c0e75e79922 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:52.716120 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-048b961f-f37c-413c-a436-8c0e75e79922 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:52.716841 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-048b961f-f37c-413c-a436-8c0e75e79922 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:52.717882 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-048b961f-f37c-413c-a436-8c0e75e79922 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:52.718553 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-048b961f-f37c-413c-a436-8c0e75e79922 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:52.814466 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ecf271ab-9324-4d3f-a129-b0cb9e9bf7f3 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:52.823741 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ecf271ab-9324-4d3f-a129-b0cb9e9bf7f3 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1522 microversion: 2.1 time: 0.184309 Mar 08 14:52:52.824307 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 110/236] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:52 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:53.017942 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-048b961f-f37c-413c-a436-8c0e75e79922 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "POST /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.317485 Mar 08 14:52:53.018819 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 127/237] 10.222.0.30 () {60 vars in 1322 bytes} [Tue Mar 8 14:52:52 2022] POST /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e/os-volume_attachments => generated 194 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:52:53.481531 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3de3f219-cc5d-49c9-b0aa-baf352b44a65 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:53.482626 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-3de3f219-cc5d-49c9-b0aa-baf352b44a65 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: 463a3a9d-f121-4ca8-81f7-d8e9be78888d] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:53.490457 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3de3f219-cc5d-49c9-b0aa-baf352b44a65 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:53.491142 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3de3f219-cc5d-49c9-b0aa-baf352b44a65 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:53.492173 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3de3f219-cc5d-49c9-b0aa-baf352b44a65 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:53.492632 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3de3f219-cc5d-49c9-b0aa-baf352b44a65 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:53.638143 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-3de3f219-cc5d-49c9-b0aa-baf352b44a65 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d080fb7bd6049dea53fe1912d46b11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53fd1057c44dffb358b098d5f190fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:53.646667 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-3de3f219-cc5d-49c9-b0aa-baf352b44a65 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "GET /compute/v2.1/servers/463a3a9d-f121-4ca8-81f7-d8e9be78888d" status: 200 len: 1319 microversion: 2.1 time: 0.169397 Mar 08 14:52:53.647365 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 111/238] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:53 2022] GET /compute/v2.1/servers/463a3a9d-f121-4ca8-81f7-d8e9be78888d => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:53.842596 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-99c1ad8c-76a5-4d2e-a857-a18693ba461a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:53.843316 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-99c1ad8c-76a5-4d2e-a857-a18693ba461a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:53.852518 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-99c1ad8c-76a5-4d2e-a857-a18693ba461a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:53.853436 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-99c1ad8c-76a5-4d2e-a857-a18693ba461a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:53.854285 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-99c1ad8c-76a5-4d2e-a857-a18693ba461a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:53.855083 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-99c1ad8c-76a5-4d2e-a857-a18693ba461a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:54.010441 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-99c1ad8c-76a5-4d2e-a857-a18693ba461a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:54.019955 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-99c1ad8c-76a5-4d2e-a857-a18693ba461a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1522 microversion: 2.1 time: 0.182900 Mar 08 14:52:54.020567 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 128/239] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:53 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:54.664066 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-60bd7df5-5c47-4c9e-ba8e-13e6d485dbf0 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:54.664737 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-60bd7df5-5c47-4c9e-ba8e-13e6d485dbf0 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: 463a3a9d-f121-4ca8-81f7-d8e9be78888d] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:54.671860 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-60bd7df5-5c47-4c9e-ba8e-13e6d485dbf0 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:54.673073 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-60bd7df5-5c47-4c9e-ba8e-13e6d485dbf0 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:54.674005 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-60bd7df5-5c47-4c9e-ba8e-13e6d485dbf0 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:54.674557 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-60bd7df5-5c47-4c9e-ba8e-13e6d485dbf0 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:54.818033 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-60bd7df5-5c47-4c9e-ba8e-13e6d485dbf0 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d080fb7bd6049dea53fe1912d46b11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53fd1057c44dffb358b098d5f190fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:54.827858 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-60bd7df5-5c47-4c9e-ba8e-13e6d485dbf0 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "GET /compute/v2.1/servers/463a3a9d-f121-4ca8-81f7-d8e9be78888d" status: 200 len: 1508 microversion: 2.1 time: 0.167943 Mar 08 14:52:54.829754 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 112/240] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:54 2022] GET /compute/v2.1/servers/463a3a9d-f121-4ca8-81f7-d8e9be78888d => generated 1508 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:55.038210 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-70c90caa-b740-4fdc-832b-a8b36108ce3a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:55.038881 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-70c90caa-b740-4fdc-832b-a8b36108ce3a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:55.046576 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-70c90caa-b740-4fdc-832b-a8b36108ce3a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:55.047035 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-70c90caa-b740-4fdc-832b-a8b36108ce3a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:55.048583 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-70c90caa-b740-4fdc-832b-a8b36108ce3a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:55.049037 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-70c90caa-b740-4fdc-832b-a8b36108ce3a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:55.086264 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b23d38cb-ed3c-4057-92eb-11b7b041f252 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:52:55.086895 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b23d38cb-ed3c-4057-92eb-11b7b041f252 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:55.102462 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b23d38cb-ed3c-4057-92eb-11b7b041f252 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:55.102918 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b23d38cb-ed3c-4057-92eb-11b7b041f252 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:55.103703 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b23d38cb-ed3c-4057-92eb-11b7b041f252 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:55.104143 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b23d38cb-ed3c-4057-92eb-11b7b041f252 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:55.127872 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.objects.instance [None req-b23d38cb-ed3c-4057-92eb-11b7b041f252 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lazy-loading 'flavor' on Instance uuid 1b7917ad-8941-400f-ae66-d22e26633416 {{(pid=128352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 14:52:55.222639 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-70c90caa-b740-4fdc-832b-a8b36108ce3a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:55.231832 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-70c90caa-b740-4fdc-832b-a8b36108ce3a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1522 microversion: 2.1 time: 0.197905 Mar 08 14:52:55.233932 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 129/241] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:55 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:56.254590 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-70c8c69b-6c33-406d-8a54-da728618077c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:56.256266 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-70c8c69b-6c33-406d-8a54-da728618077c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:56.266358 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-70c8c69b-6c33-406d-8a54-da728618077c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:56.267184 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-70c8c69b-6c33-406d-8a54-da728618077c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:56.268213 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-70c8c69b-6c33-406d-8a54-da728618077c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:56.269041 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-70c8c69b-6c33-406d-8a54-da728618077c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:56.436631 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-70c8c69b-6c33-406d-8a54-da728618077c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:56.444981 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-70c8c69b-6c33-406d-8a54-da728618077c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1522 microversion: 2.1 time: 0.197856 Mar 08 14:52:56.455787 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 130/242] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:56 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:52:56.463282 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b23d38cb-ed3c-4057-92eb-11b7b041f252 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "POST /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/action" status: 202 len: 0 microversion: 2.20 time: 1.380705 Mar 08 14:52:56.467709 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 113/243] 10.222.0.30 () {62 vars in 1318 bytes} [Tue Mar 8 14:52:55 2022] POST /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/action => generated 0 bytes in 1383 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Mar 08 14:52:56.477009 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b50de126-29c6-458b-a824-29f94edee5c4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:56.478222 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-b50de126-29c6-458b-a824-29f94edee5c4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:56.489646 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b50de126-29c6-458b-a824-29f94edee5c4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:56.490568 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b50de126-29c6-458b-a824-29f94edee5c4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:56.491652 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b50de126-29c6-458b-a824-29f94edee5c4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:56.492526 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b50de126-29c6-458b-a824-29f94edee5c4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:56.676750 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-b50de126-29c6-458b-a824-29f94edee5c4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:56.685290 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-b50de126-29c6-458b-a824-29f94edee5c4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:56.687088 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-b50de126-29c6-458b-a824-29f94edee5c4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:56.688291 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-b50de126-29c6-458b-a824-29f94edee5c4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1725 microversion: 2.20 time: 0.217823 Mar 08 14:52:56.689145 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 131/244] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:52:56 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1725 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:52:57.469568 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-daa577a7-db35-4335-90d7-02cd3fbcfe57 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:57.475032 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-daa577a7-db35-4335-90d7-02cd3fbcfe57 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:57.481986 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-daa577a7-db35-4335-90d7-02cd3fbcfe57 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:57.482452 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-daa577a7-db35-4335-90d7-02cd3fbcfe57 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:57.483519 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-daa577a7-db35-4335-90d7-02cd3fbcfe57 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:57.484063 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-daa577a7-db35-4335-90d7-02cd3fbcfe57 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:57.674352 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-daa577a7-db35-4335-90d7-02cd3fbcfe57 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:57.681673 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-daa577a7-db35-4335-90d7-02cd3fbcfe57 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1522 microversion: 2.1 time: 0.220192 Mar 08 14:52:57.682339 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 114/245] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:57 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:52:57.707380 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-3e79c566-97bc-4781-8486-f5e52c6694ec tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:57.708015 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-3e79c566-97bc-4781-8486-f5e52c6694ec tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:57.714205 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3e79c566-97bc-4781-8486-f5e52c6694ec tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:57.714659 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3e79c566-97bc-4781-8486-f5e52c6694ec tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:57.715425 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3e79c566-97bc-4781-8486-f5e52c6694ec tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:57.715864 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3e79c566-97bc-4781-8486-f5e52c6694ec tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:57.850408 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-3e79c566-97bc-4781-8486-f5e52c6694ec tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:57.858108 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-3e79c566-97bc-4781-8486-f5e52c6694ec tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:57.859713 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-3e79c566-97bc-4781-8486-f5e52c6694ec tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:57.861295 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-3e79c566-97bc-4781-8486-f5e52c6694ec tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1725 microversion: 2.20 time: 0.158228 Mar 08 14:52:57.861914 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 132/246] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:52:57 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:52:58.700618 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c9d7e4b1-06d5-446a-99f1-d371c3e485c5 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:58.702109 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-c9d7e4b1-06d5-446a-99f1-d371c3e485c5 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:58.710091 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c9d7e4b1-06d5-446a-99f1-d371c3e485c5 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:58.710945 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c9d7e4b1-06d5-446a-99f1-d371c3e485c5 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:58.711845 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c9d7e4b1-06d5-446a-99f1-d371c3e485c5 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:58.712348 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c9d7e4b1-06d5-446a-99f1-d371c3e485c5 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:58.880711 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-1dde5ade-a63d-4fa5-9b6b-cf2ddd862905 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:58.882192 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-1dde5ade-a63d-4fa5-9b6b-cf2ddd862905 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:58.888785 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-c9d7e4b1-06d5-446a-99f1-d371c3e485c5 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:58.892220 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1dde5ade-a63d-4fa5-9b6b-cf2ddd862905 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:58.892685 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1dde5ade-a63d-4fa5-9b6b-cf2ddd862905 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:58.893507 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1dde5ade-a63d-4fa5-9b6b-cf2ddd862905 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:58.894005 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1dde5ade-a63d-4fa5-9b6b-cf2ddd862905 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:58.898553 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-c9d7e4b1-06d5-446a-99f1-d371c3e485c5 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1522 microversion: 2.1 time: 0.201766 Mar 08 14:52:58.899683 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 115/247] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:58 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:52:59.080807 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-1dde5ade-a63d-4fa5-9b6b-cf2ddd862905 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:59.094095 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-1dde5ade-a63d-4fa5-9b6b-cf2ddd862905 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:59.096455 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-1dde5ade-a63d-4fa5-9b6b-cf2ddd862905 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:52:59.100909 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-1dde5ade-a63d-4fa5-9b6b-cf2ddd862905 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1725 microversion: 2.20 time: 0.221630 Mar 08 14:52:59.102326 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 133/248] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:52:58 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1725 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 14:52:59.919229 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-7e37f415-dbf0-48d1-903e-32d2b8857d44 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:52:59.920481 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-7e37f415-dbf0-48d1-903e-32d2b8857d44 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:52:59.927149 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7e37f415-dbf0-48d1-903e-32d2b8857d44 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:59.927809 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7e37f415-dbf0-48d1-903e-32d2b8857d44 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:52:59.928581 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7e37f415-dbf0-48d1-903e-32d2b8857d44 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:52:59.929014 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7e37f415-dbf0-48d1-903e-32d2b8857d44 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:00.103200 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-7e37f415-dbf0-48d1-903e-32d2b8857d44 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:00.111398 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-7e37f415-dbf0-48d1-903e-32d2b8857d44 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1502 microversion: 2.1 time: 0.195997 Mar 08 14:53:00.128158 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-01740a73-5416-4606-833e-425facfa7615 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:00.128158 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-01740a73-5416-4606-833e-425facfa7615 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:00.129388 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 116/249] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:52:59 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1502 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:00.131592 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-01740a73-5416-4606-833e-425facfa7615 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:00.132057 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-01740a73-5416-4606-833e-425facfa7615 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:00.134424 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-01740a73-5416-4606-833e-425facfa7615 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:00.135110 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-01740a73-5416-4606-833e-425facfa7615 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:00.135464 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3d9256bb-90f8-4c94-99dc-3ba25833915a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52d9b9f9-9817-4e21-8814-0838c38696bd"}} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:53:00.136772 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-3d9256bb-90f8-4c94-99dc-3ba25833915a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:00.143641 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3d9256bb-90f8-4c94-99dc-3ba25833915a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:00.144381 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3d9256bb-90f8-4c94-99dc-3ba25833915a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:00.145389 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3d9256bb-90f8-4c94-99dc-3ba25833915a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:00.146969 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3d9256bb-90f8-4c94-99dc-3ba25833915a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:00.181773 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-3d9256bb-90f8-4c94-99dc-3ba25833915a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] HTTP exception thrown: Cannot 'attach_volume' instance f936e19e-08fe-43d1-8c05-2fc52d3a5a67 while it is in vm_state rescued Mar 08 14:53:00.182599 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3d9256bb-90f8-4c94-99dc-3ba25833915a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Returning 409 to user: Cannot 'attach_volume' instance f936e19e-08fe-43d1-8c05-2fc52d3a5a67 while it is in vm_state rescued {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 14:53:00.183802 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-3d9256bb-90f8-4c94-99dc-3ba25833915a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "POST /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.053119 Mar 08 14:53:00.184532 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 117/250] 10.222.0.30 () {60 vars in 1322 bytes} [Tue Mar 8 14:53:00 2022] POST /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67/os-volume_attachments => generated 152 bytes in 54 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 08 14:53:00.195562 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-6a6cde7d-cedc-476a-9df6-54b5842f5754 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:53:00.196094 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-6a6cde7d-cedc-476a-9df6-54b5842f5754 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:00.202045 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6a6cde7d-cedc-476a-9df6-54b5842f5754 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:00.202494 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6a6cde7d-cedc-476a-9df6-54b5842f5754 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:00.203931 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6a6cde7d-cedc-476a-9df6-54b5842f5754 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:00.204531 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6a6cde7d-cedc-476a-9df6-54b5842f5754 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:00.286946 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-6a6cde7d-cedc-476a-9df6-54b5842f5754 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "POST /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67/action" status: 202 len: 0 microversion: 2.1 time: 0.096682 Mar 08 14:53:00.288152 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 118/251] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Mar 8 14:53:00 2022] POST /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 14:53:00.296126 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-01740a73-5416-4606-833e-425facfa7615 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:00.297228 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b23fa0d9-d640-48c2-9024-98b34db13d05 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:00.297725 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b23fa0d9-d640-48c2-9024-98b34db13d05 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:00.305381 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b23fa0d9-d640-48c2-9024-98b34db13d05 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:00.306026 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b23fa0d9-d640-48c2-9024-98b34db13d05 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:00.306993 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b23fa0d9-d640-48c2-9024-98b34db13d05 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:00.307630 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b23fa0d9-d640-48c2-9024-98b34db13d05 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:00.332280 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-01740a73-5416-4606-833e-425facfa7615 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:00.340301 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-01740a73-5416-4606-833e-425facfa7615 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:00.341843 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-01740a73-5416-4606-833e-425facfa7615 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1725 microversion: 2.20 time: 0.225673 Mar 08 14:53:00.342641 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 134/252] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:53:00 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1725 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 14:53:00.490120 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-ad7b845e-d386-4110-bc90-481bd21f5dcc tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:53:00.496719 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ad7b845e-d386-4110-bc90-481bd21f5dcc tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:00.497169 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ad7b845e-d386-4110-bc90-481bd21f5dcc tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:00.559646 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-ad7b845e-d386-4110-bc90-481bd21f5dcc tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Going to try to stop instance {{(pid=128351) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Mar 08 14:53:00.614404 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-ad7b845e-d386-4110-bc90-481bd21f5dcc tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "POST /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e/action" status: 202 len: 0 microversion: 2.1 time: 0.131710 Mar 08 14:53:00.629723 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 135/253] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Mar 8 14:53:00 2022] POST /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 14:53:00.639388 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b23fa0d9-d640-48c2-9024-98b34db13d05 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:00.639794 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-52d6eb8d-c381-4e5f-a8ef-0fcd7f926694 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:00.641195 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-52d6eb8d-c381-4e5f-a8ef-0fcd7f926694 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:00.647756 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b23fa0d9-d640-48c2-9024-98b34db13d05 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1510 microversion: 2.1 time: 0.355644 Mar 08 14:53:00.648959 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-52d6eb8d-c381-4e5f-a8ef-0fcd7f926694 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:00.649589 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-52d6eb8d-c381-4e5f-a8ef-0fcd7f926694 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:00.650321 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 119/254] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:00 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1510 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:00.650808 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-52d6eb8d-c381-4e5f-a8ef-0fcd7f926694 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:00.651461 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-52d6eb8d-c381-4e5f-a8ef-0fcd7f926694 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:00.811687 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-52d6eb8d-c381-4e5f-a8ef-0fcd7f926694 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:00.828042 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-52d6eb8d-c381-4e5f-a8ef-0fcd7f926694 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1723 microversion: 2.1 time: 0.196255 Mar 08 14:53:00.836971 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 136/255] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:00 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:01.361886 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-618d24c3-8225-4e0e-8a65-5ba7b189f579 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:01.363100 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-618d24c3-8225-4e0e-8a65-5ba7b189f579 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:01.372507 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-618d24c3-8225-4e0e-8a65-5ba7b189f579 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:01.372967 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-618d24c3-8225-4e0e-8a65-5ba7b189f579 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:01.373744 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-618d24c3-8225-4e0e-8a65-5ba7b189f579 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:01.374219 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-618d24c3-8225-4e0e-8a65-5ba7b189f579 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:01.670658 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-21b2826a-e838-46b7-b59a-f06af42b5df3 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:01.672395 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-21b2826a-e838-46b7-b59a-f06af42b5df3 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:01.679932 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-21b2826a-e838-46b7-b59a-f06af42b5df3 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:01.680679 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-21b2826a-e838-46b7-b59a-f06af42b5df3 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:01.681639 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-21b2826a-e838-46b7-b59a-f06af42b5df3 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:01.681766 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-618d24c3-8225-4e0e-8a65-5ba7b189f579 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:01.682516 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-21b2826a-e838-46b7-b59a-f06af42b5df3 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:01.690484 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-618d24c3-8225-4e0e-8a65-5ba7b189f579 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:01.701941 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-618d24c3-8225-4e0e-8a65-5ba7b189f579 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:01.705260 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-618d24c3-8225-4e0e-8a65-5ba7b189f579 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1725 microversion: 2.20 time: 0.349057 Mar 08 14:53:01.706433 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 120/256] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:53:01 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1725 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:53:01.846936 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-079db909-9011-4236-9351-9b03f10a7a2e tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:01.847970 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-079db909-9011-4236-9351-9b03f10a7a2e tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:01.855640 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-079db909-9011-4236-9351-9b03f10a7a2e tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:01.856326 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-079db909-9011-4236-9351-9b03f10a7a2e tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:01.857261 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-079db909-9011-4236-9351-9b03f10a7a2e tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:01.857866 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-079db909-9011-4236-9351-9b03f10a7a2e tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:01.875786 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-21b2826a-e838-46b7-b59a-f06af42b5df3 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:01.885128 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-21b2826a-e838-46b7-b59a-f06af42b5df3 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1510 microversion: 2.1 time: 0.220133 Mar 08 14:53:01.886056 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 137/257] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:01 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1510 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:02.083477 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-079db909-9011-4236-9351-9b03f10a7a2e tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:02.091154 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-079db909-9011-4236-9351-9b03f10a7a2e tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1723 microversion: 2.1 time: 0.248751 Mar 08 14:53:02.091707 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 121/258] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:01 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1723 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:53:02.724962 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-f450961f-c4a2-4d1d-8c86-fe36b9155cdc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:02.726111 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-f450961f-c4a2-4d1d-8c86-fe36b9155cdc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:02.732602 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f450961f-c4a2-4d1d-8c86-fe36b9155cdc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:02.733656 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f450961f-c4a2-4d1d-8c86-fe36b9155cdc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:02.734705 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f450961f-c4a2-4d1d-8c86-fe36b9155cdc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:02.735314 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f450961f-c4a2-4d1d-8c86-fe36b9155cdc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:02.903836 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-1f8b395d-cf3a-4b9e-981f-df4b0d9a3489 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:02.904603 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-1f8b395d-cf3a-4b9e-981f-df4b0d9a3489 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:02.918738 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1f8b395d-cf3a-4b9e-981f-df4b0d9a3489 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:02.921744 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1f8b395d-cf3a-4b9e-981f-df4b0d9a3489 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:02.927952 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1f8b395d-cf3a-4b9e-981f-df4b0d9a3489 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:02.930189 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1f8b395d-cf3a-4b9e-981f-df4b0d9a3489 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:02.935710 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-f450961f-c4a2-4d1d-8c86-fe36b9155cdc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:02.947530 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-f450961f-c4a2-4d1d-8c86-fe36b9155cdc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:02.949426 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-f450961f-c4a2-4d1d-8c86-fe36b9155cdc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:02.951242 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-f450961f-c4a2-4d1d-8c86-fe36b9155cdc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1725 microversion: 2.20 time: 0.230481 Mar 08 14:53:02.952286 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 138/259] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:53:02 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1725 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:53:03.107982 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-1f8b395d-cf3a-4b9e-981f-df4b0d9a3489 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:03.109261 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-1bbc3c71-b57c-47f7-8a8c-9d25ffa87a83 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:03.111565 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-1bbc3c71-b57c-47f7-8a8c-9d25ffa87a83 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:03.116595 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-1f8b395d-cf3a-4b9e-981f-df4b0d9a3489 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1510 microversion: 2.1 time: 0.217207 Mar 08 14:53:03.117740 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 122/260] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:02 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1510 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:03.127903 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1bbc3c71-b57c-47f7-8a8c-9d25ffa87a83 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:03.128584 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1bbc3c71-b57c-47f7-8a8c-9d25ffa87a83 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:03.129559 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1bbc3c71-b57c-47f7-8a8c-9d25ffa87a83 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:03.130189 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1bbc3c71-b57c-47f7-8a8c-9d25ffa87a83 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:03.277513 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-1bbc3c71-b57c-47f7-8a8c-9d25ffa87a83 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:03.287157 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-1bbc3c71-b57c-47f7-8a8c-9d25ffa87a83 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1723 microversion: 2.1 time: 0.182314 Mar 08 14:53:03.289161 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 139/261] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:03 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:03.972737 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-e0c4017f-6723-40d7-b9d9-79587f204e0b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:03.973616 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-e0c4017f-6723-40d7-b9d9-79587f204e0b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:03.980650 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e0c4017f-6723-40d7-b9d9-79587f204e0b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:03.981392 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e0c4017f-6723-40d7-b9d9-79587f204e0b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:03.982770 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e0c4017f-6723-40d7-b9d9-79587f204e0b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:03.983233 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e0c4017f-6723-40d7-b9d9-79587f204e0b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:04.134073 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-d54e68ed-29bd-4e44-a622-5a197996621d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:04.137702 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-d54e68ed-29bd-4e44-a622-5a197996621d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:04.145764 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d54e68ed-29bd-4e44-a622-5a197996621d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:04.146962 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d54e68ed-29bd-4e44-a622-5a197996621d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:04.147918 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d54e68ed-29bd-4e44-a622-5a197996621d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:04.148674 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d54e68ed-29bd-4e44-a622-5a197996621d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:04.185124 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-e0c4017f-6723-40d7-b9d9-79587f204e0b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:04.204213 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-e0c4017f-6723-40d7-b9d9-79587f204e0b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:04.206958 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-e0c4017f-6723-40d7-b9d9-79587f204e0b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:04.209167 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-e0c4017f-6723-40d7-b9d9-79587f204e0b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1725 microversion: 2.20 time: 0.241486 Mar 08 14:53:04.210774 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 123/262] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:53:03 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1725 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:53:04.306395 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-20e338e8-a506-4069-9beb-518c01853472 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:04.307071 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-20e338e8-a506-4069-9beb-518c01853472 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:04.308711 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-d54e68ed-29bd-4e44-a622-5a197996621d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:04.319482 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-20e338e8-a506-4069-9beb-518c01853472 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:04.319937 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-20e338e8-a506-4069-9beb-518c01853472 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:04.320228 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-d54e68ed-29bd-4e44-a622-5a197996621d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1516 microversion: 2.1 time: 0.187835 Mar 08 14:53:04.321298 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 140/263] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:04 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1516 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:53:04.324882 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-20e338e8-a506-4069-9beb-518c01853472 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:04.325423 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-20e338e8-a506-4069-9beb-518c01853472 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:04.541841 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-20e338e8-a506-4069-9beb-518c01853472 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:04.552183 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-20e338e8-a506-4069-9beb-518c01853472 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1723 microversion: 2.1 time: 0.251409 Mar 08 14:53:04.553401 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 124/264] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:04 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1723 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:05.227983 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-2d080a31-1079-42d4-b8fe-8b440c5abbf2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:05.228569 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-2d080a31-1079-42d4-b8fe-8b440c5abbf2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:05.237298 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2d080a31-1079-42d4-b8fe-8b440c5abbf2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:05.237755 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2d080a31-1079-42d4-b8fe-8b440c5abbf2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:05.238753 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2d080a31-1079-42d4-b8fe-8b440c5abbf2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:05.239981 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2d080a31-1079-42d4-b8fe-8b440c5abbf2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:05.427275 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-2d080a31-1079-42d4-b8fe-8b440c5abbf2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:05.441404 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-2d080a31-1079-42d4-b8fe-8b440c5abbf2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:05.443325 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-2d080a31-1079-42d4-b8fe-8b440c5abbf2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:05.444508 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-2d080a31-1079-42d4-b8fe-8b440c5abbf2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1725 microversion: 2.20 time: 0.220401 Mar 08 14:53:05.445247 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 141/265] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:53:05 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1725 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:53:05.569968 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-62467f3e-0cea-40c3-a1b9-7397cd1be212 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:05.570752 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-62467f3e-0cea-40c3-a1b9-7397cd1be212 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:05.584165 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-62467f3e-0cea-40c3-a1b9-7397cd1be212 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:05.584887 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-62467f3e-0cea-40c3-a1b9-7397cd1be212 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:05.585885 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-62467f3e-0cea-40c3-a1b9-7397cd1be212 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:05.586514 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-62467f3e-0cea-40c3-a1b9-7397cd1be212 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:05.803029 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-62467f3e-0cea-40c3-a1b9-7397cd1be212 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:05.821984 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-62467f3e-0cea-40c3-a1b9-7397cd1be212 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1723 microversion: 2.1 time: 0.255975 Mar 08 14:53:05.822797 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 125/266] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:05 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1723 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:05.839682 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-50f7c849-f2fe-4481-b1a7-8a1f08392478 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:05.840815 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-50f7c849-f2fe-4481-b1a7-8a1f08392478 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:05.848185 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-50f7c849-f2fe-4481-b1a7-8a1f08392478 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:05.848981 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-50f7c849-f2fe-4481-b1a7-8a1f08392478 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:05.851034 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-50f7c849-f2fe-4481-b1a7-8a1f08392478 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:05.851548 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-50f7c849-f2fe-4481-b1a7-8a1f08392478 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:06.027134 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-50f7c849-f2fe-4481-b1a7-8a1f08392478 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:06.035892 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-50f7c849-f2fe-4481-b1a7-8a1f08392478 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1516 microversion: 2.1 time: 0.200531 Mar 08 14:53:06.037071 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 142/267] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:05 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1516 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:06.053131 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3d27d8bd-b31f-4c75-829f-971839400ebe tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "961f8f94-37fd-49e6-aaf7-07f3de39cc3f"}} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:53:06.054535 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-3d27d8bd-b31f-4c75-829f-971839400ebe tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:06.060598 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3d27d8bd-b31f-4c75-829f-971839400ebe tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:06.061325 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3d27d8bd-b31f-4c75-829f-971839400ebe tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:06.063436 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3d27d8bd-b31f-4c75-829f-971839400ebe tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:06.064099 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3d27d8bd-b31f-4c75-829f-971839400ebe tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:06.466638 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-9b6cc9aa-7502-4db8-99b4-5b63e2a05d88 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:06.469502 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-9b6cc9aa-7502-4db8-99b4-5b63e2a05d88 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:06.490377 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9b6cc9aa-7502-4db8-99b4-5b63e2a05d88 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:06.491045 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9b6cc9aa-7502-4db8-99b4-5b63e2a05d88 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:06.491839 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9b6cc9aa-7502-4db8-99b4-5b63e2a05d88 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:06.492278 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9b6cc9aa-7502-4db8-99b4-5b63e2a05d88 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:06.527408 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-3d27d8bd-b31f-4c75-829f-971839400ebe tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "POST /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.475124 Mar 08 14:53:06.529218 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 126/268] 10.222.0.30 () {60 vars in 1322 bytes} [Tue Mar 8 14:53:06 2022] POST /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67/os-volume_attachments => generated 194 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:53:06.684308 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-9b6cc9aa-7502-4db8-99b4-5b63e2a05d88 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:06.694206 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-9b6cc9aa-7502-4db8-99b4-5b63e2a05d88 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:06.695918 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-9b6cc9aa-7502-4db8-99b4-5b63e2a05d88 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:06.697072 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-9b6cc9aa-7502-4db8-99b4-5b63e2a05d88 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1725 microversion: 2.20 time: 0.235846 Mar 08 14:53:06.697650 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 143/269] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:53:06 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1725 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 14:53:06.846299 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c4a8b009-4f7b-4a88-9984-57163f72764f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:06.847135 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-c4a8b009-4f7b-4a88-9984-57163f72764f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:06.853528 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c4a8b009-4f7b-4a88-9984-57163f72764f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:06.854023 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c4a8b009-4f7b-4a88-9984-57163f72764f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:06.854822 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c4a8b009-4f7b-4a88-9984-57163f72764f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:06.855292 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c4a8b009-4f7b-4a88-9984-57163f72764f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:07.025358 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-c4a8b009-4f7b-4a88-9984-57163f72764f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:07.035380 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-c4a8b009-4f7b-4a88-9984-57163f72764f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1723 microversion: 2.1 time: 0.194888 Mar 08 14:53:07.036195 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 127/270] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:06 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:07.718363 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b47cdbd7-17b7-48a0-876f-96c7daaf0b42 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:07.719981 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-b47cdbd7-17b7-48a0-876f-96c7daaf0b42 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:07.730487 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b47cdbd7-17b7-48a0-876f-96c7daaf0b42 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:07.731213 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b47cdbd7-17b7-48a0-876f-96c7daaf0b42 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:07.732215 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b47cdbd7-17b7-48a0-876f-96c7daaf0b42 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:07.733019 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b47cdbd7-17b7-48a0-876f-96c7daaf0b42 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:07.893565 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-b47cdbd7-17b7-48a0-876f-96c7daaf0b42 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:07.902798 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-b47cdbd7-17b7-48a0-876f-96c7daaf0b42 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:07.904607 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-b47cdbd7-17b7-48a0-876f-96c7daaf0b42 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:07.907137 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-b47cdbd7-17b7-48a0-876f-96c7daaf0b42 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1725 microversion: 2.20 time: 0.191505 Mar 08 14:53:07.907469 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 144/271] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:53:07 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1725 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:53:08.055079 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-6cfded1a-3a9a-4d5e-881d-7eb6a5ebef6c tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:08.055699 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-6cfded1a-3a9a-4d5e-881d-7eb6a5ebef6c tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:08.062409 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6cfded1a-3a9a-4d5e-881d-7eb6a5ebef6c tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:08.063283 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6cfded1a-3a9a-4d5e-881d-7eb6a5ebef6c tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:08.064119 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6cfded1a-3a9a-4d5e-881d-7eb6a5ebef6c tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:08.064531 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6cfded1a-3a9a-4d5e-881d-7eb6a5ebef6c tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:08.216641 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-6cfded1a-3a9a-4d5e-881d-7eb6a5ebef6c tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:08.225461 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-6cfded1a-3a9a-4d5e-881d-7eb6a5ebef6c tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1723 microversion: 2.1 time: 0.176110 Mar 08 14:53:08.234932 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 128/272] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:08 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:08.925727 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-d99bdc03-9948-4066-a922-baac6e23fb16 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:08.926952 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-d99bdc03-9948-4066-a922-baac6e23fb16 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:08.933725 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d99bdc03-9948-4066-a922-baac6e23fb16 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:08.934985 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d99bdc03-9948-4066-a922-baac6e23fb16 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:08.936062 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d99bdc03-9948-4066-a922-baac6e23fb16 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:08.936828 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d99bdc03-9948-4066-a922-baac6e23fb16 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:09.098258 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-d99bdc03-9948-4066-a922-baac6e23fb16 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:09.106775 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-d99bdc03-9948-4066-a922-baac6e23fb16 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:09.108494 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-d99bdc03-9948-4066-a922-baac6e23fb16 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:09.109814 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-d99bdc03-9948-4066-a922-baac6e23fb16 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1725 microversion: 2.20 time: 0.188993 Mar 08 14:53:09.110508 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 145/273] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:53:08 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1725 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:53:09.242266 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-20d57414-e3f9-4cdd-9bf2-2785d2f6120f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:09.242868 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-20d57414-e3f9-4cdd-9bf2-2785d2f6120f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:09.249442 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-20d57414-e3f9-4cdd-9bf2-2785d2f6120f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:09.250550 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-20d57414-e3f9-4cdd-9bf2-2785d2f6120f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:09.251347 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-20d57414-e3f9-4cdd-9bf2-2785d2f6120f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:09.251841 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-20d57414-e3f9-4cdd-9bf2-2785d2f6120f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:09.401043 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-20d57414-e3f9-4cdd-9bf2-2785d2f6120f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:09.408999 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-20d57414-e3f9-4cdd-9bf2-2785d2f6120f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1723 microversion: 2.1 time: 0.170514 Mar 08 14:53:09.409654 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 129/274] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:09 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:10.129604 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-667917d2-dfd3-4d8e-94e6-4e407d0ab365 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:10.130205 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-667917d2-dfd3-4d8e-94e6-4e407d0ab365 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:10.136322 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-667917d2-dfd3-4d8e-94e6-4e407d0ab365 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:10.136754 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-667917d2-dfd3-4d8e-94e6-4e407d0ab365 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:10.137794 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-667917d2-dfd3-4d8e-94e6-4e407d0ab365 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:10.138263 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-667917d2-dfd3-4d8e-94e6-4e407d0ab365 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:10.285007 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-667917d2-dfd3-4d8e-94e6-4e407d0ab365 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:10.293036 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-667917d2-dfd3-4d8e-94e6-4e407d0ab365 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:10.294955 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-667917d2-dfd3-4d8e-94e6-4e407d0ab365 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:10.296259 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-667917d2-dfd3-4d8e-94e6-4e407d0ab365 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1725 microversion: 2.20 time: 0.171746 Mar 08 14:53:10.297053 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 146/275] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:53:10 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:53:10.425887 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-76f1f546-1ffc-43b2-ac51-f8c7366a5fd1 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:10.426595 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-76f1f546-1ffc-43b2-ac51-f8c7366a5fd1 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:10.435047 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-76f1f546-1ffc-43b2-ac51-f8c7366a5fd1 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:10.435620 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-76f1f546-1ffc-43b2-ac51-f8c7366a5fd1 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:10.436802 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-76f1f546-1ffc-43b2-ac51-f8c7366a5fd1 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:10.437380 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-76f1f546-1ffc-43b2-ac51-f8c7366a5fd1 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:10.597573 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-76f1f546-1ffc-43b2-ac51-f8c7366a5fd1 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:10.605784 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-76f1f546-1ffc-43b2-ac51-f8c7366a5fd1 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1723 microversion: 2.1 time: 0.184448 Mar 08 14:53:10.615530 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 130/276] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:10 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:11.317517 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b31da5d9-faeb-4f8e-bc27-788bc54bff21 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:11.318854 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-b31da5d9-faeb-4f8e-bc27-788bc54bff21 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:11.326273 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b31da5d9-faeb-4f8e-bc27-788bc54bff21 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:11.326822 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b31da5d9-faeb-4f8e-bc27-788bc54bff21 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:11.327944 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b31da5d9-faeb-4f8e-bc27-788bc54bff21 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:11.328334 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b31da5d9-faeb-4f8e-bc27-788bc54bff21 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:11.489041 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-b31da5d9-faeb-4f8e-bc27-788bc54bff21 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:11.497502 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-b31da5d9-faeb-4f8e-bc27-788bc54bff21 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:11.499058 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-b31da5d9-faeb-4f8e-bc27-788bc54bff21 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:11.500959 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-b31da5d9-faeb-4f8e-bc27-788bc54bff21 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1725 microversion: 2.20 time: 0.188763 Mar 08 14:53:11.501516 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 147/277] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:53:11 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1725 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:53:11.623157 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-515790cf-cb17-4685-b5f3-17bcd628c660 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:11.623788 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-515790cf-cb17-4685-b5f3-17bcd628c660 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:11.631506 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-515790cf-cb17-4685-b5f3-17bcd628c660 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:11.631975 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-515790cf-cb17-4685-b5f3-17bcd628c660 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:11.632806 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-515790cf-cb17-4685-b5f3-17bcd628c660 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:11.633506 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-515790cf-cb17-4685-b5f3-17bcd628c660 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:11.783730 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-515790cf-cb17-4685-b5f3-17bcd628c660 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:11.806943 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-515790cf-cb17-4685-b5f3-17bcd628c660 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1723 microversion: 2.1 time: 0.186810 Mar 08 14:53:11.820095 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 131/278] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:11 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:12.518904 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-e71786c1-fda9-4a56-a1df-b95779a70f0a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:12.520154 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-e71786c1-fda9-4a56-a1df-b95779a70f0a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:12.527007 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e71786c1-fda9-4a56-a1df-b95779a70f0a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:12.527736 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e71786c1-fda9-4a56-a1df-b95779a70f0a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:12.528528 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e71786c1-fda9-4a56-a1df-b95779a70f0a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:12.528966 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e71786c1-fda9-4a56-a1df-b95779a70f0a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:12.677147 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-e71786c1-fda9-4a56-a1df-b95779a70f0a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:12.685700 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-e71786c1-fda9-4a56-a1df-b95779a70f0a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:12.688266 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-e71786c1-fda9-4a56-a1df-b95779a70f0a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:12.689494 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-e71786c1-fda9-4a56-a1df-b95779a70f0a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1725 microversion: 2.20 time: 0.174460 Mar 08 14:53:12.690448 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 148/279] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:53:12 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:53:12.831139 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-a40719d2-ce2c-4287-90fc-b7a92f1545c5 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:12.831726 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-a40719d2-ce2c-4287-90fc-b7a92f1545c5 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:12.838283 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a40719d2-ce2c-4287-90fc-b7a92f1545c5 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:12.838734 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a40719d2-ce2c-4287-90fc-b7a92f1545c5 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:12.839917 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a40719d2-ce2c-4287-90fc-b7a92f1545c5 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:12.840352 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a40719d2-ce2c-4287-90fc-b7a92f1545c5 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:12.996589 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-a40719d2-ce2c-4287-90fc-b7a92f1545c5 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:13.006435 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-a40719d2-ce2c-4287-90fc-b7a92f1545c5 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1723 microversion: 2.1 time: 0.179551 Mar 08 14:53:13.016581 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 132/280] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:12 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:13.707864 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-c86f22bc-3ab4-4cb5-99e5-611a9bf619c7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:13.708493 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-c86f22bc-3ab4-4cb5-99e5-611a9bf619c7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:13.714754 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c86f22bc-3ab4-4cb5-99e5-611a9bf619c7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:13.715202 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c86f22bc-3ab4-4cb5-99e5-611a9bf619c7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:13.715952 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c86f22bc-3ab4-4cb5-99e5-611a9bf619c7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:13.716385 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c86f22bc-3ab4-4cb5-99e5-611a9bf619c7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:13.848162 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-c86f22bc-3ab4-4cb5-99e5-611a9bf619c7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:13.855785 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-c86f22bc-3ab4-4cb5-99e5-611a9bf619c7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:13.857272 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-c86f22bc-3ab4-4cb5-99e5-611a9bf619c7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:13.858445 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-c86f22bc-3ab4-4cb5-99e5-611a9bf619c7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1725 microversion: 2.20 time: 0.154530 Mar 08 14:53:13.859605 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 149/281] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:53:13 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:53:14.024039 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-58de020d-5b6a-47e6-a8fd-132301cf3660 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:14.024649 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-58de020d-5b6a-47e6-a8fd-132301cf3660 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:14.031553 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-58de020d-5b6a-47e6-a8fd-132301cf3660 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:14.032086 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-58de020d-5b6a-47e6-a8fd-132301cf3660 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:14.032781 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-58de020d-5b6a-47e6-a8fd-132301cf3660 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:14.033214 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-58de020d-5b6a-47e6-a8fd-132301cf3660 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:14.170257 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-58de020d-5b6a-47e6-a8fd-132301cf3660 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:14.178172 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-58de020d-5b6a-47e6-a8fd-132301cf3660 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1723 microversion: 2.1 time: 0.157937 Mar 08 14:53:14.178737 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 133/282] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:14 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:14.876927 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-5ae734aa-24ad-4f58-bec9-7ed1aed5d380 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:14.877534 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-5ae734aa-24ad-4f58-bec9-7ed1aed5d380 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:14.883764 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5ae734aa-24ad-4f58-bec9-7ed1aed5d380 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:14.884218 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5ae734aa-24ad-4f58-bec9-7ed1aed5d380 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:14.885068 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5ae734aa-24ad-4f58-bec9-7ed1aed5d380 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:14.885507 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5ae734aa-24ad-4f58-bec9-7ed1aed5d380 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:15.017875 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-5ae734aa-24ad-4f58-bec9-7ed1aed5d380 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:15.025644 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-5ae734aa-24ad-4f58-bec9-7ed1aed5d380 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:15.027200 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-5ae734aa-24ad-4f58-bec9-7ed1aed5d380 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:15.028340 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-5ae734aa-24ad-4f58-bec9-7ed1aed5d380 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1725 microversion: 2.20 time: 0.155810 Mar 08 14:53:15.028907 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 150/283] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:53:14 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:53:15.194741 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-414c7ef8-7e06-4d5c-9968-6c854be7053a tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:15.195350 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-414c7ef8-7e06-4d5c-9968-6c854be7053a tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:15.201693 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-414c7ef8-7e06-4d5c-9968-6c854be7053a tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:15.202178 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-414c7ef8-7e06-4d5c-9968-6c854be7053a tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:15.203105 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-414c7ef8-7e06-4d5c-9968-6c854be7053a tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:15.203539 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-414c7ef8-7e06-4d5c-9968-6c854be7053a tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:15.360809 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-414c7ef8-7e06-4d5c-9968-6c854be7053a tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:15.368701 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-414c7ef8-7e06-4d5c-9968-6c854be7053a tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1723 microversion: 2.1 time: 0.177716 Mar 08 14:53:15.369248 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 134/284] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:15 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:16.048056 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-2f881b2e-c522-4cec-b32d-3c0b9f1bb61e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:16.048650 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-2f881b2e-c522-4cec-b32d-3c0b9f1bb61e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:16.054954 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2f881b2e-c522-4cec-b32d-3c0b9f1bb61e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:16.055399 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2f881b2e-c522-4cec-b32d-3c0b9f1bb61e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:16.056167 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2f881b2e-c522-4cec-b32d-3c0b9f1bb61e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:16.056606 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2f881b2e-c522-4cec-b32d-3c0b9f1bb61e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:16.196627 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-2f881b2e-c522-4cec-b32d-3c0b9f1bb61e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:16.211371 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-2f881b2e-c522-4cec-b32d-3c0b9f1bb61e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:16.213136 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-2f881b2e-c522-4cec-b32d-3c0b9f1bb61e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:16.214430 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-2f881b2e-c522-4cec-b32d-3c0b9f1bb61e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1725 microversion: 2.20 time: 0.170372 Mar 08 14:53:16.215101 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 151/285] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:53:16 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 14:53:16.263699 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-45c2d772-bb89-4ce0-8e9d-2d12d7e7458d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:53:16.264735 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-45c2d772-bb89-4ce0-8e9d-2d12d7e7458d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:16.272237 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-45c2d772-bb89-4ce0-8e9d-2d12d7e7458d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:16.272675 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-45c2d772-bb89-4ce0-8e9d-2d12d7e7458d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:16.273491 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-45c2d772-bb89-4ce0-8e9d-2d12d7e7458d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:16.273915 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-45c2d772-bb89-4ce0-8e9d-2d12d7e7458d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:16.305586 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.objects.instance [None req-45c2d772-bb89-4ce0-8e9d-2d12d7e7458d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lazy-loading 'flavor' on Instance uuid f936e19e-08fe-43d1-8c05-2fc52d3a5a67 {{(pid=128352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 14:53:16.387652 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b5a3513f-0ecf-4541-a02c-eed119829fd5 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:16.388185 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-b5a3513f-0ecf-4541-a02c-eed119829fd5 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:16.394777 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b5a3513f-0ecf-4541-a02c-eed119829fd5 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:16.395229 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b5a3513f-0ecf-4541-a02c-eed119829fd5 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:16.396003 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b5a3513f-0ecf-4541-a02c-eed119829fd5 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:16.396601 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b5a3513f-0ecf-4541-a02c-eed119829fd5 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:16.456253 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-45c2d772-bb89-4ce0-8e9d-2d12d7e7458d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "POST /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67/action" status: 200 len: 32 microversion: 2.1 time: 0.196471 Mar 08 14:53:16.456956 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 135/286] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Mar 8 14:53:16 2022] POST /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67/action => generated 32 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 08 14:53:16.466546 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-7c83dea9-344d-452b-9a63-127d60084ca6 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:16.467515 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-7c83dea9-344d-452b-9a63-127d60084ca6 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:16.473669 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7c83dea9-344d-452b-9a63-127d60084ca6 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:16.474338 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7c83dea9-344d-452b-9a63-127d60084ca6 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:16.475116 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7c83dea9-344d-452b-9a63-127d60084ca6 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:16.475630 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7c83dea9-344d-452b-9a63-127d60084ca6 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:16.549580 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-b5a3513f-0ecf-4541-a02c-eed119829fd5 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:16.557349 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-b5a3513f-0ecf-4541-a02c-eed119829fd5 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1723 microversion: 2.1 time: 0.175387 Mar 08 14:53:16.557932 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 152/287] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:16 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:16.714213 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-7c83dea9-344d-452b-9a63-127d60084ca6 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:16.722577 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-7c83dea9-344d-452b-9a63-127d60084ca6 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1568 microversion: 2.1 time: 0.260259 Mar 08 14:53:16.723143 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 136/288] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:16 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1568 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:53:17.232866 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-4f87b417-8a28-4060-b463-5b7f45b07378 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:17.233504 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-4f87b417-8a28-4060-b463-5b7f45b07378 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:17.240658 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4f87b417-8a28-4060-b463-5b7f45b07378 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:17.241201 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4f87b417-8a28-4060-b463-5b7f45b07378 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:17.242011 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4f87b417-8a28-4060-b463-5b7f45b07378 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:17.242445 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4f87b417-8a28-4060-b463-5b7f45b07378 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:17.380935 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-4f87b417-8a28-4060-b463-5b7f45b07378 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:17.388853 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-4f87b417-8a28-4060-b463-5b7f45b07378 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:17.390706 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-4f87b417-8a28-4060-b463-5b7f45b07378 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:17.391753 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-4f87b417-8a28-4060-b463-5b7f45b07378 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1725 microversion: 2.20 time: 0.163069 Mar 08 14:53:17.392306 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 153/289] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:53:17 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:53:17.574364 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5c82328b-418a-4998-9454-1e2c40eccfc7 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:17.575676 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5c82328b-418a-4998-9454-1e2c40eccfc7 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:17.583324 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5c82328b-418a-4998-9454-1e2c40eccfc7 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:17.584192 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5c82328b-418a-4998-9454-1e2c40eccfc7 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:17.585286 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5c82328b-418a-4998-9454-1e2c40eccfc7 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:17.585978 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5c82328b-418a-4998-9454-1e2c40eccfc7 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:17.733140 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-5c82328b-418a-4998-9454-1e2c40eccfc7 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:17.742999 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-565eeaca-df40-4ff4-8dcf-4b720c847679 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:17.743618 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-565eeaca-df40-4ff4-8dcf-4b720c847679 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:17.747199 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5c82328b-418a-4998-9454-1e2c40eccfc7 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1723 microversion: 2.1 time: 0.176641 Mar 08 14:53:17.748010 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 137/290] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:17 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:17.751533 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-565eeaca-df40-4ff4-8dcf-4b720c847679 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:17.752177 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-565eeaca-df40-4ff4-8dcf-4b720c847679 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:17.756245 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-565eeaca-df40-4ff4-8dcf-4b720c847679 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:17.756717 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-565eeaca-df40-4ff4-8dcf-4b720c847679 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:17.906479 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-565eeaca-df40-4ff4-8dcf-4b720c847679 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:17.914244 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-565eeaca-df40-4ff4-8dcf-4b720c847679 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1568 microversion: 2.1 time: 0.178129 Mar 08 14:53:17.914795 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 154/291] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:17 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:53:18.413510 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ae79a37f-fea3-4467-81a8-5aaa2e4283f2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:18.414332 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ae79a37f-fea3-4467-81a8-5aaa2e4283f2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:18.420261 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ae79a37f-fea3-4467-81a8-5aaa2e4283f2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:18.420718 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ae79a37f-fea3-4467-81a8-5aaa2e4283f2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:18.422414 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ae79a37f-fea3-4467-81a8-5aaa2e4283f2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:18.422872 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ae79a37f-fea3-4467-81a8-5aaa2e4283f2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:18.554591 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ae79a37f-fea3-4467-81a8-5aaa2e4283f2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:18.562909 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ae79a37f-fea3-4467-81a8-5aaa2e4283f2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:18.564428 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ae79a37f-fea3-4467-81a8-5aaa2e4283f2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:18.565592 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ae79a37f-fea3-4467-81a8-5aaa2e4283f2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1725 microversion: 2.20 time: 0.157167 Mar 08 14:53:18.566202 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 138/292] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:53:18 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:53:18.764651 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-3f8e6bca-0c32-4ae6-bace-3bd6fca3681b tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:18.766060 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-3f8e6bca-0c32-4ae6-bace-3bd6fca3681b tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:18.772890 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3f8e6bca-0c32-4ae6-bace-3bd6fca3681b tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:18.773549 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3f8e6bca-0c32-4ae6-bace-3bd6fca3681b tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:18.774499 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3f8e6bca-0c32-4ae6-bace-3bd6fca3681b tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:18.774941 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3f8e6bca-0c32-4ae6-bace-3bd6fca3681b tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:18.921222 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-3f8e6bca-0c32-4ae6-bace-3bd6fca3681b tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:18.930821 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-3f8e6bca-0c32-4ae6-bace-3bd6fca3681b tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1723 microversion: 2.1 time: 0.169940 Mar 08 14:53:18.931396 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 155/293] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:18 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:18.933100 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-7e752f5e-c875-472c-9ca7-07490b6f3906 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:18.933938 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-7e752f5e-c875-472c-9ca7-07490b6f3906 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:18.951632 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7e752f5e-c875-472c-9ca7-07490b6f3906 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:18.952333 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7e752f5e-c875-472c-9ca7-07490b6f3906 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:18.953742 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7e752f5e-c875-472c-9ca7-07490b6f3906 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:18.954421 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7e752f5e-c875-472c-9ca7-07490b6f3906 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:19.109042 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-7e752f5e-c875-472c-9ca7-07490b6f3906 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:19.116928 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-7e752f5e-c875-472c-9ca7-07490b6f3906 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1568 microversion: 2.1 time: 0.188622 Mar 08 14:53:19.117488 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 139/294] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:18 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1568 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:19.584432 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-347017d6-704b-4ab7-ab2c-d959c76519de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:19.585034 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-347017d6-704b-4ab7-ab2c-d959c76519de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:19.591558 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-347017d6-704b-4ab7-ab2c-d959c76519de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:19.592002 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-347017d6-704b-4ab7-ab2c-d959c76519de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:19.592966 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-347017d6-704b-4ab7-ab2c-d959c76519de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:19.598490 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-347017d6-704b-4ab7-ab2c-d959c76519de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:19.747719 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-347017d6-704b-4ab7-ab2c-d959c76519de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:19.756383 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-347017d6-704b-4ab7-ab2c-d959c76519de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:19.757922 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-347017d6-704b-4ab7-ab2c-d959c76519de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:19.759077 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-347017d6-704b-4ab7-ab2c-d959c76519de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1725 microversion: 2.20 time: 0.178721 Mar 08 14:53:19.759632 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 156/295] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:53:19 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:53:19.948332 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-7ecc51b4-accb-4688-bc4f-64869b3e7c5b tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:19.949679 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-7ecc51b4-accb-4688-bc4f-64869b3e7c5b tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:19.959153 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7ecc51b4-accb-4688-bc4f-64869b3e7c5b tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:19.959611 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7ecc51b4-accb-4688-bc4f-64869b3e7c5b tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:19.960382 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7ecc51b4-accb-4688-bc4f-64869b3e7c5b tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:19.960993 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7ecc51b4-accb-4688-bc4f-64869b3e7c5b tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:20.109910 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-7ecc51b4-accb-4688-bc4f-64869b3e7c5b tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:20.117888 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-7ecc51b4-accb-4688-bc4f-64869b3e7c5b tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1723 microversion: 2.1 time: 0.173391 Mar 08 14:53:20.118464 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 140/296] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:19 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:20.134184 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-c1f1d3c9-97ef-4c4e-a370-d91ec58ab89f tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:20.134795 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-c1f1d3c9-97ef-4c4e-a370-d91ec58ab89f tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:20.143763 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c1f1d3c9-97ef-4c4e-a370-d91ec58ab89f tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:20.144219 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c1f1d3c9-97ef-4c4e-a370-d91ec58ab89f tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:20.144994 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c1f1d3c9-97ef-4c4e-a370-d91ec58ab89f tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:20.145434 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c1f1d3c9-97ef-4c4e-a370-d91ec58ab89f tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:20.287898 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-c1f1d3c9-97ef-4c4e-a370-d91ec58ab89f tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:20.309971 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-c1f1d3c9-97ef-4c4e-a370-d91ec58ab89f tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1568 microversion: 2.1 time: 0.178851 Mar 08 14:53:20.317135 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 157/297] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:20 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:20.778353 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-9e4f4622-38e0-4baf-a891-a024ea8703d9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:20.778703 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-9e4f4622-38e0-4baf-a891-a024ea8703d9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:20.784698 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9e4f4622-38e0-4baf-a891-a024ea8703d9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:20.785155 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9e4f4622-38e0-4baf-a891-a024ea8703d9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:20.785968 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9e4f4622-38e0-4baf-a891-a024ea8703d9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:20.786417 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9e4f4622-38e0-4baf-a891-a024ea8703d9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:20.922671 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-9e4f4622-38e0-4baf-a891-a024ea8703d9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:20.930366 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-9e4f4622-38e0-4baf-a891-a024ea8703d9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:20.931874 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-9e4f4622-38e0-4baf-a891-a024ea8703d9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:20.933022 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-9e4f4622-38e0-4baf-a891-a024ea8703d9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1725 microversion: 2.20 time: 0.158994 Mar 08 14:53:20.933584 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 141/298] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:53:20 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:53:21.135829 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-4e8e8a94-46b2-476d-9e34-7c5b74e12993 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:21.137314 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-4e8e8a94-46b2-476d-9e34-7c5b74e12993 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:21.144453 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4e8e8a94-46b2-476d-9e34-7c5b74e12993 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:21.144915 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4e8e8a94-46b2-476d-9e34-7c5b74e12993 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:21.145700 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4e8e8a94-46b2-476d-9e34-7c5b74e12993 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:21.146168 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4e8e8a94-46b2-476d-9e34-7c5b74e12993 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:21.283445 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-4e8e8a94-46b2-476d-9e34-7c5b74e12993 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:21.291505 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-4e8e8a94-46b2-476d-9e34-7c5b74e12993 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1723 microversion: 2.1 time: 0.159436 Mar 08 14:53:21.292380 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 158/299] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:21 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:21.329445 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5d16db57-17da-430f-98c7-1f4db0dcdf12 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:21.330093 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5d16db57-17da-430f-98c7-1f4db0dcdf12 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:21.336316 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5d16db57-17da-430f-98c7-1f4db0dcdf12 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:21.336786 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5d16db57-17da-430f-98c7-1f4db0dcdf12 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:21.337539 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5d16db57-17da-430f-98c7-1f4db0dcdf12 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:21.338018 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5d16db57-17da-430f-98c7-1f4db0dcdf12 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:21.481043 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-5d16db57-17da-430f-98c7-1f4db0dcdf12 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:21.489906 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5d16db57-17da-430f-98c7-1f4db0dcdf12 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1568 microversion: 2.1 time: 0.164920 Mar 08 14:53:21.490494 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 142/300] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:21 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:21.952179 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-3e86a830-e9e0-45e0-9b6a-a9d5b12d492c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:21.953491 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-3e86a830-e9e0-45e0-9b6a-a9d5b12d492c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:21.959417 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3e86a830-e9e0-45e0-9b6a-a9d5b12d492c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:21.959873 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3e86a830-e9e0-45e0-9b6a-a9d5b12d492c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:21.960646 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3e86a830-e9e0-45e0-9b6a-a9d5b12d492c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:21.961091 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3e86a830-e9e0-45e0-9b6a-a9d5b12d492c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:22.099119 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-3e86a830-e9e0-45e0-9b6a-a9d5b12d492c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:22.107039 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-3e86a830-e9e0-45e0-9b6a-a9d5b12d492c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:22.108559 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-3e86a830-e9e0-45e0-9b6a-a9d5b12d492c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:22.109904 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-3e86a830-e9e0-45e0-9b6a-a9d5b12d492c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1725 microversion: 2.20 time: 0.161606 Mar 08 14:53:22.110457 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 159/301] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:53:21 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:53:22.309153 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f3a41f2a-1960-4cd2-8216-215d23b75f1f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:22.309763 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f3a41f2a-1960-4cd2-8216-215d23b75f1f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:22.316654 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f3a41f2a-1960-4cd2-8216-215d23b75f1f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:22.317105 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f3a41f2a-1960-4cd2-8216-215d23b75f1f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:22.317892 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f3a41f2a-1960-4cd2-8216-215d23b75f1f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:22.318406 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f3a41f2a-1960-4cd2-8216-215d23b75f1f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:22.452113 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f3a41f2a-1960-4cd2-8216-215d23b75f1f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:22.460008 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f3a41f2a-1960-4cd2-8216-215d23b75f1f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1723 microversion: 2.1 time: 0.154663 Mar 08 14:53:22.460569 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 143/302] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:22 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:22.507028 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-59f4ac07-b2a4-418a-aa6c-95adc4fac607 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:22.507649 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-59f4ac07-b2a4-418a-aa6c-95adc4fac607 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:22.513816 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-59f4ac07-b2a4-418a-aa6c-95adc4fac607 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:22.514311 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-59f4ac07-b2a4-418a-aa6c-95adc4fac607 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:22.515566 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-59f4ac07-b2a4-418a-aa6c-95adc4fac607 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:22.516015 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-59f4ac07-b2a4-418a-aa6c-95adc4fac607 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:22.653145 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-59f4ac07-b2a4-418a-aa6c-95adc4fac607 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:22.661139 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-59f4ac07-b2a4-418a-aa6c-95adc4fac607 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1568 microversion: 2.1 time: 0.157898 Mar 08 14:53:22.661700 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 160/303] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:22 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:23.129111 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-45dd8f74-7f23-4dc0-a3a3-8199e729868a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:23.129785 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-45dd8f74-7f23-4dc0-a3a3-8199e729868a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:23.135980 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-45dd8f74-7f23-4dc0-a3a3-8199e729868a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:23.136435 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-45dd8f74-7f23-4dc0-a3a3-8199e729868a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:23.137218 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-45dd8f74-7f23-4dc0-a3a3-8199e729868a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:23.137623 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-45dd8f74-7f23-4dc0-a3a3-8199e729868a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:23.276741 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-45dd8f74-7f23-4dc0-a3a3-8199e729868a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:23.284879 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-45dd8f74-7f23-4dc0-a3a3-8199e729868a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:23.286442 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-45dd8f74-7f23-4dc0-a3a3-8199e729868a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:23.287596 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-45dd8f74-7f23-4dc0-a3a3-8199e729868a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1746 microversion: 2.20 time: 0.163654 Mar 08 14:53:23.288150 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 144/304] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:53:23 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1746 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:53:23.477064 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-4d929b64-e3ed-44e3-a527-3ccc41106c3c tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:23.477499 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-4d929b64-e3ed-44e3-a527-3ccc41106c3c tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:23.483361 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4d929b64-e3ed-44e3-a527-3ccc41106c3c tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:23.484067 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4d929b64-e3ed-44e3-a527-3ccc41106c3c tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:23.484830 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4d929b64-e3ed-44e3-a527-3ccc41106c3c tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:23.485270 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4d929b64-e3ed-44e3-a527-3ccc41106c3c tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:23.622492 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-4d929b64-e3ed-44e3-a527-3ccc41106c3c tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:23.631773 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-4d929b64-e3ed-44e3-a527-3ccc41106c3c tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1723 microversion: 2.1 time: 0.158685 Mar 08 14:53:23.632296 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 161/305] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:23 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:23.678637 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c09f0c84-553e-4f44-b2e8-21037eab091c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:23.680548 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-c09f0c84-553e-4f44-b2e8-21037eab091c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:23.689026 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c09f0c84-553e-4f44-b2e8-21037eab091c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:23.689473 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c09f0c84-553e-4f44-b2e8-21037eab091c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:23.690725 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c09f0c84-553e-4f44-b2e8-21037eab091c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:23.691177 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c09f0c84-553e-4f44-b2e8-21037eab091c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:23.852008 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-c09f0c84-553e-4f44-b2e8-21037eab091c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:23.860623 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-c09f0c84-553e-4f44-b2e8-21037eab091c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1568 microversion: 2.1 time: 0.186502 Mar 08 14:53:23.861290 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 145/306] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:23 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:24.306792 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-0b0951c5-0886-4578-a73b-d735c6a365f2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:24.307384 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-0b0951c5-0886-4578-a73b-d735c6a365f2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:24.313534 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0b0951c5-0886-4578-a73b-d735c6a365f2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:24.314018 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0b0951c5-0886-4578-a73b-d735c6a365f2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:24.314779 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0b0951c5-0886-4578-a73b-d735c6a365f2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:24.315210 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0b0951c5-0886-4578-a73b-d735c6a365f2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:24.446181 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-0b0951c5-0886-4578-a73b-d735c6a365f2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:24.454199 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-0b0951c5-0886-4578-a73b-d735c6a365f2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:24.455839 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-0b0951c5-0886-4578-a73b-d735c6a365f2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:24.456994 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-0b0951c5-0886-4578-a73b-d735c6a365f2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1746 microversion: 2.20 time: 0.154109 Mar 08 14:53:24.457557 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 162/307] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:53:24 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 14:53:24.649630 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-fca7c6cf-5d25-40a0-9599-82c6c5ee73b6 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:24.650335 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-fca7c6cf-5d25-40a0-9599-82c6c5ee73b6 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:24.656480 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fca7c6cf-5d25-40a0-9599-82c6c5ee73b6 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:24.656932 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fca7c6cf-5d25-40a0-9599-82c6c5ee73b6 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:24.657690 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fca7c6cf-5d25-40a0-9599-82c6c5ee73b6 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:24.658159 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fca7c6cf-5d25-40a0-9599-82c6c5ee73b6 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:24.788399 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-fca7c6cf-5d25-40a0-9599-82c6c5ee73b6 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:24.796674 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-fca7c6cf-5d25-40a0-9599-82c6c5ee73b6 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1723 microversion: 2.1 time: 0.150249 Mar 08 14:53:24.797331 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 146/308] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:24 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:24.878259 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-74686a11-ead0-4be9-b23c-e4d234b2b076 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:24.878799 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-74686a11-ead0-4be9-b23c-e4d234b2b076 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:24.884901 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-74686a11-ead0-4be9-b23c-e4d234b2b076 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:24.885351 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-74686a11-ead0-4be9-b23c-e4d234b2b076 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:24.886144 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-74686a11-ead0-4be9-b23c-e4d234b2b076 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:24.886578 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-74686a11-ead0-4be9-b23c-e4d234b2b076 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:25.022672 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-74686a11-ead0-4be9-b23c-e4d234b2b076 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:25.031147 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-74686a11-ead0-4be9-b23c-e4d234b2b076 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1568 microversion: 2.1 time: 0.156638 Mar 08 14:53:25.032149 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 163/309] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:24 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:25.475237 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c97b6ce0-4ca0-4d54-8e40-9629ffdeae14 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:25.475844 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-c97b6ce0-4ca0-4d54-8e40-9629ffdeae14 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:25.481697 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c97b6ce0-4ca0-4d54-8e40-9629ffdeae14 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:25.482184 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c97b6ce0-4ca0-4d54-8e40-9629ffdeae14 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:25.482953 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c97b6ce0-4ca0-4d54-8e40-9629ffdeae14 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:25.483393 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c97b6ce0-4ca0-4d54-8e40-9629ffdeae14 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:25.618433 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-c97b6ce0-4ca0-4d54-8e40-9629ffdeae14 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:25.626326 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-c97b6ce0-4ca0-4d54-8e40-9629ffdeae14 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:25.627830 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-c97b6ce0-4ca0-4d54-8e40-9629ffdeae14 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:25.628979 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-c97b6ce0-4ca0-4d54-8e40-9629ffdeae14 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1746 microversion: 2.20 time: 0.157655 Mar 08 14:53:25.629527 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 147/310] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:53:25 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:53:25.814137 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-6302569b-5837-437f-82cc-f73bb6c1f3d9 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:25.814744 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-6302569b-5837-437f-82cc-f73bb6c1f3d9 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:25.820468 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6302569b-5837-437f-82cc-f73bb6c1f3d9 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:25.820915 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6302569b-5837-437f-82cc-f73bb6c1f3d9 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:25.821699 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6302569b-5837-437f-82cc-f73bb6c1f3d9 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:25.822157 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6302569b-5837-437f-82cc-f73bb6c1f3d9 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:25.958206 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-6302569b-5837-437f-82cc-f73bb6c1f3d9 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:25.966240 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-6302569b-5837-437f-82cc-f73bb6c1f3d9 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1723 microversion: 2.1 time: 0.156332 Mar 08 14:53:25.966906 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 164/311] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:25 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:26.049617 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-eb6b14dd-dc0e-44bd-98aa-9e52cc9d63a6 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:26.050167 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-eb6b14dd-dc0e-44bd-98aa-9e52cc9d63a6 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:26.056423 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-eb6b14dd-dc0e-44bd-98aa-9e52cc9d63a6 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:26.056876 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-eb6b14dd-dc0e-44bd-98aa-9e52cc9d63a6 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:26.057640 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-eb6b14dd-dc0e-44bd-98aa-9e52cc9d63a6 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:26.058134 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-eb6b14dd-dc0e-44bd-98aa-9e52cc9d63a6 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:26.187350 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-eb6b14dd-dc0e-44bd-98aa-9e52cc9d63a6 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:26.195083 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-eb6b14dd-dc0e-44bd-98aa-9e52cc9d63a6 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1568 microversion: 2.1 time: 0.150281 Mar 08 14:53:26.195654 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 148/312] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:26 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:26.647003 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-3d4d20f9-5ff4-4c3c-9e8f-3305750071de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:26.647603 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-3d4d20f9-5ff4-4c3c-9e8f-3305750071de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:26.653393 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3d4d20f9-5ff4-4c3c-9e8f-3305750071de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:26.653837 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3d4d20f9-5ff4-4c3c-9e8f-3305750071de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:26.654622 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3d4d20f9-5ff4-4c3c-9e8f-3305750071de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:26.655052 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3d4d20f9-5ff4-4c3c-9e8f-3305750071de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:26.785605 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-3d4d20f9-5ff4-4c3c-9e8f-3305750071de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:26.793135 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-3d4d20f9-5ff4-4c3c-9e8f-3305750071de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:26.794669 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-3d4d20f9-5ff4-4c3c-9e8f-3305750071de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:26.795801 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-3d4d20f9-5ff4-4c3c-9e8f-3305750071de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1746 microversion: 2.20 time: 0.152712 Mar 08 14:53:26.796435 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 165/313] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:53:26 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:53:26.983261 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-30c3d024-22ef-4383-9dd8-3da5180cfd89 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:26.984070 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-30c3d024-22ef-4383-9dd8-3da5180cfd89 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:26.989954 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-30c3d024-22ef-4383-9dd8-3da5180cfd89 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:26.990405 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-30c3d024-22ef-4383-9dd8-3da5180cfd89 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:26.991268 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-30c3d024-22ef-4383-9dd8-3da5180cfd89 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:26.991778 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-30c3d024-22ef-4383-9dd8-3da5180cfd89 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:27.127351 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-30c3d024-22ef-4383-9dd8-3da5180cfd89 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:27.135164 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-30c3d024-22ef-4383-9dd8-3da5180cfd89 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1723 microversion: 2.1 time: 0.155770 Mar 08 14:53:27.135723 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 149/314] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:26 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:27.212335 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-a358d523-bba6-4e48-bc91-37753f8d0f81 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:27.212935 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-a358d523-bba6-4e48-bc91-37753f8d0f81 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:27.220197 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a358d523-bba6-4e48-bc91-37753f8d0f81 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:27.220648 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a358d523-bba6-4e48-bc91-37753f8d0f81 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:27.221436 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a358d523-bba6-4e48-bc91-37753f8d0f81 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:27.221893 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a358d523-bba6-4e48-bc91-37753f8d0f81 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:27.354977 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-a358d523-bba6-4e48-bc91-37753f8d0f81 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:27.363413 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-a358d523-bba6-4e48-bc91-37753f8d0f81 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1568 microversion: 2.1 time: 0.154937 Mar 08 14:53:27.363974 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 166/315] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:27 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:27.815206 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-0956b596-276d-4a1c-83ca-b5874568d3b6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:27.815829 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-0956b596-276d-4a1c-83ca-b5874568d3b6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:27.821711 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0956b596-276d-4a1c-83ca-b5874568d3b6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:27.822197 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0956b596-276d-4a1c-83ca-b5874568d3b6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:27.822970 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0956b596-276d-4a1c-83ca-b5874568d3b6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:27.823409 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0956b596-276d-4a1c-83ca-b5874568d3b6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:27.960353 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-0956b596-276d-4a1c-83ca-b5874568d3b6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:27.968394 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-0956b596-276d-4a1c-83ca-b5874568d3b6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:27.969944 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-0956b596-276d-4a1c-83ca-b5874568d3b6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:27.971095 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-0956b596-276d-4a1c-83ca-b5874568d3b6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1746 microversion: 2.20 time: 0.160543 Mar 08 14:53:27.971639 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 150/316] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:53:27 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1746 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:53:28.157502 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-0337f6de-15d2-4391-b8bf-e1fe00938a72 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:28.158230 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-0337f6de-15d2-4391-b8bf-e1fe00938a72 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:28.164322 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0337f6de-15d2-4391-b8bf-e1fe00938a72 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:28.164783 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0337f6de-15d2-4391-b8bf-e1fe00938a72 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:28.165610 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0337f6de-15d2-4391-b8bf-e1fe00938a72 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:28.166080 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0337f6de-15d2-4391-b8bf-e1fe00938a72 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:28.252784 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [req-0115381f-0b3b-4e9b-b420-fb2d59fd6abc req-cc8e8592-f61f-447d-8d7c-1c36fc92e3ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b7917ad-8941-400f-ae66-d22e26633416", "name": "network-vif-plugged", "status": "completed", "tag": "14e51cd2-ee26-4f88-bdde-048115f528a7"}]} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:53:28.263106 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-0115381f-0b3b-4e9b-b420-fb2d59fd6abc req-cc8e8592-f61f-447d-8d7c-1c36fc92e3ac service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:28.264000 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-0115381f-0b3b-4e9b-b420-fb2d59fd6abc req-cc8e8592-f61f-447d-8d7c-1c36fc92e3ac service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:28.276521 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.compute.server_external_events [req-0115381f-0b3b-4e9b-b420-fb2d59fd6abc req-cc8e8592-f61f-447d-8d7c-1c36fc92e3ac service nova] Creating event network-vif-plugged:14e51cd2-ee26-4f88-bdde-048115f528a7 for instance 1b7917ad-8941-400f-ae66-d22e26633416 on hv-cinder-83009 Mar 08 14:53:28.282334 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [req-0115381f-0b3b-4e9b-b420-fb2d59fd6abc req-cc8e8592-f61f-447d-8d7c-1c36fc92e3ac service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033643 Mar 08 14:53:28.283300 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 151/317] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 14:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:53:28.304725 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-0337f6de-15d2-4391-b8bf-e1fe00938a72 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:28.314649 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-0337f6de-15d2-4391-b8bf-e1fe00938a72 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1723 microversion: 2.1 time: 0.162195 Mar 08 14:53:28.315351 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 167/318] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:28 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:28.380827 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d805cf02-2108-4c65-ada3-0adf29edd997 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:28.381560 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d805cf02-2108-4c65-ada3-0adf29edd997 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:28.387918 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d805cf02-2108-4c65-ada3-0adf29edd997 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:28.388385 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d805cf02-2108-4c65-ada3-0adf29edd997 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:28.389152 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d805cf02-2108-4c65-ada3-0adf29edd997 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:28.390135 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d805cf02-2108-4c65-ada3-0adf29edd997 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:28.527177 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d805cf02-2108-4c65-ada3-0adf29edd997 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:28.535659 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d805cf02-2108-4c65-ada3-0adf29edd997 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1568 microversion: 2.1 time: 0.159126 Mar 08 14:53:28.536226 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 152/319] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:28 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:28.990421 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-5ac97225-1faf-47f7-aeac-e7331eeeca4b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:28.991043 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-5ac97225-1faf-47f7-aeac-e7331eeeca4b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:28.997029 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5ac97225-1faf-47f7-aeac-e7331eeeca4b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:28.997484 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5ac97225-1faf-47f7-aeac-e7331eeeca4b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:28.998368 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5ac97225-1faf-47f7-aeac-e7331eeeca4b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:28.998813 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5ac97225-1faf-47f7-aeac-e7331eeeca4b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:29.185511 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-5ac97225-1faf-47f7-aeac-e7331eeeca4b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:29.198305 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-5ac97225-1faf-47f7-aeac-e7331eeeca4b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:29.207526 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-5ac97225-1faf-47f7-aeac-e7331eeeca4b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:29.208862 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-5ac97225-1faf-47f7-aeac-e7331eeeca4b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1746 microversion: 2.20 time: 0.224173 Mar 08 14:53:29.209427 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 168/320] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:53:28 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1746 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:53:29.332357 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5e532557-bd12-476f-bea7-fd24565340f0 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:29.333104 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5e532557-bd12-476f-bea7-fd24565340f0 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:29.339825 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5e532557-bd12-476f-bea7-fd24565340f0 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:29.340331 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5e532557-bd12-476f-bea7-fd24565340f0 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:29.341183 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5e532557-bd12-476f-bea7-fd24565340f0 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:29.341668 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5e532557-bd12-476f-bea7-fd24565340f0 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:29.519748 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-5e532557-bd12-476f-bea7-fd24565340f0 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:29.532179 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5e532557-bd12-476f-bea7-fd24565340f0 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1723 microversion: 2.1 time: 0.200309 Mar 08 14:53:29.541759 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 153/321] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:29 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:29.553288 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-8391b1fd-6378-40c4-b8d3-aab3fdb88aa5 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:29.554112 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-8391b1fd-6378-40c4-b8d3-aab3fdb88aa5 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:29.560431 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8391b1fd-6378-40c4-b8d3-aab3fdb88aa5 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:29.560970 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8391b1fd-6378-40c4-b8d3-aab3fdb88aa5 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:29.561958 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8391b1fd-6378-40c4-b8d3-aab3fdb88aa5 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:29.562480 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8391b1fd-6378-40c4-b8d3-aab3fdb88aa5 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:29.705386 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-8391b1fd-6378-40c4-b8d3-aab3fdb88aa5 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:29.713204 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-8391b1fd-6378-40c4-b8d3-aab3fdb88aa5 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1568 microversion: 2.1 time: 0.163938 Mar 08 14:53:29.713763 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 169/322] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:29 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:30.228389 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c1c3101d-44ff-4334-a8c4-2713ef354896 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:30.229113 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-c1c3101d-44ff-4334-a8c4-2713ef354896 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:30.235757 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c1c3101d-44ff-4334-a8c4-2713ef354896 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:30.236579 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c1c3101d-44ff-4334-a8c4-2713ef354896 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:30.237596 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c1c3101d-44ff-4334-a8c4-2713ef354896 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:30.238294 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c1c3101d-44ff-4334-a8c4-2713ef354896 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:30.407440 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-c1c3101d-44ff-4334-a8c4-2713ef354896 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:30.423513 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-c1c3101d-44ff-4334-a8c4-2713ef354896 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:30.426839 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-c1c3101d-44ff-4334-a8c4-2713ef354896 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:30.428402 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-c1c3101d-44ff-4334-a8c4-2713ef354896 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1741 microversion: 2.20 time: 0.204447 Mar 08 14:53:30.442477 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 154/323] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:53:30 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1741 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:53:30.549023 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-55ee6da2-733d-44bb-b558-b49895084cf3 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:30.549689 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-55ee6da2-733d-44bb-b558-b49895084cf3 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:30.562906 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-55ee6da2-733d-44bb-b558-b49895084cf3 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:30.564024 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-55ee6da2-733d-44bb-b558-b49895084cf3 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:30.564963 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-55ee6da2-733d-44bb-b558-b49895084cf3 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:30.565399 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-55ee6da2-733d-44bb-b558-b49895084cf3 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:30.731021 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-a1610786-07c7-4b4a-8b98-033a8950f86c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:30.731550 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-a1610786-07c7-4b4a-8b98-033a8950f86c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:30.747763 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a1610786-07c7-4b4a-8b98-033a8950f86c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:30.748524 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a1610786-07c7-4b4a-8b98-033a8950f86c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:30.749518 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a1610786-07c7-4b4a-8b98-033a8950f86c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:30.750143 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a1610786-07c7-4b4a-8b98-033a8950f86c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:30.840482 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-55ee6da2-733d-44bb-b558-b49895084cf3 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:30.849106 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-55ee6da2-733d-44bb-b558-b49895084cf3 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1723 microversion: 2.1 time: 0.304486 Mar 08 14:53:30.862245 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 170/324] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:30 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1723 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:30.915698 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-a1610786-07c7-4b4a-8b98-033a8950f86c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:30.924829 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-a1610786-07c7-4b4a-8b98-033a8950f86c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1568 microversion: 2.1 time: 0.197753 Mar 08 14:53:30.935343 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 155/325] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:30 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1568 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:53:31.460077 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-602688f4-75c3-4132-91a8-20d44da28749 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:31.464222 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-602688f4-75c3-4132-91a8-20d44da28749 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:31.496114 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-602688f4-75c3-4132-91a8-20d44da28749 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:31.497174 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-602688f4-75c3-4132-91a8-20d44da28749 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:31.498440 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-602688f4-75c3-4132-91a8-20d44da28749 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:31.499538 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-602688f4-75c3-4132-91a8-20d44da28749 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:31.750197 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-602688f4-75c3-4132-91a8-20d44da28749 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:31.762253 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-602688f4-75c3-4132-91a8-20d44da28749 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:31.764569 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-602688f4-75c3-4132-91a8-20d44da28749 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:31.766362 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-602688f4-75c3-4132-91a8-20d44da28749 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1741 microversion: 2.20 time: 0.319544 Mar 08 14:53:31.770530 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 171/326] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:53:31 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1741 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:53:31.867559 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d2bb2859-d159-4fcb-8a1e-c5d558afbb03 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:31.868166 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d2bb2859-d159-4fcb-8a1e-c5d558afbb03 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:31.903025 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d2bb2859-d159-4fcb-8a1e-c5d558afbb03 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:31.903388 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d2bb2859-d159-4fcb-8a1e-c5d558afbb03 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:31.908886 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d2bb2859-d159-4fcb-8a1e-c5d558afbb03 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:31.909317 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d2bb2859-d159-4fcb-8a1e-c5d558afbb03 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:31.945847 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-15712bdf-4906-45bf-9e92-0991e0e8ef1d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:31.946502 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-15712bdf-4906-45bf-9e92-0991e0e8ef1d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:31.959186 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-15712bdf-4906-45bf-9e92-0991e0e8ef1d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:31.959654 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-15712bdf-4906-45bf-9e92-0991e0e8ef1d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:31.969291 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-15712bdf-4906-45bf-9e92-0991e0e8ef1d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:31.969884 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-15712bdf-4906-45bf-9e92-0991e0e8ef1d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:32.214419 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d2bb2859-d159-4fcb-8a1e-c5d558afbb03 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:32.226283 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d2bb2859-d159-4fcb-8a1e-c5d558afbb03 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1700 microversion: 2.1 time: 0.363806 Mar 08 14:53:32.238239 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 156/327] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:31 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1700 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:32.247863 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-4f60b910-9a07-4b0a-98a4-17f07c15c218 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:53:32.257189 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4f60b910-9a07-4b0a-98a4-17f07c15c218 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:32.258242 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4f60b910-9a07-4b0a-98a4-17f07c15c218 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:32.290966 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-15712bdf-4906-45bf-9e92-0991e0e8ef1d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:32.303555 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-15712bdf-4906-45bf-9e92-0991e0e8ef1d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1568 microversion: 2.1 time: 0.364046 Mar 08 14:53:32.306871 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 172/328] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:31 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1568 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:32.351215 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-4f60b910-9a07-4b0a-98a4-17f07c15c218 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Going to try to start instance {{(pid=128352) start /opt/stack/nova/nova/compute/api.py:2730}} Mar 08 14:53:32.418646 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-4f60b910-9a07-4b0a-98a4-17f07c15c218 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "POST /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e/action" status: 202 len: 0 microversion: 2.1 time: 0.171738 Mar 08 14:53:32.421728 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 157/329] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Mar 8 14:53:32 2022] POST /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 14:53:32.431953 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-51931fa6-ae8a-4262-bfff-9b661bd75a5f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:32.432693 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-51931fa6-ae8a-4262-bfff-9b661bd75a5f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:32.447260 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-51931fa6-ae8a-4262-bfff-9b661bd75a5f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:32.448484 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-51931fa6-ae8a-4262-bfff-9b661bd75a5f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:32.452922 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-51931fa6-ae8a-4262-bfff-9b661bd75a5f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:32.453728 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-51931fa6-ae8a-4262-bfff-9b661bd75a5f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:32.761255 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-51931fa6-ae8a-4262-bfff-9b661bd75a5f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:32.775216 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-51931fa6-ae8a-4262-bfff-9b661bd75a5f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1709 microversion: 2.1 time: 0.349016 Mar 08 14:53:32.778852 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 173/330] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:32 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1709 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:32.792857 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-4c75d7f7-c084-40f6-b922-40cdf447ca15 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:32.794637 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-4c75d7f7-c084-40f6-b922-40cdf447ca15 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:32.809413 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4c75d7f7-c084-40f6-b922-40cdf447ca15 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:32.814797 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4c75d7f7-c084-40f6-b922-40cdf447ca15 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:32.822209 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4c75d7f7-c084-40f6-b922-40cdf447ca15 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:32.822209 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4c75d7f7-c084-40f6-b922-40cdf447ca15 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:33.329388 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-33d7da38-ab3c-47e6-81bd-f8bfc7754170 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:33.331472 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-33d7da38-ab3c-47e6-81bd-f8bfc7754170 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:33.345903 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-33d7da38-ab3c-47e6-81bd-f8bfc7754170 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:33.347172 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-33d7da38-ab3c-47e6-81bd-f8bfc7754170 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:33.348212 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-33d7da38-ab3c-47e6-81bd-f8bfc7754170 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:33.350152 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-33d7da38-ab3c-47e6-81bd-f8bfc7754170 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:33.354610 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-4c75d7f7-c084-40f6-b922-40cdf447ca15 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:33.379008 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-4c75d7f7-c084-40f6-b922-40cdf447ca15 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:33.380931 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-4c75d7f7-c084-40f6-b922-40cdf447ca15 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:33.403327 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-4c75d7f7-c084-40f6-b922-40cdf447ca15 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1741 microversion: 2.20 time: 0.612949 Mar 08 14:53:33.403983 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 158/331] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:53:32 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1741 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:53:33.590786 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-33d7da38-ab3c-47e6-81bd-f8bfc7754170 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:33.602734 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-33d7da38-ab3c-47e6-81bd-f8bfc7754170 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1568 microversion: 2.1 time: 0.282712 Mar 08 14:53:33.607710 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 174/332] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:33 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1568 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:33.795546 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-03a64649-53b3-4a10-84d6-4632c5c7de12 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:33.796240 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-03a64649-53b3-4a10-84d6-4632c5c7de12 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:33.803332 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-03a64649-53b3-4a10-84d6-4632c5c7de12 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:33.803781 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-03a64649-53b3-4a10-84d6-4632c5c7de12 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:33.812818 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-03a64649-53b3-4a10-84d6-4632c5c7de12 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:33.813530 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-03a64649-53b3-4a10-84d6-4632c5c7de12 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:34.196346 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-03a64649-53b3-4a10-84d6-4632c5c7de12 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:34.205056 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-03a64649-53b3-4a10-84d6-4632c5c7de12 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1709 microversion: 2.1 time: 0.413288 Mar 08 14:53:34.218538 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 159/333] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:33 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1709 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:34.422572 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-1f43904d-8017-42eb-8404-6c0d4fa2917c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:34.424252 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-1f43904d-8017-42eb-8404-6c0d4fa2917c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:34.431796 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1f43904d-8017-42eb-8404-6c0d4fa2917c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:34.433301 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1f43904d-8017-42eb-8404-6c0d4fa2917c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:34.437468 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1f43904d-8017-42eb-8404-6c0d4fa2917c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:34.438127 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1f43904d-8017-42eb-8404-6c0d4fa2917c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:34.627926 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c058b5f8-3003-4e5f-8c32-c87b499f0df6 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:34.628687 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-c058b5f8-3003-4e5f-8c32-c87b499f0df6 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:34.637456 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c058b5f8-3003-4e5f-8c32-c87b499f0df6 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:34.640899 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c058b5f8-3003-4e5f-8c32-c87b499f0df6 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:34.642321 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c058b5f8-3003-4e5f-8c32-c87b499f0df6 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:34.643486 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c058b5f8-3003-4e5f-8c32-c87b499f0df6 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:34.657298 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-1f43904d-8017-42eb-8404-6c0d4fa2917c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:34.670130 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-1f43904d-8017-42eb-8404-6c0d4fa2917c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:34.675610 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-1f43904d-8017-42eb-8404-6c0d4fa2917c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:34.676983 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-1f43904d-8017-42eb-8404-6c0d4fa2917c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1741 microversion: 2.20 time: 0.258620 Mar 08 14:53:34.679753 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 175/334] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:53:34 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1741 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:53:34.989360 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-c058b5f8-3003-4e5f-8c32-c87b499f0df6 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:35.015451 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-c058b5f8-3003-4e5f-8c32-c87b499f0df6 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1568 microversion: 2.1 time: 0.377679 Mar 08 14:53:35.016787 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 160/335] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:34 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1568 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:35.229263 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-5815cd11-c208-4415-9d17-da5b90384d79 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:35.230256 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-5815cd11-c208-4415-9d17-da5b90384d79 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:35.240015 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5815cd11-c208-4415-9d17-da5b90384d79 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:35.240937 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5815cd11-c208-4415-9d17-da5b90384d79 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:35.243172 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5815cd11-c208-4415-9d17-da5b90384d79 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:35.243802 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5815cd11-c208-4415-9d17-da5b90384d79 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:35.697012 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-afaaa0d3-189a-46c6-92ae-0f62a51513d1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:35.697626 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-afaaa0d3-189a-46c6-92ae-0f62a51513d1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:35.709243 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-afaaa0d3-189a-46c6-92ae-0f62a51513d1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:35.709991 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-afaaa0d3-189a-46c6-92ae-0f62a51513d1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:35.711445 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-afaaa0d3-189a-46c6-92ae-0f62a51513d1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:35.712108 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-afaaa0d3-189a-46c6-92ae-0f62a51513d1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:35.967024 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-afaaa0d3-189a-46c6-92ae-0f62a51513d1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:35.984115 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-afaaa0d3-189a-46c6-92ae-0f62a51513d1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:35.993301 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-afaaa0d3-189a-46c6-92ae-0f62a51513d1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:35.994741 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-afaaa0d3-189a-46c6-92ae-0f62a51513d1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1741 microversion: 2.20 time: 0.301610 Mar 08 14:53:35.997975 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 161/336] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:53:35 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1741 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 14:53:36.014054 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-5815cd11-c208-4415-9d17-da5b90384d79 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:36.032768 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-5815cd11-c208-4415-9d17-da5b90384d79 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1713 microversion: 2.1 time: 0.807987 Mar 08 14:53:36.034453 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 176/337] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:35 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1713 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:36.039177 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5229a407-b40d-4b7f-b7a8-725203899c73 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:36.040488 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5229a407-b40d-4b7f-b7a8-725203899c73 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:36.054847 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5229a407-b40d-4b7f-b7a8-725203899c73 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:36.057114 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5229a407-b40d-4b7f-b7a8-725203899c73 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:36.058274 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5229a407-b40d-4b7f-b7a8-725203899c73 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:36.058726 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5229a407-b40d-4b7f-b7a8-725203899c73 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:36.705138 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-5229a407-b40d-4b7f-b7a8-725203899c73 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:36.721983 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5229a407-b40d-4b7f-b7a8-725203899c73 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1568 microversion: 2.1 time: 0.692946 Mar 08 14:53:36.723305 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 162/338] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:36 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1568 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:53:37.013185 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-3f1ba12e-0179-4a37-940f-84a6365ac62c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:37.015123 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-3f1ba12e-0179-4a37-940f-84a6365ac62c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:37.027715 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3f1ba12e-0179-4a37-940f-84a6365ac62c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:37.032030 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3f1ba12e-0179-4a37-940f-84a6365ac62c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:37.035713 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3f1ba12e-0179-4a37-940f-84a6365ac62c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:37.036329 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3f1ba12e-0179-4a37-940f-84a6365ac62c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:37.464382 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-3f1ba12e-0179-4a37-940f-84a6365ac62c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:37.484888 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-3f1ba12e-0179-4a37-940f-84a6365ac62c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:37.493246 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-3f1ba12e-0179-4a37-940f-84a6365ac62c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:37.494841 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-3f1ba12e-0179-4a37-940f-84a6365ac62c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1741 microversion: 2.20 time: 0.485974 Mar 08 14:53:37.500677 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 177/339] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:53:37 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1741 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:53:37.745430 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ab1c9496-f71a-49cf-b97f-4e3198c5950b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:37.746088 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ab1c9496-f71a-49cf-b97f-4e3198c5950b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:37.757164 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ab1c9496-f71a-49cf-b97f-4e3198c5950b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:37.757617 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ab1c9496-f71a-49cf-b97f-4e3198c5950b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:37.758436 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ab1c9496-f71a-49cf-b97f-4e3198c5950b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:37.758874 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ab1c9496-f71a-49cf-b97f-4e3198c5950b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:38.133683 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ab1c9496-f71a-49cf-b97f-4e3198c5950b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:38.155507 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ab1c9496-f71a-49cf-b97f-4e3198c5950b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1568 microversion: 2.1 time: 0.418218 Mar 08 14:53:38.165629 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 163/340] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:37 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1568 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:38.523484 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-48793bb4-28f9-41d6-958c-1d7bc4b56119 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:38.525239 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-48793bb4-28f9-41d6-958c-1d7bc4b56119 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:38.547069 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-48793bb4-28f9-41d6-958c-1d7bc4b56119 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:38.547809 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-48793bb4-28f9-41d6-958c-1d7bc4b56119 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:38.549838 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-48793bb4-28f9-41d6-958c-1d7bc4b56119 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:38.551212 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-48793bb4-28f9-41d6-958c-1d7bc4b56119 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:39.174087 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-7be64f2f-6d99-441f-b4b5-acf264448836 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:39.175819 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-7be64f2f-6d99-441f-b4b5-acf264448836 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:39.190464 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7be64f2f-6d99-441f-b4b5-acf264448836 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:39.191185 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7be64f2f-6d99-441f-b4b5-acf264448836 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:39.193831 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7be64f2f-6d99-441f-b4b5-acf264448836 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:39.194493 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7be64f2f-6d99-441f-b4b5-acf264448836 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:39.427763 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-48793bb4-28f9-41d6-958c-1d7bc4b56119 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:39.437334 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-48793bb4-28f9-41d6-958c-1d7bc4b56119 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:39.447323 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-48793bb4-28f9-41d6-958c-1d7bc4b56119 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:39.448835 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-48793bb4-28f9-41d6-958c-1d7bc4b56119 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1741 microversion: 2.20 time: 0.933071 Mar 08 14:53:39.449372 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 178/341] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:53:38 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1741 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:53:39.680181 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-7be64f2f-6d99-441f-b4b5-acf264448836 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:39.694528 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-7be64f2f-6d99-441f-b4b5-acf264448836 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1568 microversion: 2.1 time: 0.525337 Mar 08 14:53:39.706267 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 164/342] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:39 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1568 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:40.468617 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-4d0b301d-d255-4c1f-a255-2cd468f40bd2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:40.469220 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-4d0b301d-d255-4c1f-a255-2cd468f40bd2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:40.480769 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4d0b301d-d255-4c1f-a255-2cd468f40bd2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:40.481229 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4d0b301d-d255-4c1f-a255-2cd468f40bd2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:40.482070 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4d0b301d-d255-4c1f-a255-2cd468f40bd2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:40.488979 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4d0b301d-d255-4c1f-a255-2cd468f40bd2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:40.718906 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-590edc37-5e8d-4df8-b696-913724120c31 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:40.720144 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-590edc37-5e8d-4df8-b696-913724120c31 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:40.728780 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-590edc37-5e8d-4df8-b696-913724120c31 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:40.729479 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-590edc37-5e8d-4df8-b696-913724120c31 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:40.730456 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-590edc37-5e8d-4df8-b696-913724120c31 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:40.731049 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-590edc37-5e8d-4df8-b696-913724120c31 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:41.311551 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-4d0b301d-d255-4c1f-a255-2cd468f40bd2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:41.325647 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-4d0b301d-d255-4c1f-a255-2cd468f40bd2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:41.331980 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-4d0b301d-d255-4c1f-a255-2cd468f40bd2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:41.335000 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-4d0b301d-d255-4c1f-a255-2cd468f40bd2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1741 microversion: 2.20 time: 0.870202 Mar 08 14:53:41.354945 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 179/343] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:53:40 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1741 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:53:41.364972 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-590edc37-5e8d-4df8-b696-913724120c31 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:41.369130 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-ce7fd39a-46f4-4758-bb9b-4f30f0d2c7ae tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5ac49fd8-a5ff-4fc8-995c-fc15f7087d3c", "device": "/dev/sdb"}} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:53:41.373046 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-590edc37-5e8d-4df8-b696-913724120c31 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1568 microversion: 2.1 time: 0.660022 Mar 08 14:53:41.376922 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-ce7fd39a-46f4-4758-bb9b-4f30f0d2c7ae tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: 463a3a9d-f121-4ca8-81f7-d8e9be78888d] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:41.385990 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 165/344] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:40 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1568 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:41.395346 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ce7fd39a-46f4-4758-bb9b-4f30f0d2c7ae tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:41.400516 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ce7fd39a-46f4-4758-bb9b-4f30f0d2c7ae tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:41.402544 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ce7fd39a-46f4-4758-bb9b-4f30f0d2c7ae tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:41.404129 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ce7fd39a-46f4-4758-bb9b-4f30f0d2c7ae tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:41.946399 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-ce7fd39a-46f4-4758-bb9b-4f30f0d2c7ae tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "POST /compute/v2.1/servers/463a3a9d-f121-4ca8-81f7-d8e9be78888d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.580073 Mar 08 14:53:41.967203 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 180/345] 10.222.0.30 () {60 vars in 1322 bytes} [Tue Mar 8 14:53:41 2022] POST /compute/v2.1/servers/463a3a9d-f121-4ca8-81f7-d8e9be78888d/os-volume_attachments => generated 194 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:53:42.355180 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-8d98b6a5-469b-4a7b-98b7-7445d1d408aa tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:42.355772 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-8d98b6a5-469b-4a7b-98b7-7445d1d408aa tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:42.363375 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8d98b6a5-469b-4a7b-98b7-7445d1d408aa tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:42.363825 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8d98b6a5-469b-4a7b-98b7-7445d1d408aa tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:42.364598 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8d98b6a5-469b-4a7b-98b7-7445d1d408aa tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:42.365046 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8d98b6a5-469b-4a7b-98b7-7445d1d408aa tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:42.393839 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-df360d3c-7330-4d69-b5f2-232d5f657fad tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:42.395196 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-df360d3c-7330-4d69-b5f2-232d5f657fad tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:42.425309 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-df360d3c-7330-4d69-b5f2-232d5f657fad tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:42.426872 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-df360d3c-7330-4d69-b5f2-232d5f657fad tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:42.431463 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-df360d3c-7330-4d69-b5f2-232d5f657fad tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:42.434243 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-df360d3c-7330-4d69-b5f2-232d5f657fad tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:42.958030 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-df360d3c-7330-4d69-b5f2-232d5f657fad tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:42.967150 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-df360d3c-7330-4d69-b5f2-232d5f657fad tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1568 microversion: 2.1 time: 0.579840 Mar 08 14:53:42.970242 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 181/346] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:42 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1568 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:53:43.024935 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-8d98b6a5-469b-4a7b-98b7-7445d1d408aa tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:43.039687 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-8d98b6a5-469b-4a7b-98b7-7445d1d408aa tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:43.045746 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-8d98b6a5-469b-4a7b-98b7-7445d1d408aa tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:43.050328 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-8d98b6a5-469b-4a7b-98b7-7445d1d408aa tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1741 microversion: 2.20 time: 0.698801 Mar 08 14:53:43.062730 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 166/347] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:53:42 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1741 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:53:43.991969 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-6d766122-af61-40c8-8160-ec0dffc0928b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:43.992574 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-6d766122-af61-40c8-8160-ec0dffc0928b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:44.004227 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6d766122-af61-40c8-8160-ec0dffc0928b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:44.004903 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6d766122-af61-40c8-8160-ec0dffc0928b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:44.005907 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6d766122-af61-40c8-8160-ec0dffc0928b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:44.020556 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6d766122-af61-40c8-8160-ec0dffc0928b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:44.068779 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-82c40b32-141f-47d9-b4b3-ad4e315d9d54 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:44.069384 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-82c40b32-141f-47d9-b4b3-ad4e315d9d54 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:44.088555 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-82c40b32-141f-47d9-b4b3-ad4e315d9d54 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:44.090598 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-82c40b32-141f-47d9-b4b3-ad4e315d9d54 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:44.094386 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-82c40b32-141f-47d9-b4b3-ad4e315d9d54 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:44.100406 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-82c40b32-141f-47d9-b4b3-ad4e315d9d54 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:44.675583 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-82c40b32-141f-47d9-b4b3-ad4e315d9d54 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:44.694147 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-82c40b32-141f-47d9-b4b3-ad4e315d9d54 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:44.695935 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-82c40b32-141f-47d9-b4b3-ad4e315d9d54 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:44.697023 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-82c40b32-141f-47d9-b4b3-ad4e315d9d54 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1741 microversion: 2.20 time: 0.632159 Mar 08 14:53:44.710785 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 167/348] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:53:44 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1741 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 14:53:45.723663 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-89368e75-5c45-4b08-a4b6-2a2cca257688 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:45.724956 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-89368e75-5c45-4b08-a4b6-2a2cca257688 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:45.735890 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-89368e75-5c45-4b08-a4b6-2a2cca257688 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:45.740136 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-89368e75-5c45-4b08-a4b6-2a2cca257688 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:45.742944 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-89368e75-5c45-4b08-a4b6-2a2cca257688 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:45.744382 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-89368e75-5c45-4b08-a4b6-2a2cca257688 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:45.992576 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-6d766122-af61-40c8-8160-ec0dffc0928b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:46.014147 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-6d766122-af61-40c8-8160-ec0dffc0928b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1568 microversion: 2.1 time: 2.026712 Mar 08 14:53:46.022013 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 182/349] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:43 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1568 bytes in 2039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:46.306757 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-89368e75-5c45-4b08-a4b6-2a2cca257688 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:46.320678 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-89368e75-5c45-4b08-a4b6-2a2cca257688 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:46.332017 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-89368e75-5c45-4b08-a4b6-2a2cca257688 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:46.333305 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-89368e75-5c45-4b08-a4b6-2a2cca257688 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1741 microversion: 2.20 time: 0.614314 Mar 08 14:53:46.345510 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 168/350] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:53:45 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1741 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 14:53:47.034922 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-31bd50d3-189e-4968-aea7-35cbef15cd03 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:47.035836 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-31bd50d3-189e-4968-aea7-35cbef15cd03 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:47.056248 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-31bd50d3-189e-4968-aea7-35cbef15cd03 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:47.056707 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-31bd50d3-189e-4968-aea7-35cbef15cd03 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:47.057496 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-31bd50d3-189e-4968-aea7-35cbef15cd03 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:47.057954 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-31bd50d3-189e-4968-aea7-35cbef15cd03 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:47.353894 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-6b2eeb21-e6be-47d7-85e3-52c8b9fa8d2d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:47.355112 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-6b2eeb21-e6be-47d7-85e3-52c8b9fa8d2d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:47.372098 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6b2eeb21-e6be-47d7-85e3-52c8b9fa8d2d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:47.388322 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6b2eeb21-e6be-47d7-85e3-52c8b9fa8d2d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:47.394450 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6b2eeb21-e6be-47d7-85e3-52c8b9fa8d2d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:47.395164 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6b2eeb21-e6be-47d7-85e3-52c8b9fa8d2d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:47.671426 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-31bd50d3-189e-4968-aea7-35cbef15cd03 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:47.696499 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-31bd50d3-189e-4968-aea7-35cbef15cd03 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1568 microversion: 2.1 time: 0.667686 Mar 08 14:53:47.702244 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 183/351] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:47 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1568 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:47.841992 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-6b2eeb21-e6be-47d7-85e3-52c8b9fa8d2d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:47.862891 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-6b2eeb21-e6be-47d7-85e3-52c8b9fa8d2d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:47.870140 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-6b2eeb21-e6be-47d7-85e3-52c8b9fa8d2d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:47.871369 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-6b2eeb21-e6be-47d7-85e3-52c8b9fa8d2d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1741 microversion: 2.20 time: 0.522412 Mar 08 14:53:47.871935 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 169/352] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:53:47 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1741 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:53:48.720421 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-3fd82e60-7ad2-4769-9899-cb60912e1594 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:48.721698 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-3fd82e60-7ad2-4769-9899-cb60912e1594 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:48.750927 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3fd82e60-7ad2-4769-9899-cb60912e1594 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:48.760796 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3fd82e60-7ad2-4769-9899-cb60912e1594 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:48.764421 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3fd82e60-7ad2-4769-9899-cb60912e1594 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:48.767684 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3fd82e60-7ad2-4769-9899-cb60912e1594 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:48.895598 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c81e600b-720f-4223-ae53-96a025bfd866 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:48.897001 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-c81e600b-720f-4223-ae53-96a025bfd866 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:48.965598 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c81e600b-720f-4223-ae53-96a025bfd866 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:48.968517 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c81e600b-720f-4223-ae53-96a025bfd866 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:48.969418 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c81e600b-720f-4223-ae53-96a025bfd866 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:48.978509 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c81e600b-720f-4223-ae53-96a025bfd866 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:49.702687 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-c81e600b-720f-4223-ae53-96a025bfd866 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:49.720332 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-c81e600b-720f-4223-ae53-96a025bfd866 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:49.727179 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-c81e600b-720f-4223-ae53-96a025bfd866 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:49.738688 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-c81e600b-720f-4223-ae53-96a025bfd866 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1741 microversion: 2.20 time: 0.849906 Mar 08 14:53:49.740673 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-3fd82e60-7ad2-4769-9899-cb60912e1594 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:49.749186 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 170/353] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:53:48 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1741 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:53:49.753549 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-3fd82e60-7ad2-4769-9899-cb60912e1594 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1568 microversion: 2.1 time: 1.038521 Mar 08 14:53:49.762395 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 184/354] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:48 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1568 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:50.781875 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-94737a68-17d6-4bc6-a885-bcf144ef8221 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:50.782734 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-94737a68-17d6-4bc6-a885-bcf144ef8221 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:50.788031 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-367e69a8-1e60-424a-9766-3cc67323e10a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:50.790199 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-367e69a8-1e60-424a-9766-3cc67323e10a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:50.791747 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-94737a68-17d6-4bc6-a885-bcf144ef8221 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:50.792298 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-94737a68-17d6-4bc6-a885-bcf144ef8221 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:50.793205 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-94737a68-17d6-4bc6-a885-bcf144ef8221 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:50.793883 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-94737a68-17d6-4bc6-a885-bcf144ef8221 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:50.823340 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-367e69a8-1e60-424a-9766-3cc67323e10a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:50.825183 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-367e69a8-1e60-424a-9766-3cc67323e10a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:50.827394 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-367e69a8-1e60-424a-9766-3cc67323e10a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:50.828509 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-367e69a8-1e60-424a-9766-3cc67323e10a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:51.161054 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-94737a68-17d6-4bc6-a885-bcf144ef8221 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:51.171441 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-94737a68-17d6-4bc6-a885-bcf144ef8221 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1568 microversion: 2.1 time: 0.399199 Mar 08 14:53:51.178317 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 171/355] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:50 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1568 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:51.387281 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-367e69a8-1e60-424a-9766-3cc67323e10a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:51.399375 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-367e69a8-1e60-424a-9766-3cc67323e10a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:51.405035 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-367e69a8-1e60-424a-9766-3cc67323e10a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:51.409489 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-367e69a8-1e60-424a-9766-3cc67323e10a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1741 microversion: 2.20 time: 0.632310 Mar 08 14:53:51.415293 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 185/356] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:53:50 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1741 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:53:52.189008 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b1767712-66cf-40f0-b4cc-1f129d0ec3a4 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:52.189623 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b1767712-66cf-40f0-b4cc-1f129d0ec3a4 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:52.208364 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b1767712-66cf-40f0-b4cc-1f129d0ec3a4 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:52.211409 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b1767712-66cf-40f0-b4cc-1f129d0ec3a4 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:52.214755 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b1767712-66cf-40f0-b4cc-1f129d0ec3a4 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:52.218107 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b1767712-66cf-40f0-b4cc-1f129d0ec3a4 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:52.432894 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-47a555fe-2aa3-40bc-b714-c0163f3f56d0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:52.433595 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-47a555fe-2aa3-40bc-b714-c0163f3f56d0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:52.445348 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-47a555fe-2aa3-40bc-b714-c0163f3f56d0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:52.445805 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-47a555fe-2aa3-40bc-b714-c0163f3f56d0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:52.456519 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-47a555fe-2aa3-40bc-b714-c0163f3f56d0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:52.458062 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-47a555fe-2aa3-40bc-b714-c0163f3f56d0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:52.786831 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-47a555fe-2aa3-40bc-b714-c0163f3f56d0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:52.800378 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-47a555fe-2aa3-40bc-b714-c0163f3f56d0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:52.807552 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-47a555fe-2aa3-40bc-b714-c0163f3f56d0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:52.811287 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-47a555fe-2aa3-40bc-b714-c0163f3f56d0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1741 microversion: 2.20 time: 0.381266 Mar 08 14:53:52.811894 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 186/357] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:53:52 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1741 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 14:53:53.028141 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b1767712-66cf-40f0-b4cc-1f129d0ec3a4 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:53.046029 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b1767712-66cf-40f0-b4cc-1f129d0ec3a4 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1568 microversion: 2.1 time: 0.856855 Mar 08 14:53:53.049575 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 172/358] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:52 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1568 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:53.828652 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-0d90eee9-a876-4723-bdb0-12f0de8c4fb1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:53.829408 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-0d90eee9-a876-4723-bdb0-12f0de8c4fb1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:53.846803 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0d90eee9-a876-4723-bdb0-12f0de8c4fb1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:53.847686 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0d90eee9-a876-4723-bdb0-12f0de8c4fb1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:53.848890 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0d90eee9-a876-4723-bdb0-12f0de8c4fb1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:53.849743 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0d90eee9-a876-4723-bdb0-12f0de8c4fb1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:54.065164 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-e0e76e9a-887e-4f8d-ab6a-62ee106b939c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:54.065917 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-e0e76e9a-887e-4f8d-ab6a-62ee106b939c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:54.077298 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e0e76e9a-887e-4f8d-ab6a-62ee106b939c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:54.077298 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e0e76e9a-887e-4f8d-ab6a-62ee106b939c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:54.077298 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e0e76e9a-887e-4f8d-ab6a-62ee106b939c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:54.077298 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e0e76e9a-887e-4f8d-ab6a-62ee106b939c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:54.387031 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-0d90eee9-a876-4723-bdb0-12f0de8c4fb1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:54.395605 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-0d90eee9-a876-4723-bdb0-12f0de8c4fb1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:54.397034 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-0d90eee9-a876-4723-bdb0-12f0de8c4fb1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:54.398239 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-0d90eee9-a876-4723-bdb0-12f0de8c4fb1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1741 microversion: 2.20 time: 0.573527 Mar 08 14:53:54.398798 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 187/359] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:53:53 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1741 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:53:54.541286 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-e0e76e9a-887e-4f8d-ab6a-62ee106b939c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:54.550709 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-e0e76e9a-887e-4f8d-ab6a-62ee106b939c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1568 microversion: 2.1 time: 0.490387 Mar 08 14:53:54.553991 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 173/360] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:54 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1568 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:55.416455 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b4a4f4e3-f67d-41bc-8244-2554ef3bb228 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:55.417669 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-b4a4f4e3-f67d-41bc-8244-2554ef3bb228 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:55.428687 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b4a4f4e3-f67d-41bc-8244-2554ef3bb228 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:55.429316 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b4a4f4e3-f67d-41bc-8244-2554ef3bb228 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:55.443042 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b4a4f4e3-f67d-41bc-8244-2554ef3bb228 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:55.443744 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b4a4f4e3-f67d-41bc-8244-2554ef3bb228 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:55.571357 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d563a77b-ff27-4bf7-b7e0-e2222d307808 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:55.572809 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d563a77b-ff27-4bf7-b7e0-e2222d307808 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:55.579866 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d563a77b-ff27-4bf7-b7e0-e2222d307808 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:55.585140 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d563a77b-ff27-4bf7-b7e0-e2222d307808 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:55.588711 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d563a77b-ff27-4bf7-b7e0-e2222d307808 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:55.589403 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d563a77b-ff27-4bf7-b7e0-e2222d307808 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:55.853673 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-b4a4f4e3-f67d-41bc-8244-2554ef3bb228 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:55.865373 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-b4a4f4e3-f67d-41bc-8244-2554ef3bb228 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:55.877114 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-b4a4f4e3-f67d-41bc-8244-2554ef3bb228 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:55.878760 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-b4a4f4e3-f67d-41bc-8244-2554ef3bb228 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1723 microversion: 2.20 time: 0.466120 Mar 08 14:53:55.885286 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 188/361] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:53:55 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1723 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:53:56.485138 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d563a77b-ff27-4bf7-b7e0-e2222d307808 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:56.493964 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d563a77b-ff27-4bf7-b7e0-e2222d307808 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1568 microversion: 2.1 time: 0.926846 Mar 08 14:53:56.494564 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 174/362] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:55 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1568 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:53:56.905203 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-cf386220-079e-4c6d-9aa0-76d1b6ce01ba tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:56.908804 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-cf386220-079e-4c6d-9aa0-76d1b6ce01ba tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:56.922800 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cf386220-079e-4c6d-9aa0-76d1b6ce01ba tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:56.923570 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cf386220-079e-4c6d-9aa0-76d1b6ce01ba tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:56.925437 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cf386220-079e-4c6d-9aa0-76d1b6ce01ba tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:56.926110 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cf386220-079e-4c6d-9aa0-76d1b6ce01ba tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:57.518030 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-cf386220-079e-4c6d-9aa0-76d1b6ce01ba tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:57.523859 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-a57cbf93-0eb3-42c4-ad1f-294e8d26953b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:57.530631 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-a57cbf93-0eb3-42c4-ad1f-294e8d26953b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:57.568109 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-cf386220-079e-4c6d-9aa0-76d1b6ce01ba tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:57.573973 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-cf386220-079e-4c6d-9aa0-76d1b6ce01ba tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:57.575194 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-cf386220-079e-4c6d-9aa0-76d1b6ce01ba tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1723 microversion: 2.20 time: 0.675420 Mar 08 14:53:57.578078 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a57cbf93-0eb3-42c4-ad1f-294e8d26953b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:57.578550 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a57cbf93-0eb3-42c4-ad1f-294e8d26953b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:57.580751 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a57cbf93-0eb3-42c4-ad1f-294e8d26953b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:57.581208 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a57cbf93-0eb3-42c4-ad1f-294e8d26953b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:57.586700 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 189/363] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:53:56 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1723 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:53:58.418703 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-a57cbf93-0eb3-42c4-ad1f-294e8d26953b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:58.427825 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-a57cbf93-0eb3-42c4-ad1f-294e8d26953b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1548 microversion: 2.1 time: 0.918235 Mar 08 14:53:58.439379 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 175/364] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:57 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1548 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:53:58.446986 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-8329fbe7-d524-46d8-afd6-31836288d2a2 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:58.447582 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-8329fbe7-d524-46d8-afd6-31836288d2a2 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:58.457001 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8329fbe7-d524-46d8-afd6-31836288d2a2 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:58.457465 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8329fbe7-d524-46d8-afd6-31836288d2a2 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:58.458257 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8329fbe7-d524-46d8-afd6-31836288d2a2 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:58.458713 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8329fbe7-d524-46d8-afd6-31836288d2a2 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:58.594175 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-2b885d7f-fe4e-4a88-aa22-0b1d94a6ceef tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Action: 'create', calling method: .version_select at 0x7ff35d1213a0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1546550273"}} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:53:58.656226 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-8329fbe7-d524-46d8-afd6-31836288d2a2 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] HTTP exception thrown: Cannot 'detach_volume' instance f936e19e-08fe-43d1-8c05-2fc52d3a5a67 while it is in vm_state rescued Mar 08 14:53:58.656839 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-8329fbe7-d524-46d8-afd6-31836288d2a2 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Returning 409 to user: Cannot 'detach_volume' instance f936e19e-08fe-43d1-8c05-2fc52d3a5a67 while it is in vm_state rescued {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 14:53:58.657679 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-8329fbe7-d524-46d8-afd6-31836288d2a2 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67/os-volume_attachments/961f8f94-37fd-49e6-aaf7-07f3de39cc3f" status: 409 len: 152 microversion: 2.1 time: 0.215476 Mar 08 14:53:58.658267 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 176/365] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Mar 8 14:53:58 2022] DELETE /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67/os-volume_attachments/961f8f94-37fd-49e6-aaf7-07f3de39cc3f => generated 152 bytes in 217 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Mar 08 14:53:58.660468 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.quota [None req-2b885d7f-fe4e-4a88-aa22-0b1d94a6ceef tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Getting quotas for project 6ce506c63f16445cac166f16104398cd. Resources: {'key_pairs'} {{(pid=128351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 14:53:58.671251 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.quota [None req-2b885d7f-fe4e-4a88-aa22-0b1d94a6ceef tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Getting quotas for user d5eebbc0c8574cd58c022f2cc0e9f1eb and project 6ce506c63f16445cac166f16104398cd. Resources: {'key_pairs'} {{(pid=128351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 14:53:58.671486 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-785d207b-3965-457b-b621-1af546e4eb18 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:58.671979 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-785d207b-3965-457b-b621-1af546e4eb18 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:58.686722 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-785d207b-3965-457b-b621-1af546e4eb18 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:58.687311 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-785d207b-3965-457b-b621-1af546e4eb18 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:58.687971 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-785d207b-3965-457b-b621-1af546e4eb18 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:58.688425 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-785d207b-3965-457b-b621-1af546e4eb18 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:59.535389 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-785d207b-3965-457b-b621-1af546e4eb18 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:59.559963 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-785d207b-3965-457b-b621-1af546e4eb18 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:59.567005 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-785d207b-3965-457b-b621-1af546e4eb18 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:53:59.569235 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-785d207b-3965-457b-b621-1af546e4eb18 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1723 microversion: 2.20 time: 0.902173 Mar 08 14:53:59.571982 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 177/366] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:53:58 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1723 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:53:59.586724 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d10704f7-f18e-4787-954a-a89a396205c0 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:53:59.587784 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d10704f7-f18e-4787-954a-a89a396205c0 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:59.597237 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d10704f7-f18e-4787-954a-a89a396205c0 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:59.598221 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d10704f7-f18e-4787-954a-a89a396205c0 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:59.599626 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d10704f7-f18e-4787-954a-a89a396205c0 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:59.600319 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d10704f7-f18e-4787-954a-a89a396205c0 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:59.600459 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.quota [None req-2b885d7f-fe4e-4a88-aa22-0b1d94a6ceef tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Getting quotas for project 6ce506c63f16445cac166f16104398cd. Resources: {'key_pairs'} {{(pid=128351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 14:53:59.621492 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.quota [None req-2b885d7f-fe4e-4a88-aa22-0b1d94a6ceef tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Getting quotas for user d5eebbc0c8574cd58c022f2cc0e9f1eb and project 6ce506c63f16445cac166f16104398cd. Resources: {'key_pairs'} {{(pid=128351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 14:53:59.662480 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-2b885d7f-fe4e-4a88-aa22-0b1d94a6ceef tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 1.416025 Mar 08 14:53:59.670073 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 190/367] 10.222.0.30 () {60 vars in 1157 bytes} [Tue Mar 8 14:53:58 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:53:59.680246 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [req-2c8059e9-413e-4e07-b532-0a27d8023cae req-1a260817-6b11-4af2-bdbe-8997959f4fb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b7917ad-8941-400f-ae66-d22e26633416", "name": "network-vif-unplugged", "status": "completed", "tag": "14e51cd2-ee26-4f88-bdde-048115f528a7"}]} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:53:59.708522 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-2c8059e9-413e-4e07-b532-0a27d8023cae req-1a260817-6b11-4af2-bdbe-8997959f4fb4 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:59.712792 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-2c8059e9-413e-4e07-b532-0a27d8023cae req-1a260817-6b11-4af2-bdbe-8997959f4fb4 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:59.742725 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d10704f7-f18e-4787-954a-a89a396205c0 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "POST /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67/action" status: 202 len: 0 microversion: 2.1 time: 0.163996 Mar 08 14:53:59.749909 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 178/368] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Mar 8 14:53:59 2022] POST /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 14:53:59.754757 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.compute.server_external_events [req-2c8059e9-413e-4e07-b532-0a27d8023cae req-1a260817-6b11-4af2-bdbe-8997959f4fb4 service nova] Creating event network-vif-unplugged:14e51cd2-ee26-4f88-bdde-048115f528a7 for instance 1b7917ad-8941-400f-ae66-d22e26633416 on hv-cinder-83009 Mar 08 14:53:59.767819 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-effe161f-1eec-4b54-b0ef-e4107a25041c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:53:59.768459 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [req-2c8059e9-413e-4e07-b532-0a27d8023cae req-1a260817-6b11-4af2-bdbe-8997959f4fb4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096163 Mar 08 14:53:59.769491 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-effe161f-1eec-4b54-b0ef-e4107a25041c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:53:59.780952 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-effe161f-1eec-4b54-b0ef-e4107a25041c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:59.782279 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-effe161f-1eec-4b54-b0ef-e4107a25041c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:59.783439 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-effe161f-1eec-4b54-b0ef-e4107a25041c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:53:59.784823 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-effe161f-1eec-4b54-b0ef-e4107a25041c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:53:59.800165 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 191/369] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 14:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:54:00.219713 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-effe161f-1eec-4b54-b0ef-e4107a25041c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:00.236204 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-effe161f-1eec-4b54-b0ef-e4107a25041c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1556 microversion: 2.1 time: 0.479683 Mar 08 14:54:00.237074 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 179/370] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:53:59 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1556 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:00.592703 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-0d1ee93b-1417-4906-a785-46e509398913 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:00.593604 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-0d1ee93b-1417-4906-a785-46e509398913 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:00.609937 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0d1ee93b-1417-4906-a785-46e509398913 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:00.610612 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0d1ee93b-1417-4906-a785-46e509398913 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:00.616989 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0d1ee93b-1417-4906-a785-46e509398913 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:00.617570 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0d1ee93b-1417-4906-a785-46e509398913 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:01.132908 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-0d1ee93b-1417-4906-a785-46e509398913 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:01.144995 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-0d1ee93b-1417-4906-a785-46e509398913 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:01.151832 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-0d1ee93b-1417-4906-a785-46e509398913 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:01.156078 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-0d1ee93b-1417-4906-a785-46e509398913 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1723 microversion: 2.20 time: 0.568291 Mar 08 14:54:01.157693 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 192/371] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:54:00 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1723 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:54:01.266993 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c692cb1c-692b-4437-b941-15836edb8e89 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:01.267607 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-c692cb1c-692b-4437-b941-15836edb8e89 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:01.281467 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c692cb1c-692b-4437-b941-15836edb8e89 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:01.289224 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c692cb1c-692b-4437-b941-15836edb8e89 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:01.292423 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c692cb1c-692b-4437-b941-15836edb8e89 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:01.293194 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c692cb1c-692b-4437-b941-15836edb8e89 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:01.492840 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-576c68a1-d51c-4b4d-b0a7-0d356bbc1f8a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Action: 'create', calling method: .version_select at 0x7ff35d1b15e0>, body: {"keypair": {"name": "tempest-TestShelveInstance-665506048"}} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:54:01.550718 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.quota [None req-576c68a1-d51c-4b4d-b0a7-0d356bbc1f8a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Getting quotas for project d8469a7d8671451eb029d18b67e7f76d. Resources: {'key_pairs'} {{(pid=128351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 14:54:01.563058 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.quota [None req-576c68a1-d51c-4b4d-b0a7-0d356bbc1f8a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Getting quotas for user 86a6549a475a4cbe803ab5bed1c91e51 and project d8469a7d8671451eb029d18b67e7f76d. Resources: {'key_pairs'} {{(pid=128351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 14:54:01.655782 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-c692cb1c-692b-4437-b941-15836edb8e89 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:01.673298 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-c692cb1c-692b-4437-b941-15836edb8e89 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1556 microversion: 2.1 time: 0.422083 Mar 08 14:54:01.674571 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 180/372] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:01 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1556 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:01.793430 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.quota [None req-576c68a1-d51c-4b4d-b0a7-0d356bbc1f8a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Getting quotas for project d8469a7d8671451eb029d18b67e7f76d. Resources: {'key_pairs'} {{(pid=128351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 14:54:01.806292 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.quota [None req-576c68a1-d51c-4b4d-b0a7-0d356bbc1f8a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Getting quotas for user 86a6549a475a4cbe803ab5bed1c91e51 and project d8469a7d8671451eb029d18b67e7f76d. Resources: {'key_pairs'} {{(pid=128351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 14:54:01.822967 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-576c68a1-d51c-4b4d-b0a7-0d356bbc1f8a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 0.556894 Mar 08 14:54:01.826635 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 193/373] 10.222.0.30 () {60 vars in 1157 bytes} [Tue Mar 8 14:54:01 2022] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:54:02.176311 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-58fb967c-7907-47ca-8f1c-aff352d84510 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:02.176856 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-58fb967c-7907-47ca-8f1c-aff352d84510 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:02.187086 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-58fb967c-7907-47ca-8f1c-aff352d84510 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:02.188034 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-58fb967c-7907-47ca-8f1c-aff352d84510 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:02.190173 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-58fb967c-7907-47ca-8f1c-aff352d84510 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:02.191506 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-58fb967c-7907-47ca-8f1c-aff352d84510 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:02.693125 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-35948ce8-1a77-4af8-9fed-a5d5b11c4a8c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:02.695181 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-35948ce8-1a77-4af8-9fed-a5d5b11c4a8c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:02.708772 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-35948ce8-1a77-4af8-9fed-a5d5b11c4a8c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:02.710434 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-35948ce8-1a77-4af8-9fed-a5d5b11c4a8c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:02.712146 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-35948ce8-1a77-4af8-9fed-a5d5b11c4a8c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:02.719561 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-35948ce8-1a77-4af8-9fed-a5d5b11c4a8c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:02.825157 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-58fb967c-7907-47ca-8f1c-aff352d84510 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:02.851990 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-58fb967c-7907-47ca-8f1c-aff352d84510 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:02.854140 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-58fb967c-7907-47ca-8f1c-aff352d84510 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:02.856076 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-58fb967c-7907-47ca-8f1c-aff352d84510 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1723 microversion: 2.20 time: 0.684378 Mar 08 14:54:02.859429 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 181/374] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:54:02 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1723 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:54:03.238236 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-35948ce8-1a77-4af8-9fed-a5d5b11c4a8c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:03.252551 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-35948ce8-1a77-4af8-9fed-a5d5b11c4a8c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1556 microversion: 2.1 time: 0.564453 Mar 08 14:54:03.253149 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 194/375] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:02 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1556 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:03.875545 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-be0cb406-f8d5-49af-b40a-c7d0ea70f81f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:03.876135 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-be0cb406-f8d5-49af-b40a-c7d0ea70f81f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:03.890229 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-be0cb406-f8d5-49af-b40a-c7d0ea70f81f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:03.890684 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-be0cb406-f8d5-49af-b40a-c7d0ea70f81f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:03.891475 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-be0cb406-f8d5-49af-b40a-c7d0ea70f81f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:03.891911 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-be0cb406-f8d5-49af-b40a-c7d0ea70f81f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:04.283296 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-8f2b8274-489b-4188-8565-3ce99bdfbfe9 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:04.284684 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-8f2b8274-489b-4188-8565-3ce99bdfbfe9 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:04.297376 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8f2b8274-489b-4188-8565-3ce99bdfbfe9 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:04.298838 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8f2b8274-489b-4188-8565-3ce99bdfbfe9 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:04.299875 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8f2b8274-489b-4188-8565-3ce99bdfbfe9 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:04.300531 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8f2b8274-489b-4188-8565-3ce99bdfbfe9 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:04.509901 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-be0cb406-f8d5-49af-b40a-c7d0ea70f81f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:04.524709 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-be0cb406-f8d5-49af-b40a-c7d0ea70f81f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:04.531324 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-be0cb406-f8d5-49af-b40a-c7d0ea70f81f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:04.532835 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-be0cb406-f8d5-49af-b40a-c7d0ea70f81f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1726 microversion: 2.20 time: 0.662751 Mar 08 14:54:04.534370 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 182/376] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:54:03 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1726 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:54:04.552603 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-55c48b91-8a5f-4bb4-9e46-12cc77cdd8e4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0e5d04ad-3d3f-417f-9390-ec286037e38f"}} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:54:04.564996 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-55c48b91-8a5f-4bb4-9e46-12cc77cdd8e4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:04.583225 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-55c48b91-8a5f-4bb4-9e46-12cc77cdd8e4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:04.601111 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-55c48b91-8a5f-4bb4-9e46-12cc77cdd8e4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:04.605250 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-55c48b91-8a5f-4bb4-9e46-12cc77cdd8e4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:04.608836 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-55c48b91-8a5f-4bb4-9e46-12cc77cdd8e4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:04.773260 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-8f2b8274-489b-4188-8565-3ce99bdfbfe9 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:04.787637 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-8f2b8274-489b-4188-8565-3ce99bdfbfe9 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1556 microversion: 2.1 time: 0.508728 Mar 08 14:54:04.788923 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 195/377] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:04 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1556 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:05.294211 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-55c48b91-8a5f-4bb4-9e46-12cc77cdd8e4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "POST /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.747060 Mar 08 14:54:05.298444 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 183/378] 10.222.0.30 () {62 vars in 1363 bytes} [Tue Mar 8 14:54:04 2022] POST /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 188 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:54:05.500750 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-215fefc6-05ed-44ce-b737-db7f0e88f265 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:54:05.505802 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-215fefc6-05ed-44ce-b737-db7f0e88f265 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:05.523307 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-215fefc6-05ed-44ce-b737-db7f0e88f265 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:05.523987 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-215fefc6-05ed-44ce-b737-db7f0e88f265 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:05.525164 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-215fefc6-05ed-44ce-b737-db7f0e88f265 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:05.526522 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-215fefc6-05ed-44ce-b737-db7f0e88f265 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:05.736477 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-215fefc6-05ed-44ce-b737-db7f0e88f265 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "POST /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/action" status: 202 len: 0 microversion: 2.20 time: 0.243257 Mar 08 14:54:05.741724 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 196/379] 10.222.0.30 () {62 vars in 1318 bytes} [Tue Mar 8 14:54:05 2022] POST /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 08 14:54:05.750560 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-6921e61c-6c06-4ff5-b1ca-fa5a2faab33d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:05.750667 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-6921e61c-6c06-4ff5-b1ca-fa5a2faab33d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:05.759260 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6921e61c-6c06-4ff5-b1ca-fa5a2faab33d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:05.766637 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6921e61c-6c06-4ff5-b1ca-fa5a2faab33d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:05.768021 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6921e61c-6c06-4ff5-b1ca-fa5a2faab33d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:05.768676 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6921e61c-6c06-4ff5-b1ca-fa5a2faab33d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:05.817641 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-7d8c38c1-00ff-41da-b451-7ffea539e050 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:05.818638 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-7d8c38c1-00ff-41da-b451-7ffea539e050 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:05.831948 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7d8c38c1-00ff-41da-b451-7ffea539e050 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:05.833228 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7d8c38c1-00ff-41da-b451-7ffea539e050 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:05.834337 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7d8c38c1-00ff-41da-b451-7ffea539e050 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:05.838080 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7d8c38c1-00ff-41da-b451-7ffea539e050 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:06.081951 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-7d8c38c1-00ff-41da-b451-7ffea539e050 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:06.095296 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-7d8c38c1-00ff-41da-b451-7ffea539e050 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1562 microversion: 2.1 time: 0.292707 Mar 08 14:54:06.099890 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 197/380] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:05 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1562 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:54:06.220823 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-a3999505-05a1-4c03-b1ba-3dd14eadbe23 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:06.221606 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-a3999505-05a1-4c03-b1ba-3dd14eadbe23 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:06.241545 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a3999505-05a1-4c03-b1ba-3dd14eadbe23 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:06.242330 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a3999505-05a1-4c03-b1ba-3dd14eadbe23 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:06.243349 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a3999505-05a1-4c03-b1ba-3dd14eadbe23 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:06.243954 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a3999505-05a1-4c03-b1ba-3dd14eadbe23 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:06.431421 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-6921e61c-6c06-4ff5-b1ca-fa5a2faab33d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:06.442431 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-6921e61c-6c06-4ff5-b1ca-fa5a2faab33d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:06.444341 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-6921e61c-6c06-4ff5-b1ca-fa5a2faab33d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:06.445828 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-6921e61c-6c06-4ff5-b1ca-fa5a2faab33d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1752 microversion: 2.20 time: 0.702967 Mar 08 14:54:06.446943 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 184/381] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:54:05 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1752 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:54:06.578286 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.objects.instance [None req-a3999505-05a1-4c03-b1ba-3dd14eadbe23 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lazy-loading 'services' on Instance uuid f936e19e-08fe-43d1-8c05-2fc52d3a5a67 {{(pid=128351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 14:54:06.781437 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-a3999505-05a1-4c03-b1ba-3dd14eadbe23 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67/os-volume_attachments/961f8f94-37fd-49e6-aaf7-07f3de39cc3f" status: 202 len: 0 microversion: 2.1 time: 0.568468 Mar 08 14:54:06.782705 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 198/382] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Mar 8 14:54:06 2022] DELETE /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67/os-volume_attachments/961f8f94-37fd-49e6-aaf7-07f3de39cc3f => generated 0 bytes in 571 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 08 14:54:06.791875 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-6dadd1c0-9bbe-4dbe-ac35-d36ff9aa1e1c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:06.793697 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-6dadd1c0-9bbe-4dbe-ac35-d36ff9aa1e1c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:06.851516 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b058a5ba-aed1-41ed-8236-c19795546d17 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:06.855054 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-b058a5ba-aed1-41ed-8236-c19795546d17 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: 463a3a9d-f121-4ca8-81f7-d8e9be78888d] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:06.867403 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b058a5ba-aed1-41ed-8236-c19795546d17 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:06.868215 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b058a5ba-aed1-41ed-8236-c19795546d17 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:06.869578 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6dadd1c0-9bbe-4dbe-ac35-d36ff9aa1e1c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:06.870081 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6dadd1c0-9bbe-4dbe-ac35-d36ff9aa1e1c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:06.873780 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b058a5ba-aed1-41ed-8236-c19795546d17 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:06.874801 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b058a5ba-aed1-41ed-8236-c19795546d17 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:06.878873 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6dadd1c0-9bbe-4dbe-ac35-d36ff9aa1e1c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:06.879342 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6dadd1c0-9bbe-4dbe-ac35-d36ff9aa1e1c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:06.960268 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-6dadd1c0-9bbe-4dbe-ac35-d36ff9aa1e1c tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.172453 Mar 08 14:54:06.963528 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 185/383] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:54:06 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67/os-volume_attachments => generated 197 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:54:07.023055 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.objects.instance [None req-b058a5ba-aed1-41ed-8236-c19795546d17 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lazy-loading 'services' on Instance uuid 463a3a9d-f121-4ca8-81f7-d8e9be78888d {{(pid=128351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 14:54:07.120935 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-b058a5ba-aed1-41ed-8236-c19795546d17 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "DELETE /compute/v2.1/servers/463a3a9d-f121-4ca8-81f7-d8e9be78888d/os-volume_attachments/5ac49fd8-a5ff-4fc8-995c-fc15f7087d3c" status: 202 len: 0 microversion: 2.1 time: 0.273530 Mar 08 14:54:07.128078 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 199/384] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Mar 8 14:54:06 2022] DELETE /compute/v2.1/servers/463a3a9d-f121-4ca8-81f7-d8e9be78888d/os-volume_attachments/5ac49fd8-a5ff-4fc8-995c-fc15f7087d3c => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 14:54:07.465732 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b2c1b47f-c4fc-4c51-8c50-c36ff499eb36 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:07.467707 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b2c1b47f-c4fc-4c51-8c50-c36ff499eb36 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:07.485267 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b2c1b47f-c4fc-4c51-8c50-c36ff499eb36 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:07.486036 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b2c1b47f-c4fc-4c51-8c50-c36ff499eb36 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:07.487008 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b2c1b47f-c4fc-4c51-8c50-c36ff499eb36 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:07.491625 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b2c1b47f-c4fc-4c51-8c50-c36ff499eb36 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:07.862180 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b2c1b47f-c4fc-4c51-8c50-c36ff499eb36 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:07.883084 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b2c1b47f-c4fc-4c51-8c50-c36ff499eb36 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:07.903559 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b2c1b47f-c4fc-4c51-8c50-c36ff499eb36 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:07.907306 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b2c1b47f-c4fc-4c51-8c50-c36ff499eb36 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1752 microversion: 2.20 time: 0.445479 Mar 08 14:54:07.910475 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 186/385] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:54:07 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1752 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:54:07.977966 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-f6d41d25-47a3-478e-99fa-23e6a83d72ea tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:07.979726 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-f6d41d25-47a3-478e-99fa-23e6a83d72ea tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:07.993465 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f6d41d25-47a3-478e-99fa-23e6a83d72ea tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:07.996847 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f6d41d25-47a3-478e-99fa-23e6a83d72ea tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:07.999091 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f6d41d25-47a3-478e-99fa-23e6a83d72ea tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:07.999797 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f6d41d25-47a3-478e-99fa-23e6a83d72ea tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:08.040620 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-f6d41d25-47a3-478e-99fa-23e6a83d72ea tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.068710 Mar 08 14:54:08.048291 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 200/386] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:54:07 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 08 14:54:08.928446 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-2216aa50-32d4-4a5a-949a-8a3f7c43f9de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:08.931512 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-2216aa50-32d4-4a5a-949a-8a3f7c43f9de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:08.940934 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2216aa50-32d4-4a5a-949a-8a3f7c43f9de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:08.941740 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2216aa50-32d4-4a5a-949a-8a3f7c43f9de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:08.943057 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2216aa50-32d4-4a5a-949a-8a3f7c43f9de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:08.943712 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2216aa50-32d4-4a5a-949a-8a3f7c43f9de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:09.237244 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-2216aa50-32d4-4a5a-949a-8a3f7c43f9de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:09.258203 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-2216aa50-32d4-4a5a-949a-8a3f7c43f9de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:09.260143 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-2216aa50-32d4-4a5a-949a-8a3f7c43f9de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:09.261788 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-2216aa50-32d4-4a5a-949a-8a3f7c43f9de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1752 microversion: 2.20 time: 0.337165 Mar 08 14:54:09.263186 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 187/387] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:54:08 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1752 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:54:09.433299 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-ce1350cc-3a13-4078-9dbc-68cc4b0ada4a tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:09.433844 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-ce1350cc-3a13-4078-9dbc-68cc4b0ada4a tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: 463a3a9d-f121-4ca8-81f7-d8e9be78888d] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:09.443647 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ce1350cc-3a13-4078-9dbc-68cc4b0ada4a tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:09.453442 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ce1350cc-3a13-4078-9dbc-68cc4b0ada4a tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:09.458319 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ce1350cc-3a13-4078-9dbc-68cc4b0ada4a tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:09.458796 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ce1350cc-3a13-4078-9dbc-68cc4b0ada4a tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:09.577322 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-ce1350cc-3a13-4078-9dbc-68cc4b0ada4a tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: 463a3a9d-f121-4ca8-81f7-d8e9be78888d] Going to try to terminate instance {{(pid=128351) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 14:54:09.907926 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-ce1350cc-3a13-4078-9dbc-68cc4b0ada4a tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "DELETE /compute/v2.1/servers/463a3a9d-f121-4ca8-81f7-d8e9be78888d" status: 204 len: 0 microversion: 2.1 time: 0.478082 Mar 08 14:54:09.910777 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 201/388] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 14:54:09 2022] DELETE /compute/v2.1/servers/463a3a9d-f121-4ca8-81f7-d8e9be78888d => generated 0 bytes in 481 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 14:54:09.919968 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-e00f1c28-fa3e-4712-8d1b-ebc5cee02e56 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:09.920649 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-e00f1c28-fa3e-4712-8d1b-ebc5cee02e56 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: 463a3a9d-f121-4ca8-81f7-d8e9be78888d] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:09.931261 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e00f1c28-fa3e-4712-8d1b-ebc5cee02e56 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:09.940712 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e00f1c28-fa3e-4712-8d1b-ebc5cee02e56 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:09.946711 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e00f1c28-fa3e-4712-8d1b-ebc5cee02e56 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:09.947713 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e00f1c28-fa3e-4712-8d1b-ebc5cee02e56 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:10.206450 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-e00f1c28-fa3e-4712-8d1b-ebc5cee02e56 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d080fb7bd6049dea53fe1912d46b11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53fd1057c44dffb358b098d5f190fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:10.224762 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-e00f1c28-fa3e-4712-8d1b-ebc5cee02e56 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "GET /compute/v2.1/servers/463a3a9d-f121-4ca8-81f7-d8e9be78888d" status: 200 len: 1514 microversion: 2.1 time: 0.307189 Mar 08 14:54:10.236994 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 188/389] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:09 2022] GET /compute/v2.1/servers/463a3a9d-f121-4ca8-81f7-d8e9be78888d => generated 1514 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:10.281270 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-60bf6552-1da1-44ff-a6dd-bb0993cff2f3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:10.282593 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-60bf6552-1da1-44ff-a6dd-bb0993cff2f3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:10.293391 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-60bf6552-1da1-44ff-a6dd-bb0993cff2f3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:10.293843 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-60bf6552-1da1-44ff-a6dd-bb0993cff2f3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:10.294691 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-60bf6552-1da1-44ff-a6dd-bb0993cff2f3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:10.295130 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-60bf6552-1da1-44ff-a6dd-bb0993cff2f3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:10.502995 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-60bf6552-1da1-44ff-a6dd-bb0993cff2f3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:10.515690 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-60bf6552-1da1-44ff-a6dd-bb0993cff2f3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:10.517547 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-60bf6552-1da1-44ff-a6dd-bb0993cff2f3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:10.518764 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-60bf6552-1da1-44ff-a6dd-bb0993cff2f3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1752 microversion: 2.20 time: 0.242027 Mar 08 14:54:10.519660 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 202/390] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:54:10 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1752 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:54:10.903805 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-64bb2b33-6da8-4294-a8ee-4f4cce272d6a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:10.907553 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-64bb2b33-6da8-4294-a8ee-4f4cce272d6a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:10.929788 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-64bb2b33-6da8-4294-a8ee-4f4cce272d6a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:10.930464 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-64bb2b33-6da8-4294-a8ee-4f4cce272d6a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:10.931363 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-64bb2b33-6da8-4294-a8ee-4f4cce272d6a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:10.932493 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-64bb2b33-6da8-4294-a8ee-4f4cce272d6a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:10.980838 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-64bb2b33-6da8-4294-a8ee-4f4cce272d6a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Going to try to terminate instance {{(pid=128352) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 14:54:11.149357 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-64bb2b33-6da8-4294-a8ee-4f4cce272d6a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 204 len: 0 microversion: 2.1 time: 0.249983 Mar 08 14:54:11.150061 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 189/391] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 14:54:10 2022] DELETE /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 14:54:11.158919 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-32219dd3-a4ba-4608-866b-4b35e3ff9f43 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:11.159538 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-32219dd3-a4ba-4608-866b-4b35e3ff9f43 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:11.189673 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-32219dd3-a4ba-4608-866b-4b35e3ff9f43 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:11.190186 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-32219dd3-a4ba-4608-866b-4b35e3ff9f43 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:11.190989 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-32219dd3-a4ba-4608-866b-4b35e3ff9f43 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:11.191913 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-32219dd3-a4ba-4608-866b-4b35e3ff9f43 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:11.243915 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5b65d6cd-f87c-4378-b388-996014d14408 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:11.244610 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5b65d6cd-f87c-4378-b388-996014d14408 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: 463a3a9d-f121-4ca8-81f7-d8e9be78888d] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:11.265186 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5b65d6cd-f87c-4378-b388-996014d14408 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:11.265686 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5b65d6cd-f87c-4378-b388-996014d14408 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:11.270845 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5b65d6cd-f87c-4378-b388-996014d14408 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:11.271684 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5b65d6cd-f87c-4378-b388-996014d14408 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:11.493848 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-32219dd3-a4ba-4608-866b-4b35e3ff9f43 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:11.502771 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-32219dd3-a4ba-4608-866b-4b35e3ff9f43 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1509 microversion: 2.1 time: 0.347723 Mar 08 14:54:11.505811 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 203/392] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:11 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1509 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:11.516237 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-5b65d6cd-f87c-4378-b388-996014d14408 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d080fb7bd6049dea53fe1912d46b11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53fd1057c44dffb358b098d5f190fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:11.525161 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5b65d6cd-f87c-4378-b388-996014d14408 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "GET /compute/v2.1/servers/463a3a9d-f121-4ca8-81f7-d8e9be78888d" status: 200 len: 1514 microversion: 2.1 time: 0.285847 Mar 08 14:54:11.539072 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-1f7d19d7-8b46-4caa-91be-c9e5963b9f81 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:11.541906 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 190/393] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:11 2022] GET /compute/v2.1/servers/463a3a9d-f121-4ca8-81f7-d8e9be78888d => generated 1514 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:11.543895 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-1f7d19d7-8b46-4caa-91be-c9e5963b9f81 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:11.551284 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1f7d19d7-8b46-4caa-91be-c9e5963b9f81 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:11.552037 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1f7d19d7-8b46-4caa-91be-c9e5963b9f81 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:11.553017 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1f7d19d7-8b46-4caa-91be-c9e5963b9f81 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:11.554294 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1f7d19d7-8b46-4caa-91be-c9e5963b9f81 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:11.775283 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-1f7d19d7-8b46-4caa-91be-c9e5963b9f81 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:11.795151 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-1f7d19d7-8b46-4caa-91be-c9e5963b9f81 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:11.796666 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-1f7d19d7-8b46-4caa-91be-c9e5963b9f81 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:11.797841 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-1f7d19d7-8b46-4caa-91be-c9e5963b9f81 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1752 microversion: 2.20 time: 0.262750 Mar 08 14:54:11.802154 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 204/394] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:54:11 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1752 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:54:12.523151 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-fdb6500d-8e83-47b7-8536-10c6980c5636 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:12.523764 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-fdb6500d-8e83-47b7-8536-10c6980c5636 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:12.535866 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fdb6500d-8e83-47b7-8536-10c6980c5636 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:12.536545 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fdb6500d-8e83-47b7-8536-10c6980c5636 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:12.537362 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fdb6500d-8e83-47b7-8536-10c6980c5636 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:12.545467 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-a37b5bd0-15b1-4e96-af63-56b7219b0568 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:12.547571 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-a37b5bd0-15b1-4e96-af63-56b7219b0568 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: 463a3a9d-f121-4ca8-81f7-d8e9be78888d] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:12.558092 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fdb6500d-8e83-47b7-8536-10c6980c5636 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:12.566493 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a37b5bd0-15b1-4e96-af63-56b7219b0568 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:12.567542 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a37b5bd0-15b1-4e96-af63-56b7219b0568 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:12.570769 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a37b5bd0-15b1-4e96-af63-56b7219b0568 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:12.571222 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a37b5bd0-15b1-4e96-af63-56b7219b0568 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:12.693808 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-a37b5bd0-15b1-4e96-af63-56b7219b0568 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d080fb7bd6049dea53fe1912d46b11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53fd1057c44dffb358b098d5f190fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:12.709132 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-a37b5bd0-15b1-4e96-af63-56b7219b0568 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "GET /compute/v2.1/servers/463a3a9d-f121-4ca8-81f7-d8e9be78888d" status: 200 len: 1472 microversion: 2.1 time: 0.168031 Mar 08 14:54:12.709750 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 205/395] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:12 2022] GET /compute/v2.1/servers/463a3a9d-f121-4ca8-81f7-d8e9be78888d => generated 1472 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:12.722781 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [req-003c2175-6a8c-4cda-bd9f-891e95240fa4 req-39620c3a-87bd-4f17-bf3b-de126ea31e06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "463a3a9d-f121-4ca8-81f7-d8e9be78888d", "name": "network-vif-deleted", "tag": "d493f362-caab-4ded-95a0-670d3d821f36"}]} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:54:12.746816 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-003c2175-6a8c-4cda-bd9f-891e95240fa4 req-39620c3a-87bd-4f17-bf3b-de126ea31e06 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:12.749555 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-003c2175-6a8c-4cda-bd9f-891e95240fa4 req-39620c3a-87bd-4f17-bf3b-de126ea31e06 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:12.779396 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.compute.server_external_events [req-003c2175-6a8c-4cda-bd9f-891e95240fa4 req-39620c3a-87bd-4f17-bf3b-de126ea31e06 service nova] Creating event network-vif-deleted:d493f362-caab-4ded-95a0-670d3d821f36 for instance 463a3a9d-f121-4ca8-81f7-d8e9be78888d on hv-cinder-83009 Mar 08 14:54:12.788138 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [req-003c2175-6a8c-4cda-bd9f-891e95240fa4 req-39620c3a-87bd-4f17-bf3b-de126ea31e06 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075106 Mar 08 14:54:12.792360 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 206/396] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 14:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:54:12.820128 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-12d3d4d2-1669-4e1b-aa6f-2984bf9e4605 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:12.821160 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-12d3d4d2-1669-4e1b-aa6f-2984bf9e4605 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:12.828482 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-12d3d4d2-1669-4e1b-aa6f-2984bf9e4605 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:12.829232 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-12d3d4d2-1669-4e1b-aa6f-2984bf9e4605 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:12.830281 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-12d3d4d2-1669-4e1b-aa6f-2984bf9e4605 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:12.830930 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-12d3d4d2-1669-4e1b-aa6f-2984bf9e4605 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:12.839787 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-fdb6500d-8e83-47b7-8536-10c6980c5636 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:12.850006 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-fdb6500d-8e83-47b7-8536-10c6980c5636 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1509 microversion: 2.1 time: 0.330894 Mar 08 14:54:12.852169 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 191/397] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:12 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1509 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:13.007115 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-12d3d4d2-1669-4e1b-aa6f-2984bf9e4605 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:13.019066 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-12d3d4d2-1669-4e1b-aa6f-2984bf9e4605 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:13.020619 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-12d3d4d2-1669-4e1b-aa6f-2984bf9e4605 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:13.026888 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-12d3d4d2-1669-4e1b-aa6f-2984bf9e4605 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1752 microversion: 2.20 time: 0.211986 Mar 08 14:54:13.027672 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 207/398] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:54:12 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1752 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 14:54:13.727383 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-db052ea4-5763-478f-a069-badb009c8961 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:13.728721 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-db052ea4-5763-478f-a069-badb009c8961 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: 463a3a9d-f121-4ca8-81f7-d8e9be78888d] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:13.735391 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-db052ea4-5763-478f-a069-badb009c8961 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:13.736179 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-db052ea4-5763-478f-a069-badb009c8961 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:13.737178 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-db052ea4-5763-478f-a069-badb009c8961 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:13.737818 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-db052ea4-5763-478f-a069-badb009c8961 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:13.751939 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-db052ea4-5763-478f-a069-badb009c8961 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] HTTP exception thrown: Instance 463a3a9d-f121-4ca8-81f7-d8e9be78888d could not be found. Mar 08 14:54:13.752878 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-db052ea4-5763-478f-a069-badb009c8961 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Returning 404 to user: Instance 463a3a9d-f121-4ca8-81f7-d8e9be78888d could not be found. {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 14:54:13.753974 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-db052ea4-5763-478f-a069-badb009c8961 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "GET /compute/v2.1/servers/463a3a9d-f121-4ca8-81f7-d8e9be78888d" status: 404 len: 111 microversion: 2.1 time: 0.030340 Mar 08 14:54:13.758944 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 192/399] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:13 2022] GET /compute/v2.1/servers/463a3a9d-f121-4ca8-81f7-d8e9be78888d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 14:54:13.868161 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-cac9a841-8318-49d4-bcfa-83ed2e7a2ef2 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:13.868767 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-cac9a841-8318-49d4-bcfa-83ed2e7a2ef2 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:13.877630 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cac9a841-8318-49d4-bcfa-83ed2e7a2ef2 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:13.878320 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cac9a841-8318-49d4-bcfa-83ed2e7a2ef2 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:13.886191 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cac9a841-8318-49d4-bcfa-83ed2e7a2ef2 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:13.887451 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cac9a841-8318-49d4-bcfa-83ed2e7a2ef2 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:14.047589 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-8c8c39e0-37fd-4756-a7a3-e640f32eeee6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:14.048573 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-8c8c39e0-37fd-4756-a7a3-e640f32eeee6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:14.057171 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8c8c39e0-37fd-4756-a7a3-e640f32eeee6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:14.059168 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8c8c39e0-37fd-4756-a7a3-e640f32eeee6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:14.062922 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8c8c39e0-37fd-4756-a7a3-e640f32eeee6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:14.063723 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8c8c39e0-37fd-4756-a7a3-e640f32eeee6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:14.188502 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-cac9a841-8318-49d4-bcfa-83ed2e7a2ef2 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:14.198529 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-cac9a841-8318-49d4-bcfa-83ed2e7a2ef2 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1509 microversion: 2.1 time: 0.334031 Mar 08 14:54:14.202035 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 208/400] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:13 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1509 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:14.364279 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-8c8c39e0-37fd-4756-a7a3-e640f32eeee6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:14.375785 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-8c8c39e0-37fd-4756-a7a3-e640f32eeee6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:14.382335 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-8c8c39e0-37fd-4756-a7a3-e640f32eeee6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:14.389700 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-8c8c39e0-37fd-4756-a7a3-e640f32eeee6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1752 microversion: 2.20 time: 0.347375 Mar 08 14:54:14.391018 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 193/401] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:54:14 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1752 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:54:14.815262 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [req-95074046-cc15-4e98-afbf-9c848913fc79 req-39192175-a81f-4b3f-b854-05b6f3cce9be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b118641-910c-41a0-82cd-66f465d96e77", "name": "network-vif-deleted", "tag": "45194c50-df18-4d74-b8bf-5c3a8941141f"}]} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:54:14.829657 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-95074046-cc15-4e98-afbf-9c848913fc79 req-39192175-a81f-4b3f-b854-05b6f3cce9be service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:14.833641 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-95074046-cc15-4e98-afbf-9c848913fc79 req-39192175-a81f-4b3f-b854-05b6f3cce9be service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:14.857515 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.compute.server_external_events [req-95074046-cc15-4e98-afbf-9c848913fc79 req-39192175-a81f-4b3f-b854-05b6f3cce9be service nova] Creating event network-vif-deleted:45194c50-df18-4d74-b8bf-5c3a8941141f for instance 0b118641-910c-41a0-82cd-66f465d96e77 on hv-cinder-83009 Mar 08 14:54:14.863912 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [req-95074046-cc15-4e98-afbf-9c848913fc79 req-39192175-a81f-4b3f-b854-05b6f3cce9be service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052488 Mar 08 14:54:14.864703 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 209/402] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 14:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:54:15.221878 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-50ce385a-e62f-4ed9-84a3-529d1b7f1227 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:15.223428 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-50ce385a-e62f-4ed9-84a3-529d1b7f1227 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:15.238102 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-50ce385a-e62f-4ed9-84a3-529d1b7f1227 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:15.238777 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-50ce385a-e62f-4ed9-84a3-529d1b7f1227 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:15.239770 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-50ce385a-e62f-4ed9-84a3-529d1b7f1227 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:15.240349 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-50ce385a-e62f-4ed9-84a3-529d1b7f1227 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:15.373745 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-50ce385a-e62f-4ed9-84a3-529d1b7f1227 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:15.394029 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-50ce385a-e62f-4ed9-84a3-529d1b7f1227 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1467 microversion: 2.1 time: 0.181167 Mar 08 14:54:15.419382 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-4a1ac1e2-6904-46b4-8ef4-c3f73650fb57 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:15.421391 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-4a1ac1e2-6904-46b4-8ef4-c3f73650fb57 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:15.425929 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 194/403] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:15 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1467 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:54:15.432738 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4a1ac1e2-6904-46b4-8ef4-c3f73650fb57 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:15.440093 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4a1ac1e2-6904-46b4-8ef4-c3f73650fb57 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:15.441361 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4a1ac1e2-6904-46b4-8ef4-c3f73650fb57 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:15.442298 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4a1ac1e2-6904-46b4-8ef4-c3f73650fb57 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:15.753781 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-4a1ac1e2-6904-46b4-8ef4-c3f73650fb57 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:15.766639 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-4a1ac1e2-6904-46b4-8ef4-c3f73650fb57 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:15.768960 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-4a1ac1e2-6904-46b4-8ef4-c3f73650fb57 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:15.770419 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-4a1ac1e2-6904-46b4-8ef4-c3f73650fb57 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1752 microversion: 2.20 time: 0.364378 Mar 08 14:54:15.783730 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 210/404] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:54:15 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1752 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:54:16.412738 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-92196f42-1fd8-4ffc-94db-a4a0a8120707 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:16.414047 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-92196f42-1fd8-4ffc-94db-a4a0a8120707 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:16.428433 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-92196f42-1fd8-4ffc-94db-a4a0a8120707 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:16.430051 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-92196f42-1fd8-4ffc-94db-a4a0a8120707 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:16.430977 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-92196f42-1fd8-4ffc-94db-a4a0a8120707 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:16.442121 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-92196f42-1fd8-4ffc-94db-a4a0a8120707 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:16.513547 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-92196f42-1fd8-4ffc-94db-a4a0a8120707 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:16.522427 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-92196f42-1fd8-4ffc-94db-a4a0a8120707 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1293 microversion: 2.1 time: 0.114229 Mar 08 14:54:16.523126 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 195/405] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:16 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1293 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:16.788545 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-6aa366fd-5009-4fea-b520-577d427b118e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:16.789894 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-6aa366fd-5009-4fea-b520-577d427b118e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:16.799345 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6aa366fd-5009-4fea-b520-577d427b118e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:16.801252 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6aa366fd-5009-4fea-b520-577d427b118e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:16.802330 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6aa366fd-5009-4fea-b520-577d427b118e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:16.802973 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6aa366fd-5009-4fea-b520-577d427b118e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:16.980312 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-6aa366fd-5009-4fea-b520-577d427b118e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:17.011207 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-6aa366fd-5009-4fea-b520-577d427b118e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:17.013269 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-6aa366fd-5009-4fea-b520-577d427b118e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:17.014280 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-6aa366fd-5009-4fea-b520-577d427b118e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1752 microversion: 2.20 time: 0.229666 Mar 08 14:54:17.024720 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 211/406] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:54:16 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1752 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:54:17.550729 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-985f26f3-440f-4ff6-a733-529e1447d2b8 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:17.551577 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-985f26f3-440f-4ff6-a733-529e1447d2b8 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:17.569459 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-985f26f3-440f-4ff6-a733-529e1447d2b8 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:17.569942 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-985f26f3-440f-4ff6-a733-529e1447d2b8 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:17.570745 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-985f26f3-440f-4ff6-a733-529e1447d2b8 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:17.571192 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-985f26f3-440f-4ff6-a733-529e1447d2b8 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:17.671955 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-985f26f3-440f-4ff6-a733-529e1447d2b8 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:17.674407 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-985f26f3-440f-4ff6-a733-529e1447d2b8 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:17.676336 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.objects.instance [None req-985f26f3-440f-4ff6-a733-529e1447d2b8 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lazy-loading 'fault' on Instance uuid 0b118641-910c-41a0-82cd-66f465d96e77 {{(pid=128352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 14:54:17.795828 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-985f26f3-440f-4ff6-a733-529e1447d2b8 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:17.805493 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-985f26f3-440f-4ff6-a733-529e1447d2b8 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 200 len: 1312 microversion: 2.1 time: 0.267139 Mar 08 14:54:17.806398 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 196/407] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:17 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 1312 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:18.033879 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-3f1e6865-6d94-4cad-bfb3-ba27b39e12dd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:18.035115 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-3f1e6865-6d94-4cad-bfb3-ba27b39e12dd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:18.047635 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3f1e6865-6d94-4cad-bfb3-ba27b39e12dd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:18.049912 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3f1e6865-6d94-4cad-bfb3-ba27b39e12dd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:18.051760 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3f1e6865-6d94-4cad-bfb3-ba27b39e12dd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:18.052212 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3f1e6865-6d94-4cad-bfb3-ba27b39e12dd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:18.229015 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-3f1e6865-6d94-4cad-bfb3-ba27b39e12dd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:18.237684 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-3f1e6865-6d94-4cad-bfb3-ba27b39e12dd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:18.246611 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-3f1e6865-6d94-4cad-bfb3-ba27b39e12dd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:18.248377 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-3f1e6865-6d94-4cad-bfb3-ba27b39e12dd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1754 microversion: 2.20 time: 0.219920 Mar 08 14:54:18.248936 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 212/408] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:54:18 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1754 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:54:18.826647 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-4ab08895-7003-47f5-880e-817c54322613 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:18.827539 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-4ab08895-7003-47f5-880e-817c54322613 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: 0b118641-910c-41a0-82cd-66f465d96e77] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:18.842583 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4ab08895-7003-47f5-880e-817c54322613 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:18.843267 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4ab08895-7003-47f5-880e-817c54322613 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:18.844849 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4ab08895-7003-47f5-880e-817c54322613 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:18.845299 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4ab08895-7003-47f5-880e-817c54322613 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:18.882612 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-4ab08895-7003-47f5-880e-817c54322613 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] HTTP exception thrown: Instance 0b118641-910c-41a0-82cd-66f465d96e77 could not be found. Mar 08 14:54:18.883356 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-4ab08895-7003-47f5-880e-817c54322613 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Returning 404 to user: Instance 0b118641-910c-41a0-82cd-66f465d96e77 could not be found. {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 14:54:18.884386 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-4ab08895-7003-47f5-880e-817c54322613 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77" status: 404 len: 111 microversion: 2.1 time: 0.065888 Mar 08 14:54:18.889474 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 197/409] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:18 2022] GET /compute/v2.1/servers/0b118641-910c-41a0-82cd-66f465d96e77 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 14:54:18.894730 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b4ca1917-ad6a-48da-ba78-a787b67f95f4 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:18.895513 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-b4ca1917-ad6a-48da-ba78-a787b67f95f4 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:18.902058 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b4ca1917-ad6a-48da-ba78-a787b67f95f4 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:18.902892 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b4ca1917-ad6a-48da-ba78-a787b67f95f4 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:18.905580 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b4ca1917-ad6a-48da-ba78-a787b67f95f4 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:18.910563 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b4ca1917-ad6a-48da-ba78-a787b67f95f4 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:18.943182 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-b4ca1917-ad6a-48da-ba78-a787b67f95f4 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Going to try to terminate instance {{(pid=128351) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 14:54:19.065629 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-b4ca1917-ad6a-48da-ba78-a787b67f95f4 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 204 len: 0 microversion: 2.1 time: 0.174598 Mar 08 14:54:19.072654 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 213/410] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 14:54:18 2022] DELETE /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 08 14:54:19.080030 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c0904545-189c-4bb2-8eb6-b4b41a293911 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:19.080672 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-c0904545-189c-4bb2-8eb6-b4b41a293911 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:19.090510 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c0904545-189c-4bb2-8eb6-b4b41a293911 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:19.091268 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c0904545-189c-4bb2-8eb6-b4b41a293911 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:19.094627 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c0904545-189c-4bb2-8eb6-b4b41a293911 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:19.096777 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c0904545-189c-4bb2-8eb6-b4b41a293911 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:19.275470 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-a2f2240e-b01b-40e0-ae82-e1f789603bcd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:19.276187 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-a2f2240e-b01b-40e0-ae82-e1f789603bcd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:19.285322 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a2f2240e-b01b-40e0-ae82-e1f789603bcd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:19.285789 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a2f2240e-b01b-40e0-ae82-e1f789603bcd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:19.286612 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a2f2240e-b01b-40e0-ae82-e1f789603bcd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:19.290754 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a2f2240e-b01b-40e0-ae82-e1f789603bcd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:19.461882 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-c0904545-189c-4bb2-8eb6-b4b41a293911 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:19.475678 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-c0904545-189c-4bb2-8eb6-b4b41a293911 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1522 microversion: 2.1 time: 0.401560 Mar 08 14:54:19.476870 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 198/411] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:19 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1522 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:19.546255 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-a2f2240e-b01b-40e0-ae82-e1f789603bcd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:19.557701 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-a2f2240e-b01b-40e0-ae82-e1f789603bcd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:19.560373 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-a2f2240e-b01b-40e0-ae82-e1f789603bcd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:19.561759 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-a2f2240e-b01b-40e0-ae82-e1f789603bcd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1810 microversion: 2.20 time: 0.292844 Mar 08 14:54:19.562952 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 214/412] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:54:19 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1810 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:54:20.160275 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-e25466ed-03fd-4650-970c-18dda12ea6cf tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Action: 'create', calling method: .version_select at 0x7ff35d138040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1407395641"}} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:54:20.174481 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.quota [None req-e25466ed-03fd-4650-970c-18dda12ea6cf tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Getting quotas for project 3ecfade47630412b85598218c7c04664. Resources: {'key_pairs'} {{(pid=128352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 14:54:20.178190 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.quota [None req-e25466ed-03fd-4650-970c-18dda12ea6cf tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Getting quotas for user b6c5fac3bd10428d87723eaf90bcbfac and project 3ecfade47630412b85598218c7c04664. Resources: {'key_pairs'} {{(pid=128352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 14:54:20.305232 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.quota [None req-e25466ed-03fd-4650-970c-18dda12ea6cf tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Getting quotas for project 3ecfade47630412b85598218c7c04664. Resources: {'key_pairs'} {{(pid=128352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 14:54:20.308832 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.quota [None req-e25466ed-03fd-4650-970c-18dda12ea6cf tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Getting quotas for user b6c5fac3bd10428d87723eaf90bcbfac and project 3ecfade47630412b85598218c7c04664. Resources: {'key_pairs'} {{(pid=128352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 14:54:20.321365 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-e25466ed-03fd-4650-970c-18dda12ea6cf tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.164980 Mar 08 14:54:20.321964 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 199/413] 10.222.0.30 () {60 vars in 1157 bytes} [Tue Mar 8 14:54:20 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:20.370979 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-fa6c08b3-712d-4169-8efa-7824cfd2fcc0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1057207398", "imageRef": "696871ed-3eaf-4bb4-bc92-f921dfc6f27c", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1407395641", "networks": [{"uuid": "d6d2b82d-7afe-4f3d-8b71-7928471a932a"}]}} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:54:20.420176 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.network.neutron [None req-fa6c08b3-712d-4169-8efa-7824cfd2fcc0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] validate_networks() for [('d6d2b82d-7afe-4f3d-8b71-7928471a932a', None, None, None, None, None)] {{(pid=128351) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 14:54:20.493938 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c5e05e81-0541-408a-a8f7-4850876a7410 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:20.494555 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-c5e05e81-0541-408a-a8f7-4850876a7410 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:20.500876 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c5e05e81-0541-408a-a8f7-4850876a7410 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:20.501328 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c5e05e81-0541-408a-a8f7-4850876a7410 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:20.502124 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c5e05e81-0541-408a-a8f7-4850876a7410 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:20.502567 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c5e05e81-0541-408a-a8f7-4850876a7410 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:20.634877 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-c5e05e81-0541-408a-a8f7-4850876a7410 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:20.644873 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-c5e05e81-0541-408a-a8f7-4850876a7410 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1522 microversion: 2.1 time: 0.154749 Mar 08 14:54:20.645410 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 200/414] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:20 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:54:20.650036 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-9f010551-b61d-4a48-b523-a1c99f8759f8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:20.650979 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-9f010551-b61d-4a48-b523-a1c99f8759f8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:20.657196 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9f010551-b61d-4a48-b523-a1c99f8759f8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:20.657661 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9f010551-b61d-4a48-b523-a1c99f8759f8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:20.658474 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9f010551-b61d-4a48-b523-a1c99f8759f8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:20.658919 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9f010551-b61d-4a48-b523-a1c99f8759f8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:20.792619 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-fa6c08b3-712d-4169-8efa-7824cfd2fcc0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Flavor limits 0:0:0 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 14:54:20.793125 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-fa6c08b3-712d-4169-8efa-7824cfd2fcc0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Image limits 0:0:0 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 14:54:20.793677 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-fa6c08b3-712d-4169-8efa-7824cfd2fcc0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Flavor pref 0:0:0 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 14:54:20.794865 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-fa6c08b3-712d-4169-8efa-7824cfd2fcc0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Image pref 0:0:0 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 14:54:20.795293 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-fa6c08b3-712d-4169-8efa-7824cfd2fcc0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 14:54:20.798814 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-9f010551-b61d-4a48-b523-a1c99f8759f8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:20.804088 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fa6c08b3-712d-4169-8efa-7824cfd2fcc0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:20.804547 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fa6c08b3-712d-4169-8efa-7824cfd2fcc0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:20.805365 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fa6c08b3-712d-4169-8efa-7824cfd2fcc0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:20.805806 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fa6c08b3-712d-4169-8efa-7824cfd2fcc0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:20.809103 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-9f010551-b61d-4a48-b523-a1c99f8759f8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:20.811018 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-9f010551-b61d-4a48-b523-a1c99f8759f8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:20.812171 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-9f010551-b61d-4a48-b523-a1c99f8759f8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1810 microversion: 2.20 time: 0.165649 Mar 08 14:54:20.812904 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 201/415] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:54:20 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:54:20.823612 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.quota [None req-fa6c08b3-712d-4169-8efa-7824cfd2fcc0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Getting quotas for project 3ecfade47630412b85598218c7c04664. Resources: {'instances', 'ram', 'cores'} {{(pid=128351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 14:54:20.827461 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.quota [None req-fa6c08b3-712d-4169-8efa-7824cfd2fcc0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Getting quotas for user b6c5fac3bd10428d87723eaf90bcbfac and project 3ecfade47630412b85598218c7c04664. Resources: {'instances', 'ram', 'cores'} {{(pid=128351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 14:54:20.837873 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-fa6c08b3-712d-4169-8efa-7824cfd2fcc0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Going to run 1 instances... {{(pid=128351) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 14:54:20.840078 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-fa6c08b3-712d-4169-8efa-7824cfd2fcc0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='696871ed-3eaf-4bb4-bc92-f921dfc6f27c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 14:54:20.886922 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-fa6c08b3-712d-4169-8efa-7824cfd2fcc0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.520701 Mar 08 14:54:20.888333 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 215/416] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Mar 8 14:54:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 14:54:20.898175 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c236ecf1-5407-49a5-a906-c29ea2fc0981 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:20.898842 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-c236ecf1-5407-49a5-a906-c29ea2fc0981 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:20.957190 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-c236ecf1-5407-49a5-a906-c29ea2fc0981 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:20.963565 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-c236ecf1-5407-49a5-a906-c29ea2fc0981 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1259 microversion: 2.1 time: 0.069388 Mar 08 14:54:20.964329 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 202/417] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:20 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1259 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:54:21.661795 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-0e27ee9a-bac4-4d72-8d42-cf9ec5211936 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:21.662444 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-0e27ee9a-bac4-4d72-8d42-cf9ec5211936 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:21.669786 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0e27ee9a-bac4-4d72-8d42-cf9ec5211936 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:21.670277 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0e27ee9a-bac4-4d72-8d42-cf9ec5211936 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:21.671051 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0e27ee9a-bac4-4d72-8d42-cf9ec5211936 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:21.671499 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0e27ee9a-bac4-4d72-8d42-cf9ec5211936 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:21.806687 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-0e27ee9a-bac4-4d72-8d42-cf9ec5211936 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:21.814811 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-0e27ee9a-bac4-4d72-8d42-cf9ec5211936 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1522 microversion: 2.1 time: 0.157393 Mar 08 14:54:21.815376 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 216/418] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:21 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:21.830116 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-7858f8f1-3424-4451-9212-e683780c9f5c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:21.830728 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-7858f8f1-3424-4451-9212-e683780c9f5c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:21.837055 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7858f8f1-3424-4451-9212-e683780c9f5c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:21.837502 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7858f8f1-3424-4451-9212-e683780c9f5c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:21.838297 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7858f8f1-3424-4451-9212-e683780c9f5c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:21.838730 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7858f8f1-3424-4451-9212-e683780c9f5c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:21.971131 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-7858f8f1-3424-4451-9212-e683780c9f5c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:21.979894 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-7858f8f1-3424-4451-9212-e683780c9f5c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:21.980388 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-643e6606-2cca-46e5-b947-a2bd26b88473 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:21.981006 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-643e6606-2cca-46e5-b947-a2bd26b88473 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:21.981998 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-7858f8f1-3424-4451-9212-e683780c9f5c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:21.983896 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-7858f8f1-3424-4451-9212-e683780c9f5c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1810 microversion: 2.20 time: 0.156841 Mar 08 14:54:21.983896 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 203/419] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:54:21 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:54:21.990316 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-643e6606-2cca-46e5-b947-a2bd26b88473 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:21.990809 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-643e6606-2cca-46e5-b947-a2bd26b88473 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:21.999842 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-643e6606-2cca-46e5-b947-a2bd26b88473 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:22.000457 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-643e6606-2cca-46e5-b947-a2bd26b88473 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:22.059547 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-643e6606-2cca-46e5-b947-a2bd26b88473 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:22.067570 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-643e6606-2cca-46e5-b947-a2bd26b88473 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1263 microversion: 2.1 time: 0.090976 Mar 08 14:54:22.068130 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 217/420] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:21 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1263 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:54:22.832177 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f1667e53-0fdd-4167-8969-81bb0df6613b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:22.833535 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f1667e53-0fdd-4167-8969-81bb0df6613b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:22.840185 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f1667e53-0fdd-4167-8969-81bb0df6613b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:22.840484 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f1667e53-0fdd-4167-8969-81bb0df6613b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:22.841372 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f1667e53-0fdd-4167-8969-81bb0df6613b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:22.841847 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f1667e53-0fdd-4167-8969-81bb0df6613b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:22.994492 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f1667e53-0fdd-4167-8969-81bb0df6613b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:23.003141 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f1667e53-0fdd-4167-8969-81bb0df6613b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1522 microversion: 2.1 time: 0.174725 Mar 08 14:54:23.003475 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-962f44f0-8d4b-464f-8f0f-34aaf0fab833 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:23.004111 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 204/421] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:22 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:23.008564 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-962f44f0-8d4b-464f-8f0f-34aaf0fab833 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:23.018821 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-962f44f0-8d4b-464f-8f0f-34aaf0fab833 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:23.019311 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-962f44f0-8d4b-464f-8f0f-34aaf0fab833 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:23.020106 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-962f44f0-8d4b-464f-8f0f-34aaf0fab833 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:23.020549 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-962f44f0-8d4b-464f-8f0f-34aaf0fab833 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:23.096819 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3d65fe5d-1b6c-4aa2-9ad5-625ce58aa56a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:23.099573 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-3d65fe5d-1b6c-4aa2-9ad5-625ce58aa56a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:23.136458 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3d65fe5d-1b6c-4aa2-9ad5-625ce58aa56a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:23.139610 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3d65fe5d-1b6c-4aa2-9ad5-625ce58aa56a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:23.149394 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3d65fe5d-1b6c-4aa2-9ad5-625ce58aa56a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:23.156799 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3d65fe5d-1b6c-4aa2-9ad5-625ce58aa56a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:23.284579 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-962f44f0-8d4b-464f-8f0f-34aaf0fab833 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:23.284906 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-3d65fe5d-1b6c-4aa2-9ad5-625ce58aa56a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:23.294522 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-962f44f0-8d4b-464f-8f0f-34aaf0fab833 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:23.296331 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-3d65fe5d-1b6c-4aa2-9ad5-625ce58aa56a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1311 microversion: 2.1 time: 0.214763 Mar 08 14:54:23.297497 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-962f44f0-8d4b-464f-8f0f-34aaf0fab833 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:23.298487 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 205/422] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:23 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1311 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:23.302829 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-962f44f0-8d4b-464f-8f0f-34aaf0fab833 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1810 microversion: 2.20 time: 0.299587 Mar 08 14:54:23.314644 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 218/423] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:54:22 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1810 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:54:24.027585 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b4d8302d-5a51-429f-95e0-8bb9bacbd80e tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:24.029433 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b4d8302d-5a51-429f-95e0-8bb9bacbd80e tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:24.036275 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b4d8302d-5a51-429f-95e0-8bb9bacbd80e tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:24.036958 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b4d8302d-5a51-429f-95e0-8bb9bacbd80e tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:24.038122 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b4d8302d-5a51-429f-95e0-8bb9bacbd80e tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:24.038716 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b4d8302d-5a51-429f-95e0-8bb9bacbd80e tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:24.073348 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-92b2d83a-6cb7-4230-a748-872d9c78288e tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1343642709", "imageRef": "7541d53b-003d-4f1a-8d76-fc5f4bd8dabf", "flavorRef": "452", "networks": [{"uuid": "2caa43d2-21a1-44c8-a1ce-546588a7a2ce"}]}} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:54:24.207585 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b4d8302d-5a51-429f-95e0-8bb9bacbd80e tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:24.215475 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b4d8302d-5a51-429f-95e0-8bb9bacbd80e tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1522 microversion: 2.1 time: 0.198681 Mar 08 14:54:24.217026 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 206/424] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:24 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:24.316080 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b20bfc39-a29a-48b5-8bce-e29839470080 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:24.316804 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b20bfc39-a29a-48b5-8bce-e29839470080 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:24.323035 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b20bfc39-a29a-48b5-8bce-e29839470080 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:24.323498 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b20bfc39-a29a-48b5-8bce-e29839470080 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:24.324300 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b20bfc39-a29a-48b5-8bce-e29839470080 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:24.324746 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b20bfc39-a29a-48b5-8bce-e29839470080 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:24.397510 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b20bfc39-a29a-48b5-8bce-e29839470080 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:24.406014 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b20bfc39-a29a-48b5-8bce-e29839470080 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1311 microversion: 2.1 time: 0.093856 Mar 08 14:54:24.407125 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 207/425] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:24 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1311 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:54:24.413101 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b32eb696-228a-423d-a881-e7a4689f1b75 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:24.413703 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b32eb696-228a-423d-a881-e7a4689f1b75 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:24.419561 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b32eb696-228a-423d-a881-e7a4689f1b75 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:24.420039 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b32eb696-228a-423d-a881-e7a4689f1b75 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:24.420826 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b32eb696-228a-423d-a881-e7a4689f1b75 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:24.421256 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b32eb696-228a-423d-a881-e7a4689f1b75 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:24.567428 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b32eb696-228a-423d-a881-e7a4689f1b75 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:24.576873 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b32eb696-228a-423d-a881-e7a4689f1b75 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:24.578691 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b32eb696-228a-423d-a881-e7a4689f1b75 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:24.580308 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b32eb696-228a-423d-a881-e7a4689f1b75 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1810 microversion: 2.20 time: 0.171751 Mar 08 14:54:24.592333 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 208/426] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:54:24 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1810 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:54:25.232509 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-1f451583-3adb-4de5-91e7-57299e6f5a80 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:25.233364 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-1f451583-3adb-4de5-91e7-57299e6f5a80 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:25.239503 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1f451583-3adb-4de5-91e7-57299e6f5a80 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:25.239952 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1f451583-3adb-4de5-91e7-57299e6f5a80 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:25.240757 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1f451583-3adb-4de5-91e7-57299e6f5a80 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:25.241193 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1f451583-3adb-4de5-91e7-57299e6f5a80 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:25.391458 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-1f451583-3adb-4de5-91e7-57299e6f5a80 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:25.402494 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-1f451583-3adb-4de5-91e7-57299e6f5a80 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1522 microversion: 2.1 time: 0.173695 Mar 08 14:54:25.404903 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 209/427] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:25 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:54:25.424161 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-428f2798-c196-450b-91be-bee87e83ff2e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:25.424875 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-428f2798-c196-450b-91be-bee87e83ff2e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:25.431074 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-428f2798-c196-450b-91be-bee87e83ff2e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:25.431601 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-428f2798-c196-450b-91be-bee87e83ff2e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:25.432447 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-428f2798-c196-450b-91be-bee87e83ff2e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:25.432952 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-428f2798-c196-450b-91be-bee87e83ff2e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:25.492592 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-428f2798-c196-450b-91be-bee87e83ff2e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:25.500248 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-428f2798-c196-450b-91be-bee87e83ff2e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1311 microversion: 2.1 time: 0.080426 Mar 08 14:54:25.500801 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 210/428] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:25 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1311 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:25.598318 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-70d5d0ee-a5b7-4e42-bcf2-c92bca57ef8d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:25.598929 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-70d5d0ee-a5b7-4e42-bcf2-c92bca57ef8d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:25.604899 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-70d5d0ee-a5b7-4e42-bcf2-c92bca57ef8d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:25.605355 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-70d5d0ee-a5b7-4e42-bcf2-c92bca57ef8d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:25.606678 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-70d5d0ee-a5b7-4e42-bcf2-c92bca57ef8d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:25.607170 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-70d5d0ee-a5b7-4e42-bcf2-c92bca57ef8d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:25.754166 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-70d5d0ee-a5b7-4e42-bcf2-c92bca57ef8d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:25.765319 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-70d5d0ee-a5b7-4e42-bcf2-c92bca57ef8d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:25.766946 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-70d5d0ee-a5b7-4e42-bcf2-c92bca57ef8d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:25.768180 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-70d5d0ee-a5b7-4e42-bcf2-c92bca57ef8d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1810 microversion: 2.20 time: 0.173581 Mar 08 14:54:25.768809 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 211/429] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:54:25 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1810 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 14:54:26.428351 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-6cf6caad-e6b4-42dc-a13c-b33a55088f9d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:26.429089 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-6cf6caad-e6b4-42dc-a13c-b33a55088f9d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:26.436021 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6cf6caad-e6b4-42dc-a13c-b33a55088f9d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:26.436477 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6cf6caad-e6b4-42dc-a13c-b33a55088f9d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:26.437270 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6cf6caad-e6b4-42dc-a13c-b33a55088f9d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:26.437711 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6cf6caad-e6b4-42dc-a13c-b33a55088f9d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:26.587031 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-6cf6caad-e6b4-42dc-a13c-b33a55088f9d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:26.595747 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-6cf6caad-e6b4-42dc-a13c-b33a55088f9d tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1522 microversion: 2.1 time: 0.171374 Mar 08 14:54:26.606706 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 212/430] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:26 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:54:26.615298 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-4329345b-7cbe-42c7-9f2a-d812b26b40fb tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:26.616121 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-4329345b-7cbe-42c7-9f2a-d812b26b40fb tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:26.624842 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4329345b-7cbe-42c7-9f2a-d812b26b40fb tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:26.625298 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4329345b-7cbe-42c7-9f2a-d812b26b40fb tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:26.626114 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4329345b-7cbe-42c7-9f2a-d812b26b40fb tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:26.626584 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4329345b-7cbe-42c7-9f2a-d812b26b40fb tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:26.689512 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-4329345b-7cbe-42c7-9f2a-d812b26b40fb tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:26.696649 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-4329345b-7cbe-42c7-9f2a-d812b26b40fb tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1311 microversion: 2.1 time: 0.088225 Mar 08 14:54:26.697212 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 213/431] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:26 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1311 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:26.790377 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5e253b6d-1b1d-4b40-b09e-c8bd349d5d97 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:26.790948 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5e253b6d-1b1d-4b40-b09e-c8bd349d5d97 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:26.799227 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5e253b6d-1b1d-4b40-b09e-c8bd349d5d97 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:26.799679 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5e253b6d-1b1d-4b40-b09e-c8bd349d5d97 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:26.800463 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5e253b6d-1b1d-4b40-b09e-c8bd349d5d97 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:26.801006 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5e253b6d-1b1d-4b40-b09e-c8bd349d5d97 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:26.954362 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-5e253b6d-1b1d-4b40-b09e-c8bd349d5d97 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:26.963230 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-5e253b6d-1b1d-4b40-b09e-c8bd349d5d97 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:26.965694 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-5e253b6d-1b1d-4b40-b09e-c8bd349d5d97 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:26.967628 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5e253b6d-1b1d-4b40-b09e-c8bd349d5d97 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1810 microversion: 2.20 time: 0.182792 Mar 08 14:54:26.968266 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 214/432] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:54:26 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1810 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 14:54:27.516405 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-02f147cb-4aee-45d5-ac37-5247423cd0fa tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1569786390", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1546550273", "security_groups": [{"name": "tempest-secgroup-smoke-685093074"}], "block_device_mapping_v2": [{"uuid": "6dd89eb3-2ed7-4d4b-b207-fd0f7316d822", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d5766300-60e4-42fb-b029-99b68f172a9f"}]}} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:54:27.641592 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.network.neutron [None req-02f147cb-4aee-45d5-ac37-5247423cd0fa tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] validate_networks() for [('d5766300-60e4-42fb-b029-99b68f172a9f', None, None, None, None, None)] {{(pid=128352) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 14:54:28.073187 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.virt.hardware [None req-02f147cb-4aee-45d5-ac37-5247423cd0fa tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Flavor limits 0:0:0 {{(pid=128352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 14:54:28.073618 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.virt.hardware [None req-02f147cb-4aee-45d5-ac37-5247423cd0fa tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Image limits 0:0:0 {{(pid=128352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 14:54:28.074122 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.virt.hardware [None req-02f147cb-4aee-45d5-ac37-5247423cd0fa tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Flavor pref 0:0:0 {{(pid=128352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 14:54:28.074536 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.virt.hardware [None req-02f147cb-4aee-45d5-ac37-5247423cd0fa tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Image pref 0:0:0 {{(pid=128352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 14:54:28.075689 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.virt.hardware [None req-02f147cb-4aee-45d5-ac37-5247423cd0fa tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 14:54:28.084875 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-02f147cb-4aee-45d5-ac37-5247423cd0fa tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:28.085333 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-02f147cb-4aee-45d5-ac37-5247423cd0fa tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:28.086256 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-02f147cb-4aee-45d5-ac37-5247423cd0fa tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:28.086739 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-02f147cb-4aee-45d5-ac37-5247423cd0fa tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:28.113929 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.quota [None req-02f147cb-4aee-45d5-ac37-5247423cd0fa tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Getting quotas for project 6ce506c63f16445cac166f16104398cd. Resources: {'instances', 'ram', 'cores'} {{(pid=128352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 14:54:28.119561 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.quota [None req-02f147cb-4aee-45d5-ac37-5247423cd0fa tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Getting quotas for user d5eebbc0c8574cd58c022f2cc0e9f1eb and project 6ce506c63f16445cac166f16104398cd. Resources: {'instances', 'ram', 'cores'} {{(pid=128352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 14:54:28.181713 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-02f147cb-4aee-45d5-ac37-5247423cd0fa tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Going to run 1 instances... {{(pid=128352) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 14:54:28.183974 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-02f147cb-4aee-45d5-ac37-5247423cd0fa tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6dd89eb3-2ed7-4d4b-b207-fd0f7316d822',volume_size=None,volume_type=None)] {{(pid=128352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 14:54:28.340767 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-02f147cb-4aee-45d5-ac37-5247423cd0fa tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.828070 Mar 08 14:54:28.346505 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 215/433] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Mar 8 14:54:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 08 14:54:28.346697 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ccc95d3c-8b27-480d-a018-c8014bc7d069 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:28.347302 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ccc95d3c-8b27-480d-a018-c8014bc7d069 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:28.355423 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ccc95d3c-8b27-480d-a018-c8014bc7d069 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:28.356436 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ccc95d3c-8b27-480d-a018-c8014bc7d069 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:28.357481 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ccc95d3c-8b27-480d-a018-c8014bc7d069 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:28.358202 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ccc95d3c-8b27-480d-a018-c8014bc7d069 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:28.580222 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ccc95d3c-8b27-480d-a018-c8014bc7d069 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:28.590520 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ccc95d3c-8b27-480d-a018-c8014bc7d069 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1522 microversion: 2.1 time: 0.247499 Mar 08 14:54:28.591259 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 216/434] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:28 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:28.596091 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-bb08ca62-810d-435b-8d42-008de237d6a3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:28.596693 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-bb08ca62-810d-435b-8d42-008de237d6a3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:28.602494 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bb08ca62-810d-435b-8d42-008de237d6a3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:28.602959 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bb08ca62-810d-435b-8d42-008de237d6a3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:28.603776 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bb08ca62-810d-435b-8d42-008de237d6a3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:28.604243 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bb08ca62-810d-435b-8d42-008de237d6a3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:28.695080 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-bb08ca62-810d-435b-8d42-008de237d6a3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:28.704627 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-bb08ca62-810d-435b-8d42-008de237d6a3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1311 microversion: 2.1 time: 0.112021 Mar 08 14:54:28.705116 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 217/435] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:28 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1311 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:28.710571 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-17191e7d-cd93-428f-bdc4-48ee1bda5053 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:28.711255 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-17191e7d-cd93-428f-bdc4-48ee1bda5053 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:28.717328 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-17191e7d-cd93-428f-bdc4-48ee1bda5053 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:28.717788 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-17191e7d-cd93-428f-bdc4-48ee1bda5053 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:28.718644 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-17191e7d-cd93-428f-bdc4-48ee1bda5053 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:28.719087 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-17191e7d-cd93-428f-bdc4-48ee1bda5053 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:28.906406 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-17191e7d-cd93-428f-bdc4-48ee1bda5053 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:28.914542 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-17191e7d-cd93-428f-bdc4-48ee1bda5053 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:28.916041 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-17191e7d-cd93-428f-bdc4-48ee1bda5053 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:28.917180 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-17191e7d-cd93-428f-bdc4-48ee1bda5053 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1810 microversion: 2.20 time: 0.210300 Mar 08 14:54:28.917723 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 218/436] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:54:28 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1810 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:54:28.922830 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-be22c110-39b2-45e5-8173-078f932d931e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:28.923428 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-be22c110-39b2-45e5-8173-078f932d931e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:28.928946 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-be22c110-39b2-45e5-8173-078f932d931e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:28.929394 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-be22c110-39b2-45e5-8173-078f932d931e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:28.930192 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-be22c110-39b2-45e5-8173-078f932d931e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:28.930842 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-be22c110-39b2-45e5-8173-078f932d931e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:29.000545 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-be22c110-39b2-45e5-8173-078f932d931e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:29.007998 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-be22c110-39b2-45e5-8173-078f932d931e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1145 microversion: 2.1 time: 0.089298 Mar 08 14:54:29.008556 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 219/437] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:28 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1145 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:29.350923 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-06219adb-209c-44ec-b7f3-cb9bbbf19079 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:29.351679 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-06219adb-209c-44ec-b7f3-cb9bbbf19079 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:29.358802 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-06219adb-209c-44ec-b7f3-cb9bbbf19079 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:29.359647 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-06219adb-209c-44ec-b7f3-cb9bbbf19079 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:29.360613 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-06219adb-209c-44ec-b7f3-cb9bbbf19079 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:29.361220 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-06219adb-209c-44ec-b7f3-cb9bbbf19079 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:29.461514 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.objects.instance [None req-06219adb-209c-44ec-b7f3-cb9bbbf19079 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lazy-loading 'services' on Instance uuid 04409dca-0761-4f98-b039-a620e2bef81e {{(pid=128352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 14:54:29.589113 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-06219adb-209c-44ec-b7f3-cb9bbbf19079 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "DELETE /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e/os-volume_attachments/e68d3edf-20ac-4867-9f6c-854a014458ee" status: 202 len: 0 microversion: 2.1 time: 0.242151 Mar 08 14:54:29.595018 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 220/438] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Mar 8 14:54:29 2022] DELETE /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e/os-volume_attachments/e68d3edf-20ac-4867-9f6c-854a014458ee => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 08 14:54:29.620425 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-7e10741c-df5d-428f-b2df-2333651a3f8b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:29.622935 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-7e10741c-df5d-428f-b2df-2333651a3f8b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:29.634172 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7e10741c-df5d-428f-b2df-2333651a3f8b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:29.634962 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7e10741c-df5d-428f-b2df-2333651a3f8b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:29.636517 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7e10741c-df5d-428f-b2df-2333651a3f8b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:29.637371 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7e10741c-df5d-428f-b2df-2333651a3f8b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:29.808741 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-7e10741c-df5d-428f-b2df-2333651a3f8b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:29.816852 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-7e10741c-df5d-428f-b2df-2333651a3f8b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1522 microversion: 2.1 time: 0.211172 Mar 08 14:54:29.817487 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 221/439] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:29 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:29.823483 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d4184cf4-32f5-46d1-8913-5a82bacbf90f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:29.824329 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d4184cf4-32f5-46d1-8913-5a82bacbf90f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:29.831360 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d4184cf4-32f5-46d1-8913-5a82bacbf90f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:29.831971 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d4184cf4-32f5-46d1-8913-5a82bacbf90f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:29.832892 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d4184cf4-32f5-46d1-8913-5a82bacbf90f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:29.833421 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d4184cf4-32f5-46d1-8913-5a82bacbf90f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:29.908486 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d4184cf4-32f5-46d1-8913-5a82bacbf90f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:29.915671 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d4184cf4-32f5-46d1-8913-5a82bacbf90f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1311 microversion: 2.1 time: 0.097254 Mar 08 14:54:29.916221 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 222/440] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:29 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1311 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:29.936505 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-77608739-a02c-4afb-b537-4de3fe4706bb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:29.937248 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-77608739-a02c-4afb-b537-4de3fe4706bb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:29.944871 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-77608739-a02c-4afb-b537-4de3fe4706bb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:29.945330 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-77608739-a02c-4afb-b537-4de3fe4706bb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:29.946409 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-77608739-a02c-4afb-b537-4de3fe4706bb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:29.946850 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-77608739-a02c-4afb-b537-4de3fe4706bb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:30.090590 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-77608739-a02c-4afb-b537-4de3fe4706bb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:30.100810 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-77608739-a02c-4afb-b537-4de3fe4706bb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:30.102483 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-77608739-a02c-4afb-b537-4de3fe4706bb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:30.103660 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-77608739-a02c-4afb-b537-4de3fe4706bb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1810 microversion: 2.20 time: 0.172024 Mar 08 14:54:30.113393 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 223/441] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:54:29 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1810 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 14:54:30.113393 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-4fad4efa-02cc-4a39-864e-595832612af4 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:30.113393 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-4fad4efa-02cc-4a39-864e-595832612af4 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:30.116191 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4fad4efa-02cc-4a39-864e-595832612af4 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:30.116645 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4fad4efa-02cc-4a39-864e-595832612af4 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:30.117420 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4fad4efa-02cc-4a39-864e-595832612af4 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:30.117882 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4fad4efa-02cc-4a39-864e-595832612af4 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:30.183287 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-4fad4efa-02cc-4a39-864e-595832612af4 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:30.192224 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-4fad4efa-02cc-4a39-864e-595832612af4 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1145 microversion: 2.1 time: 0.086442 Mar 08 14:54:30.203712 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 224/442] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:30 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1145 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:30.833729 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b90507e2-43b1-4b9f-baab-5aa6affdd2f9 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:30.834461 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b90507e2-43b1-4b9f-baab-5aa6affdd2f9 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:30.841158 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b90507e2-43b1-4b9f-baab-5aa6affdd2f9 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:30.841634 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b90507e2-43b1-4b9f-baab-5aa6affdd2f9 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:30.842444 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b90507e2-43b1-4b9f-baab-5aa6affdd2f9 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:30.842884 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b90507e2-43b1-4b9f-baab-5aa6affdd2f9 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:31.000258 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b90507e2-43b1-4b9f-baab-5aa6affdd2f9 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:31.014304 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b90507e2-43b1-4b9f-baab-5aa6affdd2f9 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1522 microversion: 2.1 time: 0.184330 Mar 08 14:54:31.015574 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 225/443] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:30 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:54:31.020276 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d1232ab8-3c46-46eb-8bcc-313f99d2c15a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:31.021238 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d1232ab8-3c46-46eb-8bcc-313f99d2c15a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:31.027309 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d1232ab8-3c46-46eb-8bcc-313f99d2c15a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:31.028676 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d1232ab8-3c46-46eb-8bcc-313f99d2c15a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:31.029734 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d1232ab8-3c46-46eb-8bcc-313f99d2c15a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:31.030233 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d1232ab8-3c46-46eb-8bcc-313f99d2c15a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:31.043234 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.network.neutron [None req-92b2d83a-6cb7-4230-a748-872d9c78288e tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] validate_networks() for [('2caa43d2-21a1-44c8-a1ce-546588a7a2ce', None, None, None, None, None)] {{(pid=128351) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 14:54:31.098057 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d1232ab8-3c46-46eb-8bcc-313f99d2c15a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:31.108342 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d1232ab8-3c46-46eb-8bcc-313f99d2c15a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1311 microversion: 2.1 time: 0.090541 Mar 08 14:54:31.109452 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 226/444] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:31 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1311 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:31.122854 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-0c194018-8f9c-4682-8803-17f6c18d1b32 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:31.123475 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-0c194018-8f9c-4682-8803-17f6c18d1b32 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:31.129660 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0c194018-8f9c-4682-8803-17f6c18d1b32 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:31.130209 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0c194018-8f9c-4682-8803-17f6c18d1b32 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:31.130947 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0c194018-8f9c-4682-8803-17f6c18d1b32 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:31.131399 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0c194018-8f9c-4682-8803-17f6c18d1b32 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:31.483254 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-92b2d83a-6cb7-4230-a748-872d9c78288e tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Flavor limits 0:0:0 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 14:54:31.483688 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-92b2d83a-6cb7-4230-a748-872d9c78288e tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Image limits 0:0:0 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 14:54:31.484337 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-92b2d83a-6cb7-4230-a748-872d9c78288e tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Flavor pref 0:0:0 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 14:54:31.484853 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-92b2d83a-6cb7-4230-a748-872d9c78288e tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Image pref 0:0:0 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 14:54:31.486226 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-92b2d83a-6cb7-4230-a748-872d9c78288e tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 14:54:31.496215 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-92b2d83a-6cb7-4230-a748-872d9c78288e tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:31.497144 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-92b2d83a-6cb7-4230-a748-872d9c78288e tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:31.499618 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-92b2d83a-6cb7-4230-a748-872d9c78288e tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:31.500290 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-92b2d83a-6cb7-4230-a748-872d9c78288e tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:31.521278 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.quota [None req-92b2d83a-6cb7-4230-a748-872d9c78288e tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Getting quotas for project 3d53fd1057c44dffb358b098d5f190fa. Resources: {'instances', 'ram', 'cores'} {{(pid=128351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 14:54:31.525636 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.quota [None req-92b2d83a-6cb7-4230-a748-872d9c78288e tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Getting quotas for user 6d080fb7bd6049dea53fe1912d46b11b and project 3d53fd1057c44dffb358b098d5f190fa. Resources: {'instances', 'ram', 'cores'} {{(pid=128351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 14:54:31.537365 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-92b2d83a-6cb7-4230-a748-872d9c78288e tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Going to run 1 instances... {{(pid=128351) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 14:54:31.539534 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-92b2d83a-6cb7-4230-a748-872d9c78288e tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: ecac51d1-33c3-49df-9926-d953f7315f52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7541d53b-003d-4f1a-8d76-fc5f4bd8dabf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 14:54:31.549163 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-0c194018-8f9c-4682-8803-17f6c18d1b32 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:31.558877 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-0c194018-8f9c-4682-8803-17f6c18d1b32 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:31.561493 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-0c194018-8f9c-4682-8803-17f6c18d1b32 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:31.562807 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-0c194018-8f9c-4682-8803-17f6c18d1b32 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1810 microversion: 2.20 time: 0.444161 Mar 08 14:54:31.563368 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 227/445] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:54:31 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1810 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:54:31.580390 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-55b00dfe-d5a9-4fa9-aad9-da28333a18e1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:31.581265 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-55b00dfe-d5a9-4fa9-aad9-da28333a18e1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:31.587838 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-55b00dfe-d5a9-4fa9-aad9-da28333a18e1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:31.588326 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-55b00dfe-d5a9-4fa9-aad9-da28333a18e1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:31.589120 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-55b00dfe-d5a9-4fa9-aad9-da28333a18e1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:31.589567 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-55b00dfe-d5a9-4fa9-aad9-da28333a18e1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:31.589985 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-92b2d83a-6cb7-4230-a748-872d9c78288e tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.520528 Mar 08 14:54:31.591600 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 219/446] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Mar 8 14:54:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 7523 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 14:54:31.601115 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b0abd6a9-b82f-4098-854e-057828605497 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:31.601728 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-b0abd6a9-b82f-4098-854e-057828605497 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: ecac51d1-33c3-49df-9926-d953f7315f52] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:31.666562 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-b0abd6a9-b82f-4098-854e-057828605497 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d080fb7bd6049dea53fe1912d46b11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53fd1057c44dffb358b098d5f190fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:31.673948 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-b0abd6a9-b82f-4098-854e-057828605497 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "GET /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52" status: 200 len: 1219 microversion: 2.1 time: 0.076359 Mar 08 14:54:31.674309 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-55b00dfe-d5a9-4fa9-aad9-da28333a18e1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:31.681964 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-55b00dfe-d5a9-4fa9-aad9-da28333a18e1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1145 microversion: 2.1 time: 0.105402 Mar 08 14:54:31.682490 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 228/447] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:31 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1145 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:31.683069 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 220/448] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:31 2022] GET /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:54:32.032575 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-570ba6bc-2979-41a8-80af-74d7cd922890 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:32.033216 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-570ba6bc-2979-41a8-80af-74d7cd922890 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:32.040093 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-570ba6bc-2979-41a8-80af-74d7cd922890 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:32.040564 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-570ba6bc-2979-41a8-80af-74d7cd922890 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:32.041528 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-570ba6bc-2979-41a8-80af-74d7cd922890 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:32.041978 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-570ba6bc-2979-41a8-80af-74d7cd922890 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:32.125120 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-a7b6010a-d4b1-4ba7-85ac-3d6f32e11b4b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:32.126472 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-a7b6010a-d4b1-4ba7-85ac-3d6f32e11b4b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:32.134355 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a7b6010a-d4b1-4ba7-85ac-3d6f32e11b4b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:32.134355 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a7b6010a-d4b1-4ba7-85ac-3d6f32e11b4b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:32.135088 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a7b6010a-d4b1-4ba7-85ac-3d6f32e11b4b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:32.135911 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a7b6010a-d4b1-4ba7-85ac-3d6f32e11b4b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:32.203825 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-570ba6bc-2979-41a8-80af-74d7cd922890 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:32.213504 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-570ba6bc-2979-41a8-80af-74d7cd922890 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1522 microversion: 2.1 time: 0.184970 Mar 08 14:54:32.216432 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 229/449] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:32 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:32.232103 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-a7b6010a-d4b1-4ba7-85ac-3d6f32e11b4b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:32.240994 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-a7b6010a-d4b1-4ba7-85ac-3d6f32e11b4b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1311 microversion: 2.1 time: 0.120438 Mar 08 14:54:32.243256 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 221/450] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:32 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1311 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:54:32.582626 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-49b771ba-5f1c-4e40-980b-f9901a7d5a33 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:32.583155 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-49b771ba-5f1c-4e40-980b-f9901a7d5a33 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:32.589056 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-49b771ba-5f1c-4e40-980b-f9901a7d5a33 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:32.589508 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-49b771ba-5f1c-4e40-980b-f9901a7d5a33 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:32.590315 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-49b771ba-5f1c-4e40-980b-f9901a7d5a33 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:32.591346 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-49b771ba-5f1c-4e40-980b-f9901a7d5a33 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:32.692569 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-c5062b73-c1bd-45f5-9f62-32ff7aa50467 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:32.693485 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-c5062b73-c1bd-45f5-9f62-32ff7aa50467 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: ecac51d1-33c3-49df-9926-d953f7315f52] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:32.700812 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c5062b73-c1bd-45f5-9f62-32ff7aa50467 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:32.701598 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c5062b73-c1bd-45f5-9f62-32ff7aa50467 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:32.702490 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c5062b73-c1bd-45f5-9f62-32ff7aa50467 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:32.703015 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c5062b73-c1bd-45f5-9f62-32ff7aa50467 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:32.737306 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-49b771ba-5f1c-4e40-980b-f9901a7d5a33 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:32.745623 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-49b771ba-5f1c-4e40-980b-f9901a7d5a33 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:32.747653 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-49b771ba-5f1c-4e40-980b-f9901a7d5a33 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:32.748809 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-49b771ba-5f1c-4e40-980b-f9901a7d5a33 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1810 microversion: 2.20 time: 0.170232 Mar 08 14:54:32.749477 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 230/451] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:54:32 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:54:32.753649 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-21b46ad5-7bfd-49c7-aede-4ee2913a04ca tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:32.754266 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-21b46ad5-7bfd-49c7-aede-4ee2913a04ca tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:32.760122 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-21b46ad5-7bfd-49c7-aede-4ee2913a04ca tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:32.760587 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-21b46ad5-7bfd-49c7-aede-4ee2913a04ca tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:32.761364 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-21b46ad5-7bfd-49c7-aede-4ee2913a04ca tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:32.761831 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-21b46ad5-7bfd-49c7-aede-4ee2913a04ca tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:32.770019 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-c5062b73-c1bd-45f5-9f62-32ff7aa50467 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d080fb7bd6049dea53fe1912d46b11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53fd1057c44dffb358b098d5f190fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:32.777234 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-c5062b73-c1bd-45f5-9f62-32ff7aa50467 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "GET /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52" status: 200 len: 1223 microversion: 2.1 time: 0.088636 Mar 08 14:54:32.778112 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 222/452] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:32 2022] GET /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52 => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:54:32.830888 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-21b46ad5-7bfd-49c7-aede-4ee2913a04ca tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:32.838449 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-21b46ad5-7bfd-49c7-aede-4ee2913a04ca tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1145 microversion: 2.1 time: 0.088091 Mar 08 14:54:32.839089 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 231/453] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:32 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1145 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:33.232717 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-52148a19-8a9c-47be-b041-f79a72bbb000 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:33.233332 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-52148a19-8a9c-47be-b041-f79a72bbb000 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:33.239569 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-52148a19-8a9c-47be-b041-f79a72bbb000 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:33.240027 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-52148a19-8a9c-47be-b041-f79a72bbb000 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:33.240797 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-52148a19-8a9c-47be-b041-f79a72bbb000 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:33.241241 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-52148a19-8a9c-47be-b041-f79a72bbb000 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:33.259574 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-97bce839-911b-49c4-8d08-80473681b141 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:33.260209 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-97bce839-911b-49c4-8d08-80473681b141 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:33.266939 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-97bce839-911b-49c4-8d08-80473681b141 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:33.267387 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-97bce839-911b-49c4-8d08-80473681b141 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:33.268161 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-97bce839-911b-49c4-8d08-80473681b141 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:33.268595 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-97bce839-911b-49c4-8d08-80473681b141 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:33.331007 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-97bce839-911b-49c4-8d08-80473681b141 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:33.338671 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-97bce839-911b-49c4-8d08-80473681b141 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1311 microversion: 2.1 time: 0.082867 Mar 08 14:54:33.339432 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 232/454] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:33 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1311 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:54:33.379720 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-52148a19-8a9c-47be-b041-f79a72bbb000 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:33.388184 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-52148a19-8a9c-47be-b041-f79a72bbb000 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1522 microversion: 2.1 time: 0.158954 Mar 08 14:54:33.388752 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 223/455] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:33 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:33.767499 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-53f3a544-7348-443f-89fd-619ab6cb37fd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:33.768118 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-53f3a544-7348-443f-89fd-619ab6cb37fd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:33.774072 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-53f3a544-7348-443f-89fd-619ab6cb37fd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:33.774524 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-53f3a544-7348-443f-89fd-619ab6cb37fd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:33.775301 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-53f3a544-7348-443f-89fd-619ab6cb37fd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:33.775731 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-53f3a544-7348-443f-89fd-619ab6cb37fd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:33.798833 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-86fe2c53-9ee7-4c8c-9053-09bd1e8c8354 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:33.799780 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-86fe2c53-9ee7-4c8c-9053-09bd1e8c8354 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: ecac51d1-33c3-49df-9926-d953f7315f52] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:33.806902 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-86fe2c53-9ee7-4c8c-9053-09bd1e8c8354 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:33.807737 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-86fe2c53-9ee7-4c8c-9053-09bd1e8c8354 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:33.808628 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-86fe2c53-9ee7-4c8c-9053-09bd1e8c8354 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:33.810565 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-86fe2c53-9ee7-4c8c-9053-09bd1e8c8354 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:33.898844 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-86fe2c53-9ee7-4c8c-9053-09bd1e8c8354 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d080fb7bd6049dea53fe1912d46b11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53fd1057c44dffb358b098d5f190fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:33.909232 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-86fe2c53-9ee7-4c8c-9053-09bd1e8c8354 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "GET /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52" status: 200 len: 1223 microversion: 2.1 time: 0.116644 Mar 08 14:54:33.910471 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 224/456] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:33 2022] GET /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52 => generated 1223 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:33.930779 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-1d3dc765-654b-4fa7-ad6b-83331777bfcf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:33.931399 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-1d3dc765-654b-4fa7-ad6b-83331777bfcf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:33.953322 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1d3dc765-654b-4fa7-ad6b-83331777bfcf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:33.953788 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1d3dc765-654b-4fa7-ad6b-83331777bfcf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:33.954622 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1d3dc765-654b-4fa7-ad6b-83331777bfcf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:33.955064 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1d3dc765-654b-4fa7-ad6b-83331777bfcf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:33.984550 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-53f3a544-7348-443f-89fd-619ab6cb37fd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:33.993610 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-53f3a544-7348-443f-89fd-619ab6cb37fd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:33.995654 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-53f3a544-7348-443f-89fd-619ab6cb37fd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:33.997190 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-53f3a544-7348-443f-89fd-619ab6cb37fd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1810 microversion: 2.20 time: 0.234254 Mar 08 14:54:33.998252 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 233/457] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:54:33 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1810 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:54:34.024221 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-1d3dc765-654b-4fa7-ad6b-83331777bfcf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:34.032393 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-1d3dc765-654b-4fa7-ad6b-83331777bfcf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1137 microversion: 2.1 time: 0.119966 Mar 08 14:54:34.032966 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 225/458] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:33 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1137 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:34.355165 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-2c677d45-b2bc-4076-888d-623034957244 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:34.355769 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-2c677d45-b2bc-4076-888d-623034957244 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:34.363112 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2c677d45-b2bc-4076-888d-623034957244 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:34.363413 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2c677d45-b2bc-4076-888d-623034957244 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:34.364275 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2c677d45-b2bc-4076-888d-623034957244 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:34.364723 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2c677d45-b2bc-4076-888d-623034957244 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:34.406123 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-ea508dc8-9cb9-484f-b36b-6cd90c4bb71a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:34.427944 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-ea508dc8-9cb9-484f-b36b-6cd90c4bb71a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:34.438895 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ea508dc8-9cb9-484f-b36b-6cd90c4bb71a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:34.439645 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ea508dc8-9cb9-484f-b36b-6cd90c4bb71a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:34.440640 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ea508dc8-9cb9-484f-b36b-6cd90c4bb71a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:34.441399 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ea508dc8-9cb9-484f-b36b-6cd90c4bb71a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:34.484522 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-2c677d45-b2bc-4076-888d-623034957244 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:34.496062 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-2c677d45-b2bc-4076-888d-623034957244 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1317 microversion: 2.1 time: 0.144582 Mar 08 14:54:34.519459 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 234/459] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:34 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:34.670053 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-ea508dc8-9cb9-484f-b36b-6cd90c4bb71a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:34.681194 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-ea508dc8-9cb9-484f-b36b-6cd90c4bb71a tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1522 microversion: 2.1 time: 0.280056 Mar 08 14:54:34.693699 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 226/460] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:34 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:34.931305 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-4bdf4d17-4c60-4ee1-826d-bba493a907a5 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:34.931935 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-4bdf4d17-4c60-4ee1-826d-bba493a907a5 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: ecac51d1-33c3-49df-9926-d953f7315f52] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:34.945108 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4bdf4d17-4c60-4ee1-826d-bba493a907a5 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:34.945445 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4bdf4d17-4c60-4ee1-826d-bba493a907a5 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:34.947620 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4bdf4d17-4c60-4ee1-826d-bba493a907a5 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:34.950590 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4bdf4d17-4c60-4ee1-826d-bba493a907a5 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:35.018814 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-87806cc9-e94e-436d-b8c9-110611009463 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:35.020114 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-87806cc9-e94e-436d-b8c9-110611009463 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:35.040485 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-87806cc9-e94e-436d-b8c9-110611009463 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:35.041309 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-87806cc9-e94e-436d-b8c9-110611009463 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:35.042493 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-87806cc9-e94e-436d-b8c9-110611009463 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:35.043101 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-87806cc9-e94e-436d-b8c9-110611009463 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:35.283569 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-87806cc9-e94e-436d-b8c9-110611009463 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:35.285273 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-4bdf4d17-4c60-4ee1-826d-bba493a907a5 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d080fb7bd6049dea53fe1912d46b11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53fd1057c44dffb358b098d5f190fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:35.294095 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-87806cc9-e94e-436d-b8c9-110611009463 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:35.296494 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-87806cc9-e94e-436d-b8c9-110611009463 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:35.299107 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-87806cc9-e94e-436d-b8c9-110611009463 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1810 microversion: 2.20 time: 0.285871 Mar 08 14:54:35.300861 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-4bdf4d17-4c60-4ee1-826d-bba493a907a5 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "GET /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52" status: 200 len: 1277 microversion: 2.1 time: 0.367574 Mar 08 14:54:35.301594 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 235/461] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:34 2022] GET /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52 => generated 1277 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:35.314627 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 227/462] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:54:35 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1810 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:54:35.316474 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ba439289-915c-493c-bafc-e150e91806e3 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:35.317350 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ba439289-915c-493c-bafc-e150e91806e3 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:35.319716 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-0336708d-0cd0-494c-ac6f-08b27aff682d tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:54:35.327307 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0336708d-0cd0-494c-ac6f-08b27aff682d tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:35.327819 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0336708d-0cd0-494c-ac6f-08b27aff682d tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:35.329382 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ba439289-915c-493c-bafc-e150e91806e3 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:35.332879 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ba439289-915c-493c-bafc-e150e91806e3 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:35.335361 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ba439289-915c-493c-bafc-e150e91806e3 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:35.335961 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ba439289-915c-493c-bafc-e150e91806e3 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:35.359568 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-0336708d-0cd0-494c-ac6f-08b27aff682d tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Going to try to stop instance {{(pid=128351) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Mar 08 14:54:35.469162 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-0336708d-0cd0-494c-ac6f-08b27aff682d tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "POST /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e/action" status: 202 len: 0 microversion: 2.1 time: 0.141165 Mar 08 14:54:35.474287 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 228/463] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Mar 8 14:54:35 2022] POST /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 14:54:35.503209 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-aa83a6fa-63da-4002-a163-bccc906c2ee4 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:35.504760 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-aa83a6fa-63da-4002-a163-bccc906c2ee4 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:35.521077 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-aa83a6fa-63da-4002-a163-bccc906c2ee4 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:35.521928 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-aa83a6fa-63da-4002-a163-bccc906c2ee4 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:35.523120 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-aa83a6fa-63da-4002-a163-bccc906c2ee4 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:35.523908 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-aa83a6fa-63da-4002-a163-bccc906c2ee4 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:35.603472 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ba439289-915c-493c-bafc-e150e91806e3 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:35.624793 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ba439289-915c-493c-bafc-e150e91806e3 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1211 microversion: 2.1 time: 0.313694 Mar 08 14:54:35.635601 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 236/464] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:35 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1211 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:35.640733 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-663fb446-a0cc-4771-840f-8e1af20c529a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:35.641565 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-663fb446-a0cc-4771-840f-8e1af20c529a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:35.652586 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-663fb446-a0cc-4771-840f-8e1af20c529a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:35.656367 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-663fb446-a0cc-4771-840f-8e1af20c529a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:35.657397 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-663fb446-a0cc-4771-840f-8e1af20c529a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:35.662193 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-663fb446-a0cc-4771-840f-8e1af20c529a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:35.806233 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-663fb446-a0cc-4771-840f-8e1af20c529a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:35.810337 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-aa83a6fa-63da-4002-a163-bccc906c2ee4 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:35.816529 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-663fb446-a0cc-4771-840f-8e1af20c529a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1317 microversion: 2.1 time: 0.179504 Mar 08 14:54:35.820081 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-aa83a6fa-63da-4002-a163-bccc906c2ee4 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1677 microversion: 2.1 time: 0.327102 Mar 08 14:54:35.821379 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 237/465] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:35 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:35.826665 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 229/466] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:35 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1677 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:35.827248 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-18ab1793-204c-45a7-ad94-12312bf3e9e6 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:35.828098 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-18ab1793-204c-45a7-ad94-12312bf3e9e6 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:35.835075 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-18ab1793-204c-45a7-ad94-12312bf3e9e6 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:35.835765 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-18ab1793-204c-45a7-ad94-12312bf3e9e6 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:35.837002 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-18ab1793-204c-45a7-ad94-12312bf3e9e6 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:35.837697 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-18ab1793-204c-45a7-ad94-12312bf3e9e6 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:36.321104 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-5e521791-d657-4673-b9bc-3316fe3ac4b8 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:36.323190 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-5e521791-d657-4673-b9bc-3316fe3ac4b8 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: ecac51d1-33c3-49df-9926-d953f7315f52] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:36.332433 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5e521791-d657-4673-b9bc-3316fe3ac4b8 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:36.333725 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5e521791-d657-4673-b9bc-3316fe3ac4b8 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:36.339988 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5e521791-d657-4673-b9bc-3316fe3ac4b8 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:36.341516 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5e521791-d657-4673-b9bc-3316fe3ac4b8 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:36.398244 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-18ab1793-204c-45a7-ad94-12312bf3e9e6 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:36.410185 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-18ab1793-204c-45a7-ad94-12312bf3e9e6 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1522 microversion: 2.1 time: 0.587449 Mar 08 14:54:36.412514 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 238/467] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:35 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1522 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:36.428462 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3e117323-5303-40bd-97d5-127d9cac06d2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:36.429476 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-3e117323-5303-40bd-97d5-127d9cac06d2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:36.431319 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-5e521791-d657-4673-b9bc-3316fe3ac4b8 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d080fb7bd6049dea53fe1912d46b11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53fd1057c44dffb358b098d5f190fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:36.436807 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3e117323-5303-40bd-97d5-127d9cac06d2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:36.438381 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3e117323-5303-40bd-97d5-127d9cac06d2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:36.439643 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3e117323-5303-40bd-97d5-127d9cac06d2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:36.440257 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3e117323-5303-40bd-97d5-127d9cac06d2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:36.444169 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-5e521791-d657-4673-b9bc-3316fe3ac4b8 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "GET /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52" status: 200 len: 1277 microversion: 2.1 time: 0.128318 Mar 08 14:54:36.454203 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 230/468] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:36 2022] GET /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52 => generated 1277 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:36.625008 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-95fa7d5c-f80a-4b1b-9769-ba46f1ffac5f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-885719881", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-665506048", "security_groups": [{"name": "tempest-secgroup-smoke-604922245"}], "networks": [{"uuid": "6ef02a5b-489c-4f13-9a8e-f2170e8375ca"}], "block_device_mapping_v2": [{"uuid": "367fdced-b9d9-4cd8-94e7-f565604fd393", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:54:36.769348 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-3e117323-5303-40bd-97d5-127d9cac06d2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:36.780292 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-3e117323-5303-40bd-97d5-127d9cac06d2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:36.786842 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-3e117323-5303-40bd-97d5-127d9cac06d2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:36.788267 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-3e117323-5303-40bd-97d5-127d9cac06d2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1810 microversion: 2.20 time: 0.365629 Mar 08 14:54:36.794923 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 239/469] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:54:36 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1810 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:54:36.800820 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-101df655-2091-45b0-9469-f6c91596085e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:36.801448 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-101df655-2091-45b0-9469-f6c91596085e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:36.807533 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-101df655-2091-45b0-9469-f6c91596085e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:36.807989 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-101df655-2091-45b0-9469-f6c91596085e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:36.808768 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-101df655-2091-45b0-9469-f6c91596085e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:36.809508 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-101df655-2091-45b0-9469-f6c91596085e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:36.834440 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.network.neutron [None req-95fa7d5c-f80a-4b1b-9769-ba46f1ffac5f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] validate_networks() for [('6ef02a5b-489c-4f13-9a8e-f2170e8375ca', None, None, None, None, None)] {{(pid=128351) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 14:54:36.889493 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-101df655-2091-45b0-9469-f6c91596085e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:36.898037 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-101df655-2091-45b0-9469-f6c91596085e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1211 microversion: 2.1 time: 0.101697 Mar 08 14:54:36.899844 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 240/470] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:36 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1211 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:36.913115 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-574999c9-b9d4-4107-943a-6bd801331474 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:36.914111 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-574999c9-b9d4-4107-943a-6bd801331474 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:36.921317 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-574999c9-b9d4-4107-943a-6bd801331474 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:36.922293 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-574999c9-b9d4-4107-943a-6bd801331474 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:36.923178 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-574999c9-b9d4-4107-943a-6bd801331474 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:36.923716 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-574999c9-b9d4-4107-943a-6bd801331474 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:37.156141 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-574999c9-b9d4-4107-943a-6bd801331474 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:37.166234 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-574999c9-b9d4-4107-943a-6bd801331474 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1359 microversion: 2.1 time: 0.265068 Mar 08 14:54:37.176059 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 241/471] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:36 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1359 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:37.179334 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-a7cd6d31-9ee9-4eca-9ce1-1021dadeab3f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:37.180153 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-a7cd6d31-9ee9-4eca-9ce1-1021dadeab3f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:37.188881 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a7cd6d31-9ee9-4eca-9ce1-1021dadeab3f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:37.189593 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a7cd6d31-9ee9-4eca-9ce1-1021dadeab3f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:37.190554 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a7cd6d31-9ee9-4eca-9ce1-1021dadeab3f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:37.191174 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a7cd6d31-9ee9-4eca-9ce1-1021dadeab3f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:37.368373 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-a7cd6d31-9ee9-4eca-9ce1-1021dadeab3f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:37.380206 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-a7cd6d31-9ee9-4eca-9ce1-1021dadeab3f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1677 microversion: 2.1 time: 0.207727 Mar 08 14:54:37.381913 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 242/472] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:37 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1677 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:37.421011 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-95fa7d5c-f80a-4b1b-9769-ba46f1ffac5f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Flavor limits 0:0:0 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 14:54:37.421564 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-95fa7d5c-f80a-4b1b-9769-ba46f1ffac5f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Image limits 0:0:0 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 14:54:37.422300 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-95fa7d5c-f80a-4b1b-9769-ba46f1ffac5f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Flavor pref 0:0:0 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 14:54:37.423034 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-95fa7d5c-f80a-4b1b-9769-ba46f1ffac5f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Image pref 0:0:0 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 14:54:37.423888 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-95fa7d5c-f80a-4b1b-9769-ba46f1ffac5f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 14:54:37.428316 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ed5fdece-2d7e-496e-9c83-6d0489b89dc2 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:37.429136 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ed5fdece-2d7e-496e-9c83-6d0489b89dc2 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:37.436240 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-95fa7d5c-f80a-4b1b-9769-ba46f1ffac5f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:37.437269 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-95fa7d5c-f80a-4b1b-9769-ba46f1ffac5f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:37.438254 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-95fa7d5c-f80a-4b1b-9769-ba46f1ffac5f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:37.438793 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-95fa7d5c-f80a-4b1b-9769-ba46f1ffac5f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:37.439873 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ed5fdece-2d7e-496e-9c83-6d0489b89dc2 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:37.445788 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ed5fdece-2d7e-496e-9c83-6d0489b89dc2 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:37.446754 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ed5fdece-2d7e-496e-9c83-6d0489b89dc2 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:37.447279 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ed5fdece-2d7e-496e-9c83-6d0489b89dc2 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:37.463586 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.quota [None req-95fa7d5c-f80a-4b1b-9769-ba46f1ffac5f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Getting quotas for project d8469a7d8671451eb029d18b67e7f76d. Resources: {'instances', 'ram', 'cores'} {{(pid=128351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 14:54:37.471419 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.quota [None req-95fa7d5c-f80a-4b1b-9769-ba46f1ffac5f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Getting quotas for user 86a6549a475a4cbe803ab5bed1c91e51 and project d8469a7d8671451eb029d18b67e7f76d. Resources: {'instances', 'ram', 'cores'} {{(pid=128351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 14:54:37.558264 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-95fa7d5c-f80a-4b1b-9769-ba46f1ffac5f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Going to run 1 instances... {{(pid=128351) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 14:54:37.561687 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-95fa7d5c-f80a-4b1b-9769-ba46f1ffac5f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='367fdced-b9d9-4cd8-94e7-f565604fd393',volume_size=None,volume_type=None)] {{(pid=128351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 14:54:37.651344 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ed5fdece-2d7e-496e-9c83-6d0489b89dc2 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:37.659079 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ed5fdece-2d7e-496e-9c83-6d0489b89dc2 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1522 microversion: 2.1 time: 0.234487 Mar 08 14:54:37.659652 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 243/473] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:37 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:54:37.674486 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-97804b4d-b8d6-498a-8d0c-9628130cfa11 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:37.675327 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-97804b4d-b8d6-498a-8d0c-9628130cfa11 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: ecac51d1-33c3-49df-9926-d953f7315f52] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:37.681691 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-97804b4d-b8d6-498a-8d0c-9628130cfa11 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:37.682400 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-97804b4d-b8d6-498a-8d0c-9628130cfa11 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:37.683191 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-97804b4d-b8d6-498a-8d0c-9628130cfa11 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:37.683796 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-97804b4d-b8d6-498a-8d0c-9628130cfa11 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:37.728325 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-95fa7d5c-f80a-4b1b-9769-ba46f1ffac5f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.106840 Mar 08 14:54:37.728325 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 231/474] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Mar 8 14:54:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 1108 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 08 14:54:37.748814 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-35c0f983-f4f0-4ed6-9912-c1d5449cd886 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:37.750941 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-35c0f983-f4f0-4ed6-9912-c1d5449cd886 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:37.812836 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-35c0f983-f4f0-4ed6-9912-c1d5449cd886 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:37.822662 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-35c0f983-f4f0-4ed6-9912-c1d5449cd886 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1087 microversion: 2.1 time: 0.078907 Mar 08 14:54:37.823272 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 232/475] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:37 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1087 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:37.844307 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-d6e60f97-f64e-4195-810c-cabeec55bd6b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:37.844925 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-d6e60f97-f64e-4195-810c-cabeec55bd6b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:37.851683 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d6e60f97-f64e-4195-810c-cabeec55bd6b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:37.852213 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d6e60f97-f64e-4195-810c-cabeec55bd6b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:37.853065 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d6e60f97-f64e-4195-810c-cabeec55bd6b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:37.853571 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d6e60f97-f64e-4195-810c-cabeec55bd6b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:37.893960 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-97804b4d-b8d6-498a-8d0c-9628130cfa11 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d080fb7bd6049dea53fe1912d46b11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53fd1057c44dffb358b098d5f190fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:37.901750 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-97804b4d-b8d6-498a-8d0c-9628130cfa11 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "GET /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52" status: 200 len: 1319 microversion: 2.1 time: 0.231060 Mar 08 14:54:37.902540 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 244/476] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:37 2022] GET /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52 => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:37.918999 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d5317b5a-8275-4959-9117-11f093b2661e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:37.920518 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d5317b5a-8275-4959-9117-11f093b2661e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:37.928145 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d5317b5a-8275-4959-9117-11f093b2661e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:37.929054 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d5317b5a-8275-4959-9117-11f093b2661e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:37.930121 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d5317b5a-8275-4959-9117-11f093b2661e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:37.930862 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d5317b5a-8275-4959-9117-11f093b2661e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:38.030631 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d5317b5a-8275-4959-9117-11f093b2661e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:38.038988 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d5317b5a-8275-4959-9117-11f093b2661e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1211 microversion: 2.1 time: 0.126444 Mar 08 14:54:38.048946 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 245/477] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:37 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1211 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:54:38.086585 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-d6e60f97-f64e-4195-810c-cabeec55bd6b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:38.098086 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-d6e60f97-f64e-4195-810c-cabeec55bd6b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:38.099721 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-d6e60f97-f64e-4195-810c-cabeec55bd6b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:38.102387 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-d6e60f97-f64e-4195-810c-cabeec55bd6b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1810 microversion: 2.20 time: 0.271515 Mar 08 14:54:38.114556 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 233/478] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:54:37 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1810 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:54:38.183279 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-51867551-735f-45bc-b1fd-239a36f762a0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:38.184873 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-51867551-735f-45bc-b1fd-239a36f762a0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:38.195227 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-51867551-735f-45bc-b1fd-239a36f762a0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:38.197693 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-51867551-735f-45bc-b1fd-239a36f762a0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:38.199385 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-51867551-735f-45bc-b1fd-239a36f762a0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:38.201758 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-51867551-735f-45bc-b1fd-239a36f762a0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:38.341813 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-51867551-735f-45bc-b1fd-239a36f762a0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:38.349054 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-51867551-735f-45bc-b1fd-239a36f762a0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1359 microversion: 2.1 time: 0.170048 Mar 08 14:54:38.349624 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 246/479] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:38 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:38.398852 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-5a9bc796-a884-4b01-966e-3803ab15097c tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:38.399454 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-5a9bc796-a884-4b01-966e-3803ab15097c tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:38.405995 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5a9bc796-a884-4b01-966e-3803ab15097c tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:38.406457 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5a9bc796-a884-4b01-966e-3803ab15097c tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:38.407241 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5a9bc796-a884-4b01-966e-3803ab15097c tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:38.407687 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5a9bc796-a884-4b01-966e-3803ab15097c tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:38.545173 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-5a9bc796-a884-4b01-966e-3803ab15097c tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:38.553159 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-5a9bc796-a884-4b01-966e-3803ab15097c tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1677 microversion: 2.1 time: 0.158085 Mar 08 14:54:38.564002 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 234/480] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:38 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:38.676805 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-fc6a64e7-0b43-4570-be09-9af5b51a9f43 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:38.677489 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-fc6a64e7-0b43-4570-be09-9af5b51a9f43 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:38.684385 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fc6a64e7-0b43-4570-be09-9af5b51a9f43 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:38.685149 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fc6a64e7-0b43-4570-be09-9af5b51a9f43 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:38.686003 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fc6a64e7-0b43-4570-be09-9af5b51a9f43 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:38.686445 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fc6a64e7-0b43-4570-be09-9af5b51a9f43 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:38.839704 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-fc6a64e7-0b43-4570-be09-9af5b51a9f43 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:38.839958 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-9e6db487-b972-4fda-9c5f-291140cea1ac tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:38.841190 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-9e6db487-b972-4fda-9c5f-291140cea1ac tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:38.848128 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9e6db487-b972-4fda-9c5f-291140cea1ac tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:38.848578 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9e6db487-b972-4fda-9c5f-291140cea1ac tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:38.848827 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-fc6a64e7-0b43-4570-be09-9af5b51a9f43 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1522 microversion: 2.1 time: 0.176101 Mar 08 14:54:38.849354 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9e6db487-b972-4fda-9c5f-291140cea1ac tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:38.849495 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 247/481] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:38 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:54:38.850366 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9e6db487-b972-4fda-9c5f-291140cea1ac tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:38.914983 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-9e6db487-b972-4fda-9c5f-291140cea1ac tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:38.918796 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-389dfbb5-2a33-4308-92ac-aeb15d408d1a tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:38.919518 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-389dfbb5-2a33-4308-92ac-aeb15d408d1a tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: ecac51d1-33c3-49df-9926-d953f7315f52] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:38.922418 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-9e6db487-b972-4fda-9c5f-291140cea1ac tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1137 microversion: 2.1 time: 0.086354 Mar 08 14:54:38.922982 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 235/482] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:38 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1137 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:38.925395 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-389dfbb5-2a33-4308-92ac-aeb15d408d1a tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:38.925873 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-389dfbb5-2a33-4308-92ac-aeb15d408d1a tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:38.926664 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-389dfbb5-2a33-4308-92ac-aeb15d408d1a tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:38.927156 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-389dfbb5-2a33-4308-92ac-aeb15d408d1a tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:39.056585 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-fe456000-268d-4b13-95b8-04c33a866287 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:39.057526 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-fe456000-268d-4b13-95b8-04c33a866287 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:39.064462 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fe456000-268d-4b13-95b8-04c33a866287 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:39.064994 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fe456000-268d-4b13-95b8-04c33a866287 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:39.065795 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fe456000-268d-4b13-95b8-04c33a866287 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:39.066251 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fe456000-268d-4b13-95b8-04c33a866287 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:39.084748 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-389dfbb5-2a33-4308-92ac-aeb15d408d1a tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d080fb7bd6049dea53fe1912d46b11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53fd1057c44dffb358b098d5f190fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:39.091987 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-389dfbb5-2a33-4308-92ac-aeb15d408d1a tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "GET /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52" status: 200 len: 1319 microversion: 2.1 time: 0.177245 Mar 08 14:54:39.092552 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 248/483] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:38 2022] GET /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:54:39.122429 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-7e21fd2b-e8a3-42a6-84e4-e44fd9d1559c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:39.123159 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-7e21fd2b-e8a3-42a6-84e4-e44fd9d1559c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:39.129418 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7e21fd2b-e8a3-42a6-84e4-e44fd9d1559c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:39.130706 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7e21fd2b-e8a3-42a6-84e4-e44fd9d1559c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:39.131836 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7e21fd2b-e8a3-42a6-84e4-e44fd9d1559c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:39.132428 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-fe456000-268d-4b13-95b8-04c33a866287 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:39.132788 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7e21fd2b-e8a3-42a6-84e4-e44fd9d1559c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:39.150384 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-fe456000-268d-4b13-95b8-04c33a866287 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1211 microversion: 2.1 time: 0.093474 Mar 08 14:54:39.161326 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 236/484] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:39 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1211 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:54:39.283422 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-7e21fd2b-e8a3-42a6-84e4-e44fd9d1559c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:39.291770 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-7e21fd2b-e8a3-42a6-84e4-e44fd9d1559c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:39.293967 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-7e21fd2b-e8a3-42a6-84e4-e44fd9d1559c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:39.295391 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-7e21fd2b-e8a3-42a6-84e4-e44fd9d1559c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1810 microversion: 2.20 time: 0.177744 Mar 08 14:54:39.296068 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 249/485] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:54:39 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1810 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 14:54:39.366374 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-54b0b892-e8f8-4ada-993f-35d96f061ee4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:39.367369 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-54b0b892-e8f8-4ada-993f-35d96f061ee4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:39.374453 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-54b0b892-e8f8-4ada-993f-35d96f061ee4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:39.374913 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-54b0b892-e8f8-4ada-993f-35d96f061ee4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:39.375705 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-54b0b892-e8f8-4ada-993f-35d96f061ee4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:39.376147 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-54b0b892-e8f8-4ada-993f-35d96f061ee4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:39.523175 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-54b0b892-e8f8-4ada-993f-35d96f061ee4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:39.533046 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-54b0b892-e8f8-4ada-993f-35d96f061ee4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1359 microversion: 2.1 time: 0.170378 Mar 08 14:54:39.534033 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 237/486] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:39 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:39.571151 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-9887065e-c619-4df1-b814-5cb2052c5b01 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:39.571995 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-9887065e-c619-4df1-b814-5cb2052c5b01 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:39.589070 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9887065e-c619-4df1-b814-5cb2052c5b01 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:39.589529 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9887065e-c619-4df1-b814-5cb2052c5b01 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:39.590920 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9887065e-c619-4df1-b814-5cb2052c5b01 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:39.591365 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9887065e-c619-4df1-b814-5cb2052c5b01 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:39.731169 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-9887065e-c619-4df1-b814-5cb2052c5b01 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:39.739009 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-9887065e-c619-4df1-b814-5cb2052c5b01 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1677 microversion: 2.1 time: 0.171660 Mar 08 14:54:39.739777 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 250/487] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:39 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:39.866801 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-dab73e66-01a7-42be-a6e3-d11fe427101b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:39.867404 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-dab73e66-01a7-42be-a6e3-d11fe427101b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:39.873426 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-dab73e66-01a7-42be-a6e3-d11fe427101b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:39.873898 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-dab73e66-01a7-42be-a6e3-d11fe427101b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:39.874669 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-dab73e66-01a7-42be-a6e3-d11fe427101b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:39.875102 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-dab73e66-01a7-42be-a6e3-d11fe427101b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:39.956140 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3214ad39-2ebf-4f77-a48a-392cf2499243 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:39.956997 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-3214ad39-2ebf-4f77-a48a-392cf2499243 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:39.965988 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3214ad39-2ebf-4f77-a48a-392cf2499243 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:39.968088 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3214ad39-2ebf-4f77-a48a-392cf2499243 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:39.969002 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3214ad39-2ebf-4f77-a48a-392cf2499243 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:39.969531 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3214ad39-2ebf-4f77-a48a-392cf2499243 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:40.034995 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-3214ad39-2ebf-4f77-a48a-392cf2499243 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:40.042978 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-3214ad39-2ebf-4f77-a48a-392cf2499243 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1137 microversion: 2.1 time: 0.100771 Mar 08 14:54:40.044508 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 251/488] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:39 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1137 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:40.062463 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-dab73e66-01a7-42be-a6e3-d11fe427101b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:40.071506 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-dab73e66-01a7-42be-a6e3-d11fe427101b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1522 microversion: 2.1 time: 0.208444 Mar 08 14:54:40.073910 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 238/489] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:39 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:40.110743 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-790ab5db-cba9-4b27-b28d-65b1ec51cac7 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:40.111371 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-790ab5db-cba9-4b27-b28d-65b1ec51cac7 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: ecac51d1-33c3-49df-9926-d953f7315f52] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:40.118352 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-790ab5db-cba9-4b27-b28d-65b1ec51cac7 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:40.118860 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-790ab5db-cba9-4b27-b28d-65b1ec51cac7 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:40.119678 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-790ab5db-cba9-4b27-b28d-65b1ec51cac7 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:40.120262 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-790ab5db-cba9-4b27-b28d-65b1ec51cac7 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:40.168193 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-6a588e23-248e-4c12-b6d9-b22217512c23 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:40.169380 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-6a588e23-248e-4c12-b6d9-b22217512c23 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:40.175499 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6a588e23-248e-4c12-b6d9-b22217512c23 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:40.175954 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6a588e23-248e-4c12-b6d9-b22217512c23 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:40.176723 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6a588e23-248e-4c12-b6d9-b22217512c23 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:40.177163 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6a588e23-248e-4c12-b6d9-b22217512c23 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:40.261652 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-790ab5db-cba9-4b27-b28d-65b1ec51cac7 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d080fb7bd6049dea53fe1912d46b11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53fd1057c44dffb358b098d5f190fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:40.272672 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-790ab5db-cba9-4b27-b28d-65b1ec51cac7 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "GET /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52" status: 200 len: 1319 microversion: 2.1 time: 0.167439 Mar 08 14:54:40.274308 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 252/490] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:40 2022] GET /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:40.316013 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-0f658f28-80df-4c7d-b7b2-ec9615fa34cb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:40.316725 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-0f658f28-80df-4c7d-b7b2-ec9615fa34cb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:40.325703 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0f658f28-80df-4c7d-b7b2-ec9615fa34cb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:40.326665 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0f658f28-80df-4c7d-b7b2-ec9615fa34cb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:40.327684 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0f658f28-80df-4c7d-b7b2-ec9615fa34cb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:40.328525 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0f658f28-80df-4c7d-b7b2-ec9615fa34cb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:40.476179 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-0f658f28-80df-4c7d-b7b2-ec9615fa34cb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:40.481767 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-6a588e23-248e-4c12-b6d9-b22217512c23 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:40.484832 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-0f658f28-80df-4c7d-b7b2-ec9615fa34cb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:40.486476 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-0f658f28-80df-4c7d-b7b2-ec9615fa34cb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:40.487726 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-0f658f28-80df-4c7d-b7b2-ec9615fa34cb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1810 microversion: 2.20 time: 0.176833 Mar 08 14:54:40.488371 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 253/491] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:54:40 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1810 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 14:54:40.489383 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-6a588e23-248e-4c12-b6d9-b22217512c23 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1211 microversion: 2.1 time: 0.325079 Mar 08 14:54:40.490024 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 239/492] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:40 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1211 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:54:40.550706 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-4f82c246-f0f3-4559-9ddd-8fef4ddbd647 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:40.551317 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-4f82c246-f0f3-4559-9ddd-8fef4ddbd647 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:40.557582 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4f82c246-f0f3-4559-9ddd-8fef4ddbd647 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:40.558085 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4f82c246-f0f3-4559-9ddd-8fef4ddbd647 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:40.559030 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4f82c246-f0f3-4559-9ddd-8fef4ddbd647 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:40.559939 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4f82c246-f0f3-4559-9ddd-8fef4ddbd647 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:40.710320 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-4f82c246-f0f3-4559-9ddd-8fef4ddbd647 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:40.718441 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-4f82c246-f0f3-4559-9ddd-8fef4ddbd647 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1359 microversion: 2.1 time: 0.171501 Mar 08 14:54:40.719018 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 254/493] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:40 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:40.757233 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-4387b50a-6559-4fa4-9733-bef9985eb944 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:40.757837 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-4387b50a-6559-4fa4-9733-bef9985eb944 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:40.764711 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4387b50a-6559-4fa4-9733-bef9985eb944 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:40.765177 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4387b50a-6559-4fa4-9733-bef9985eb944 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:40.766002 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4387b50a-6559-4fa4-9733-bef9985eb944 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:40.766641 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4387b50a-6559-4fa4-9733-bef9985eb944 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:40.928981 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-4387b50a-6559-4fa4-9733-bef9985eb944 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:40.936421 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-4387b50a-6559-4fa4-9733-bef9985eb944 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1677 microversion: 2.1 time: 0.183754 Mar 08 14:54:40.936983 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 240/494] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:40 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1677 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:41.063158 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-299ce95c-1a8b-46b7-a536-e4c4052d8ae2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:41.063907 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-299ce95c-1a8b-46b7-a536-e4c4052d8ae2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:41.071370 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-299ce95c-1a8b-46b7-a536-e4c4052d8ae2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:41.071831 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-299ce95c-1a8b-46b7-a536-e4c4052d8ae2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:41.072625 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-299ce95c-1a8b-46b7-a536-e4c4052d8ae2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:41.073070 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-299ce95c-1a8b-46b7-a536-e4c4052d8ae2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:41.091981 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-510c17f3-2a2a-4011-9ab4-1603b3282a59 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:41.092767 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-510c17f3-2a2a-4011-9ab4-1603b3282a59 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:41.100009 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-510c17f3-2a2a-4011-9ab4-1603b3282a59 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:41.100685 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-510c17f3-2a2a-4011-9ab4-1603b3282a59 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:41.102188 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-510c17f3-2a2a-4011-9ab4-1603b3282a59 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:41.102701 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-510c17f3-2a2a-4011-9ab4-1603b3282a59 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:41.135096 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-299ce95c-1a8b-46b7-a536-e4c4052d8ae2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:41.142991 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-299ce95c-1a8b-46b7-a536-e4c4052d8ae2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1137 microversion: 2.1 time: 0.085971 Mar 08 14:54:41.143563 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 255/495] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:41 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1137 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:41.272388 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-510c17f3-2a2a-4011-9ab4-1603b3282a59 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:41.283251 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-510c17f3-2a2a-4011-9ab4-1603b3282a59 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1522 microversion: 2.1 time: 0.197096 Mar 08 14:54:41.284044 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 241/496] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:41 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:41.290592 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d506f320-6e37-4efa-8f22-a4f923ca70f4 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:41.291292 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d506f320-6e37-4efa-8f22-a4f923ca70f4 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: ecac51d1-33c3-49df-9926-d953f7315f52] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:41.297815 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d506f320-6e37-4efa-8f22-a4f923ca70f4 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:41.298415 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d506f320-6e37-4efa-8f22-a4f923ca70f4 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:41.299197 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d506f320-6e37-4efa-8f22-a4f923ca70f4 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:41.299638 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d506f320-6e37-4efa-8f22-a4f923ca70f4 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:41.447588 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d506f320-6e37-4efa-8f22-a4f923ca70f4 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d080fb7bd6049dea53fe1912d46b11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53fd1057c44dffb358b098d5f190fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:41.461031 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d506f320-6e37-4efa-8f22-a4f923ca70f4 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "GET /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52" status: 200 len: 1319 microversion: 2.1 time: 0.174016 Mar 08 14:54:41.472991 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 256/497] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:41 2022] GET /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:54:41.506016 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-d8c0d19b-60c4-420c-9e61-dd619d120751 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:41.506253 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-68831df8-b268-4d05-b859-1c8678a27e22 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:41.506784 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-68831df8-b268-4d05-b859-1c8678a27e22 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:41.507095 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-d8c0d19b-60c4-420c-9e61-dd619d120751 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:41.513994 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-68831df8-b268-4d05-b859-1c8678a27e22 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:41.514443 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-68831df8-b268-4d05-b859-1c8678a27e22 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:41.515227 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-68831df8-b268-4d05-b859-1c8678a27e22 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:41.515664 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-68831df8-b268-4d05-b859-1c8678a27e22 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:41.516182 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d8c0d19b-60c4-420c-9e61-dd619d120751 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:41.516921 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d8c0d19b-60c4-420c-9e61-dd619d120751 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:41.517764 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d8c0d19b-60c4-420c-9e61-dd619d120751 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:41.518239 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d8c0d19b-60c4-420c-9e61-dd619d120751 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:41.586725 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-68831df8-b268-4d05-b859-1c8678a27e22 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:41.594773 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-68831df8-b268-4d05-b859-1c8678a27e22 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1211 microversion: 2.1 time: 0.092207 Mar 08 14:54:41.617323 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 257/498] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:41 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1211 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:54:41.672762 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-d8c0d19b-60c4-420c-9e61-dd619d120751 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:41.681145 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-d8c0d19b-60c4-420c-9e61-dd619d120751 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:41.682702 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-d8c0d19b-60c4-420c-9e61-dd619d120751 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:41.684454 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-d8c0d19b-60c4-420c-9e61-dd619d120751 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1810 microversion: 2.20 time: 0.181852 Mar 08 14:54:41.685284 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 242/499] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:54:41 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1810 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:54:41.735186 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-2e556442-18eb-45ea-bd98-9f440fd3b37c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:41.735809 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-2e556442-18eb-45ea-bd98-9f440fd3b37c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:41.741706 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2e556442-18eb-45ea-bd98-9f440fd3b37c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:41.742203 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2e556442-18eb-45ea-bd98-9f440fd3b37c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:41.742973 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2e556442-18eb-45ea-bd98-9f440fd3b37c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:41.743418 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2e556442-18eb-45ea-bd98-9f440fd3b37c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:41.916849 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-2e556442-18eb-45ea-bd98-9f440fd3b37c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:41.924566 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-2e556442-18eb-45ea-bd98-9f440fd3b37c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1359 microversion: 2.1 time: 0.193261 Mar 08 14:54:41.925128 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 258/500] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:41 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1359 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:41.952494 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b499d003-359a-4a60-a965-8adfffb3a29c tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:41.953111 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-b499d003-359a-4a60-a965-8adfffb3a29c tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:41.959166 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b499d003-359a-4a60-a965-8adfffb3a29c tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:41.959623 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b499d003-359a-4a60-a965-8adfffb3a29c tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:41.960405 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b499d003-359a-4a60-a965-8adfffb3a29c tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:41.960845 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b499d003-359a-4a60-a965-8adfffb3a29c tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:42.096826 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-b499d003-359a-4a60-a965-8adfffb3a29c tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:42.105128 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-b499d003-359a-4a60-a965-8adfffb3a29c tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1677 microversion: 2.1 time: 0.156461 Mar 08 14:54:42.116250 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 243/501] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:41 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:42.161621 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c928db8e-3b4b-44f1-826f-aa0eaf5531f8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:42.162461 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-c928db8e-3b4b-44f1-826f-aa0eaf5531f8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:42.172175 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c928db8e-3b4b-44f1-826f-aa0eaf5531f8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:42.172628 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c928db8e-3b4b-44f1-826f-aa0eaf5531f8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:42.173524 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c928db8e-3b4b-44f1-826f-aa0eaf5531f8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:42.174021 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c928db8e-3b4b-44f1-826f-aa0eaf5531f8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:42.236303 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-c928db8e-3b4b-44f1-826f-aa0eaf5531f8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:42.243553 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-c928db8e-3b4b-44f1-826f-aa0eaf5531f8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1137 microversion: 2.1 time: 0.086742 Mar 08 14:54:42.244111 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 259/502] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:42 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1137 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:42.303219 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-70ffeecb-8d21-487c-bee2-2c4ad98a4ee4 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:42.303815 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-70ffeecb-8d21-487c-bee2-2c4ad98a4ee4 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:42.310852 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-70ffeecb-8d21-487c-bee2-2c4ad98a4ee4 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:42.311310 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-70ffeecb-8d21-487c-bee2-2c4ad98a4ee4 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:42.312232 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-70ffeecb-8d21-487c-bee2-2c4ad98a4ee4 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:42.312677 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-70ffeecb-8d21-487c-bee2-2c4ad98a4ee4 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:42.462306 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-70ffeecb-8d21-487c-bee2-2c4ad98a4ee4 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:42.470452 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-70ffeecb-8d21-487c-bee2-2c4ad98a4ee4 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1522 microversion: 2.1 time: 0.173143 Mar 08 14:54:42.471041 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 244/503] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:42 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:42.485974 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-4045d44c-01ce-4ac5-a66a-d040471d74d1 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:42.486660 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-4045d44c-01ce-4ac5-a66a-d040471d74d1 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: ecac51d1-33c3-49df-9926-d953f7315f52] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:42.500197 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4045d44c-01ce-4ac5-a66a-d040471d74d1 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:42.500652 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4045d44c-01ce-4ac5-a66a-d040471d74d1 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:42.501441 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4045d44c-01ce-4ac5-a66a-d040471d74d1 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:42.501904 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4045d44c-01ce-4ac5-a66a-d040471d74d1 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:42.610977 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-3faf3188-1474-49f7-8c91-f6d68378fcfe tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:42.611849 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-3faf3188-1474-49f7-8c91-f6d68378fcfe tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:42.618515 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3faf3188-1474-49f7-8c91-f6d68378fcfe tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:42.618966 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3faf3188-1474-49f7-8c91-f6d68378fcfe tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:42.619795 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3faf3188-1474-49f7-8c91-f6d68378fcfe tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:42.620239 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3faf3188-1474-49f7-8c91-f6d68378fcfe tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:42.656232 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-4045d44c-01ce-4ac5-a66a-d040471d74d1 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d080fb7bd6049dea53fe1912d46b11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53fd1057c44dffb358b098d5f190fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:42.663676 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-4045d44c-01ce-4ac5-a66a-d040471d74d1 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "GET /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52" status: 200 len: 1319 microversion: 2.1 time: 0.181652 Mar 08 14:54:42.664475 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 260/504] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:42 2022] GET /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:42.680345 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-3faf3188-1474-49f7-8c91-f6d68378fcfe tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:42.688603 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-3faf3188-1474-49f7-8c91-f6d68378fcfe tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1211 microversion: 2.1 time: 0.081487 Mar 08 14:54:42.689170 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 245/505] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:42 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1211 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:54:42.702914 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-1c65cf4a-d700-47ff-8bec-d93a5be21680 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:42.703544 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-1c65cf4a-d700-47ff-8bec-d93a5be21680 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:42.709353 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1c65cf4a-d700-47ff-8bec-d93a5be21680 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:42.709798 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1c65cf4a-d700-47ff-8bec-d93a5be21680 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:42.710592 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1c65cf4a-d700-47ff-8bec-d93a5be21680 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:42.711024 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1c65cf4a-d700-47ff-8bec-d93a5be21680 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:42.860763 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-1c65cf4a-d700-47ff-8bec-d93a5be21680 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:42.870916 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-1c65cf4a-d700-47ff-8bec-d93a5be21680 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:42.873049 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-1c65cf4a-d700-47ff-8bec-d93a5be21680 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:42.874855 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-1c65cf4a-d700-47ff-8bec-d93a5be21680 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1810 microversion: 2.20 time: 0.175212 Mar 08 14:54:42.876462 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 261/506] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:54:42 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1810 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 14:54:42.943056 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-35572dff-d374-4a77-80e3-633fc0edf5c3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:42.943056 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-35572dff-d374-4a77-80e3-633fc0edf5c3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:42.953260 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-35572dff-d374-4a77-80e3-633fc0edf5c3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:42.953931 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-35572dff-d374-4a77-80e3-633fc0edf5c3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:42.954788 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-35572dff-d374-4a77-80e3-633fc0edf5c3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:42.955175 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-35572dff-d374-4a77-80e3-633fc0edf5c3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:43.111729 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-35572dff-d374-4a77-80e3-633fc0edf5c3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:43.120541 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-35572dff-d374-4a77-80e3-633fc0edf5c3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1359 microversion: 2.1 time: 0.182863 Mar 08 14:54:43.121146 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 246/507] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:42 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:43.123474 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-bc2c13b1-f8ec-44e6-98cf-1e6ac0b06ab4 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:43.124089 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-bc2c13b1-f8ec-44e6-98cf-1e6ac0b06ab4 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:43.130256 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bc2c13b1-f8ec-44e6-98cf-1e6ac0b06ab4 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:43.130703 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bc2c13b1-f8ec-44e6-98cf-1e6ac0b06ab4 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:43.131481 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bc2c13b1-f8ec-44e6-98cf-1e6ac0b06ab4 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:43.131912 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bc2c13b1-f8ec-44e6-98cf-1e6ac0b06ab4 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:43.263283 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-13b0d45b-35ae-459d-9438-4f5004528980 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:43.263891 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-13b0d45b-35ae-459d-9438-4f5004528980 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:43.271080 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-13b0d45b-35ae-459d-9438-4f5004528980 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:43.271652 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-13b0d45b-35ae-459d-9438-4f5004528980 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:43.272538 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-13b0d45b-35ae-459d-9438-4f5004528980 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:43.273103 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-13b0d45b-35ae-459d-9438-4f5004528980 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:43.307682 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-bc2c13b1-f8ec-44e6-98cf-1e6ac0b06ab4 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:43.315597 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-bc2c13b1-f8ec-44e6-98cf-1e6ac0b06ab4 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1677 microversion: 2.1 time: 0.196323 Mar 08 14:54:43.316170 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 262/508] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:43 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1677 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:54:43.333736 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-13b0d45b-35ae-459d-9438-4f5004528980 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:43.341478 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-13b0d45b-35ae-459d-9438-4f5004528980 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1137 microversion: 2.1 time: 0.082024 Mar 08 14:54:43.342062 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 247/509] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:43 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1137 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:43.487707 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c6352dbc-5b0a-4ad6-b2ef-a97875c20c2f tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:43.488312 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-c6352dbc-5b0a-4ad6-b2ef-a97875c20c2f tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:43.494588 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c6352dbc-5b0a-4ad6-b2ef-a97875c20c2f tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:43.495044 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c6352dbc-5b0a-4ad6-b2ef-a97875c20c2f tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:43.495815 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c6352dbc-5b0a-4ad6-b2ef-a97875c20c2f tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:43.496355 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c6352dbc-5b0a-4ad6-b2ef-a97875c20c2f tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:43.628446 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-c6352dbc-5b0a-4ad6-b2ef-a97875c20c2f tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:43.635624 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-c6352dbc-5b0a-4ad6-b2ef-a97875c20c2f tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1522 microversion: 2.1 time: 0.151770 Mar 08 14:54:43.636178 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 263/510] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:43 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:43.680319 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-d7a65232-0edb-4b9b-ba13-0497bca1b605 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:43.680936 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-d7a65232-0edb-4b9b-ba13-0497bca1b605 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: ecac51d1-33c3-49df-9926-d953f7315f52] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:43.687494 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d7a65232-0edb-4b9b-ba13-0497bca1b605 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:43.687958 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d7a65232-0edb-4b9b-ba13-0497bca1b605 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:43.688720 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d7a65232-0edb-4b9b-ba13-0497bca1b605 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:43.689159 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d7a65232-0edb-4b9b-ba13-0497bca1b605 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:43.704916 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-168fee6b-9585-4ad7-a1d0-5a54742c3e1a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:43.705519 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-168fee6b-9585-4ad7-a1d0-5a54742c3e1a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:43.711143 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-168fee6b-9585-4ad7-a1d0-5a54742c3e1a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:43.711588 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-168fee6b-9585-4ad7-a1d0-5a54742c3e1a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:43.712352 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-168fee6b-9585-4ad7-a1d0-5a54742c3e1a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:43.712783 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-168fee6b-9585-4ad7-a1d0-5a54742c3e1a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:43.772391 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-168fee6b-9585-4ad7-a1d0-5a54742c3e1a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:43.779519 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-168fee6b-9585-4ad7-a1d0-5a54742c3e1a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1211 microversion: 2.1 time: 0.078393 Mar 08 14:54:43.780082 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 264/511] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:43 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1211 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:54:43.822506 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-d7a65232-0edb-4b9b-ba13-0497bca1b605 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d080fb7bd6049dea53fe1912d46b11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53fd1057c44dffb358b098d5f190fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:43.830368 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-d7a65232-0edb-4b9b-ba13-0497bca1b605 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "GET /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52" status: 200 len: 1319 microversion: 2.1 time: 0.153843 Mar 08 14:54:43.830935 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 248/512] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:43 2022] GET /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:43.893524 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-521cd230-8940-4c8f-851e-4997118557f9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:43.894102 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-521cd230-8940-4c8f-851e-4997118557f9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:43.900055 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-521cd230-8940-4c8f-851e-4997118557f9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:43.900515 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-521cd230-8940-4c8f-851e-4997118557f9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:43.901289 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-521cd230-8940-4c8f-851e-4997118557f9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:43.901731 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-521cd230-8940-4c8f-851e-4997118557f9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:44.103513 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-521cd230-8940-4c8f-851e-4997118557f9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:44.113814 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-521cd230-8940-4c8f-851e-4997118557f9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:44.115406 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-521cd230-8940-4c8f-851e-4997118557f9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:44.117464 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-521cd230-8940-4c8f-851e-4997118557f9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1810 microversion: 2.20 time: 0.227685 Mar 08 14:54:44.119030 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 265/513] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:54:43 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1810 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:54:44.136665 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-868ae226-bcce-48fe-bc2e-0459c96ded68 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:44.138267 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-868ae226-bcce-48fe-bc2e-0459c96ded68 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:44.144306 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-868ae226-bcce-48fe-bc2e-0459c96ded68 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:44.144772 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-868ae226-bcce-48fe-bc2e-0459c96ded68 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:44.145765 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-868ae226-bcce-48fe-bc2e-0459c96ded68 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:44.146408 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-868ae226-bcce-48fe-bc2e-0459c96ded68 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:44.313962 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-868ae226-bcce-48fe-bc2e-0459c96ded68 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:44.322093 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-868ae226-bcce-48fe-bc2e-0459c96ded68 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1359 microversion: 2.1 time: 0.189190 Mar 08 14:54:44.322821 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 249/514] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:44 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1359 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:44.335100 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-12d9aba4-7f5d-4618-8161-4e1cbdf6c0bd tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:44.335713 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-12d9aba4-7f5d-4618-8161-4e1cbdf6c0bd tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:44.342156 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-12d9aba4-7f5d-4618-8161-4e1cbdf6c0bd tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:44.342618 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-12d9aba4-7f5d-4618-8161-4e1cbdf6c0bd tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:44.343454 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-12d9aba4-7f5d-4618-8161-4e1cbdf6c0bd tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:44.343897 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-12d9aba4-7f5d-4618-8161-4e1cbdf6c0bd tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:44.358727 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-38a2ec79-9b1e-4877-b239-79846d540cc4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:44.359347 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-38a2ec79-9b1e-4877-b239-79846d540cc4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:44.366276 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-38a2ec79-9b1e-4877-b239-79846d540cc4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:44.366742 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-38a2ec79-9b1e-4877-b239-79846d540cc4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:44.367539 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-38a2ec79-9b1e-4877-b239-79846d540cc4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:44.367985 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-38a2ec79-9b1e-4877-b239-79846d540cc4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:44.432161 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-38a2ec79-9b1e-4877-b239-79846d540cc4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:44.440335 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-38a2ec79-9b1e-4877-b239-79846d540cc4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1185 microversion: 2.1 time: 0.086001 Mar 08 14:54:44.440927 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 250/515] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:44 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:44.653268 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-892a0794-6379-48d0-9e0e-8b4a887d1132 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:44.654235 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-892a0794-6379-48d0-9e0e-8b4a887d1132 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:44.661462 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-892a0794-6379-48d0-9e0e-8b4a887d1132 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:44.662218 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-892a0794-6379-48d0-9e0e-8b4a887d1132 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:44.663217 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-892a0794-6379-48d0-9e0e-8b4a887d1132 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:44.664761 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-892a0794-6379-48d0-9e0e-8b4a887d1132 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:44.924074 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-892a0794-6379-48d0-9e0e-8b4a887d1132 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:44.931635 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-892a0794-6379-48d0-9e0e-8b4a887d1132 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1522 microversion: 2.1 time: 0.282815 Mar 08 14:54:44.942707 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 251/516] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:44 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:54:44.948279 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-d1e1d3c7-f7f9-4245-911a-69447c40e347 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:44.949232 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-d1e1d3c7-f7f9-4245-911a-69447c40e347 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:44.955466 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d1e1d3c7-f7f9-4245-911a-69447c40e347 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:44.956036 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d1e1d3c7-f7f9-4245-911a-69447c40e347 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:44.956937 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d1e1d3c7-f7f9-4245-911a-69447c40e347 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:44.957593 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d1e1d3c7-f7f9-4245-911a-69447c40e347 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:45.036495 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-d1e1d3c7-f7f9-4245-911a-69447c40e347 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:45.045799 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-d1e1d3c7-f7f9-4245-911a-69447c40e347 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1199 microversion: 2.1 time: 0.101724 Mar 08 14:54:45.046505 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 252/517] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:44 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1199 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:45.057866 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-12d9aba4-7f5d-4618-8161-4e1cbdf6c0bd tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:45.066230 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-5b78817f-a044-481c-9bd7-eaab45969d78 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:45.066562 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-12d9aba4-7f5d-4618-8161-4e1cbdf6c0bd tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1677 microversion: 2.1 time: 0.732553 Mar 08 14:54:45.067470 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-5b78817f-a044-481c-9bd7-eaab45969d78 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: ecac51d1-33c3-49df-9926-d953f7315f52] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:45.067599 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 266/518] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:44 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1677 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:45.077530 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5b78817f-a044-481c-9bd7-eaab45969d78 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:45.078352 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5b78817f-a044-481c-9bd7-eaab45969d78 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:45.079578 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5b78817f-a044-481c-9bd7-eaab45969d78 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:45.080032 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5b78817f-a044-481c-9bd7-eaab45969d78 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:45.139896 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-835ba5fb-1b90-41da-a930-60c5ef5f4b8d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:45.140863 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-835ba5fb-1b90-41da-a930-60c5ef5f4b8d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:45.146954 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-835ba5fb-1b90-41da-a930-60c5ef5f4b8d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:45.148100 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-835ba5fb-1b90-41da-a930-60c5ef5f4b8d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:45.148833 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-835ba5fb-1b90-41da-a930-60c5ef5f4b8d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:45.149615 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-835ba5fb-1b90-41da-a930-60c5ef5f4b8d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:45.345616 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-5b78817f-a044-481c-9bd7-eaab45969d78 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d080fb7bd6049dea53fe1912d46b11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53fd1057c44dffb358b098d5f190fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:45.359587 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-5b78817f-a044-481c-9bd7-eaab45969d78 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "GET /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52" status: 200 len: 1319 microversion: 2.1 time: 0.297246 Mar 08 14:54:45.362235 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 253/519] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:45 2022] GET /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52 => generated 1319 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:45.370131 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-6e917cd1-5a2f-44de-915a-7ad812a49c72 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:45.386559 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-6e917cd1-5a2f-44de-915a-7ad812a49c72 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:45.396863 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6e917cd1-5a2f-44de-915a-7ad812a49c72 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:45.397324 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6e917cd1-5a2f-44de-915a-7ad812a49c72 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:45.398165 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6e917cd1-5a2f-44de-915a-7ad812a49c72 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:45.398793 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6e917cd1-5a2f-44de-915a-7ad812a49c72 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:45.632566 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-6e917cd1-5a2f-44de-915a-7ad812a49c72 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:45.642058 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-6e917cd1-5a2f-44de-915a-7ad812a49c72 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1359 microversion: 2.1 time: 0.277636 Mar 08 14:54:45.642954 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 254/520] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:45 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1359 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:45.648247 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-8f2701ad-0343-496c-b96a-d382b2af1a6a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:45.648859 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-8f2701ad-0343-496c-b96a-d382b2af1a6a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:45.654954 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8f2701ad-0343-496c-b96a-d382b2af1a6a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:45.655561 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8f2701ad-0343-496c-b96a-d382b2af1a6a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:45.656493 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8f2701ad-0343-496c-b96a-d382b2af1a6a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:45.656931 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8f2701ad-0343-496c-b96a-d382b2af1a6a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:45.734797 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-835ba5fb-1b90-41da-a930-60c5ef5f4b8d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:45.748489 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-835ba5fb-1b90-41da-a930-60c5ef5f4b8d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:45.753156 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-835ba5fb-1b90-41da-a930-60c5ef5f4b8d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:45.755736 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-835ba5fb-1b90-41da-a930-60c5ef5f4b8d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1810 microversion: 2.20 time: 0.622551 Mar 08 14:54:45.756647 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 267/521] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:54:45 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1810 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:54:45.952199 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-47b41539-016f-40eb-b20b-198f8ad7af07 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:45.952810 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-47b41539-016f-40eb-b20b-198f8ad7af07 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:45.969553 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-47b41539-016f-40eb-b20b-198f8ad7af07 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:45.970405 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-47b41539-016f-40eb-b20b-198f8ad7af07 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:45.971190 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-47b41539-016f-40eb-b20b-198f8ad7af07 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:45.971625 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-47b41539-016f-40eb-b20b-198f8ad7af07 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:46.025515 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-8f2701ad-0343-496c-b96a-d382b2af1a6a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:46.036925 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-8f2701ad-0343-496c-b96a-d382b2af1a6a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1258 microversion: 2.1 time: 0.392865 Mar 08 14:54:46.037668 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 255/522] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:45 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1258 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:46.066713 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-76b19af2-9e83-4154-9e04-f8a02d992486 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:46.067600 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-76b19af2-9e83-4154-9e04-f8a02d992486 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:46.081598 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-76b19af2-9e83-4154-9e04-f8a02d992486 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:46.082077 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-76b19af2-9e83-4154-9e04-f8a02d992486 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:46.083476 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-76b19af2-9e83-4154-9e04-f8a02d992486 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:46.084081 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-76b19af2-9e83-4154-9e04-f8a02d992486 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:46.346900 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-76b19af2-9e83-4154-9e04-f8a02d992486 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:46.366338 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-76b19af2-9e83-4154-9e04-f8a02d992486 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1266 microversion: 2.1 time: 0.304502 Mar 08 14:54:46.367679 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 256/523] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:46 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1266 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:54:46.379803 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-f54b8988-c034-4a65-a509-6fde4d2c6735 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:46.380719 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-f54b8988-c034-4a65-a509-6fde4d2c6735 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:46.390331 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f54b8988-c034-4a65-a509-6fde4d2c6735 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:46.391050 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f54b8988-c034-4a65-a509-6fde4d2c6735 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:46.391987 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f54b8988-c034-4a65-a509-6fde4d2c6735 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:46.392598 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f54b8988-c034-4a65-a509-6fde4d2c6735 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:46.485735 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-47b41539-016f-40eb-b20b-198f8ad7af07 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:46.499909 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-47b41539-016f-40eb-b20b-198f8ad7af07 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1522 microversion: 2.1 time: 0.549798 Mar 08 14:54:46.501578 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 268/524] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:45 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1522 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:54:46.508870 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [req-b606fb5c-656e-4d0d-b07b-c7c071d4cc42 req-18eb620e-5914-4557-ba9b-1598663f49c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecac51d1-33c3-49df-9926-d953f7315f52", "tag": "d38e5f9e-ffa2-4f42-a867-9e00bb20973a"}]} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:54:46.527815 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-b606fb5c-656e-4d0d-b07b-c7c071d4cc42 req-18eb620e-5914-4557-ba9b-1598663f49c9 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:46.532103 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-b606fb5c-656e-4d0d-b07b-c7c071d4cc42 req-18eb620e-5914-4557-ba9b-1598663f49c9 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:46.548851 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.compute.server_external_events [req-b606fb5c-656e-4d0d-b07b-c7c071d4cc42 req-18eb620e-5914-4557-ba9b-1598663f49c9 service nova] Creating event network-changed:d38e5f9e-ffa2-4f42-a867-9e00bb20973a for instance ecac51d1-33c3-49df-9926-d953f7315f52 on hv-cinder-83009 Mar 08 14:54:46.563345 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [req-b606fb5c-656e-4d0d-b07b-c7c071d4cc42 req-18eb620e-5914-4557-ba9b-1598663f49c9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058403 Mar 08 14:54:46.564396 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 269/525] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 14:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:54:46.573369 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-895c843f-ca19-461a-aaba-586580762893 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:46.575623 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-895c843f-ca19-461a-aaba-586580762893 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: ecac51d1-33c3-49df-9926-d953f7315f52] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:46.584651 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-895c843f-ca19-461a-aaba-586580762893 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:46.585292 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-895c843f-ca19-461a-aaba-586580762893 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:46.586467 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-895c843f-ca19-461a-aaba-586580762893 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:46.587058 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-895c843f-ca19-461a-aaba-586580762893 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:46.666661 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-f54b8988-c034-4a65-a509-6fde4d2c6735 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:46.677331 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-f54b8988-c034-4a65-a509-6fde4d2c6735 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1677 microversion: 2.1 time: 0.307085 Mar 08 14:54:46.677948 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 257/526] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:46 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1677 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:46.691175 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-04889e62-674d-42b1-8ed3-ccdeedef8846 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:46.692150 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-04889e62-674d-42b1-8ed3-ccdeedef8846 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:46.699690 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-04889e62-674d-42b1-8ed3-ccdeedef8846 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:46.700508 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-04889e62-674d-42b1-8ed3-ccdeedef8846 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:46.703031 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-04889e62-674d-42b1-8ed3-ccdeedef8846 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:46.703758 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-04889e62-674d-42b1-8ed3-ccdeedef8846 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:46.939016 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-04889e62-674d-42b1-8ed3-ccdeedef8846 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:46.952138 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-04889e62-674d-42b1-8ed3-ccdeedef8846 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1359 microversion: 2.1 time: 0.264736 Mar 08 14:54:46.953190 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 258/527] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:46 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1359 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:46.960240 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-2ff76bc6-0d46-475a-bf89-0dfad0dc7bab tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:46.961327 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-2ff76bc6-0d46-475a-bf89-0dfad0dc7bab tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:46.970850 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2ff76bc6-0d46-475a-bf89-0dfad0dc7bab tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:46.971301 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2ff76bc6-0d46-475a-bf89-0dfad0dc7bab tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:46.972266 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2ff76bc6-0d46-475a-bf89-0dfad0dc7bab tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:46.972842 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2ff76bc6-0d46-475a-bf89-0dfad0dc7bab tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:47.299129 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-2ff76bc6-0d46-475a-bf89-0dfad0dc7bab tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:47.315553 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-2ff76bc6-0d46-475a-bf89-0dfad0dc7bab tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:47.318225 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-2ff76bc6-0d46-475a-bf89-0dfad0dc7bab tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:47.320328 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-2ff76bc6-0d46-475a-bf89-0dfad0dc7bab tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1810 microversion: 2.20 time: 0.366160 Mar 08 14:54:47.322607 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 259/528] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:54:46 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1810 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:54:47.328968 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [req-c67d09e7-fed9-460f-b903-6d24f92ec98d req-641bb122-b398-40f0-a1c4-4da5de7b1487 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c488812-68f5-41d9-9d25-7f0fb61125f5", "tag": "ab17bc28-ab3f-46b1-be9d-d202c3e9d04f"}]} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:54:47.344042 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-c67d09e7-fed9-460f-b903-6d24f92ec98d req-641bb122-b398-40f0-a1c4-4da5de7b1487 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:47.345105 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-c67d09e7-fed9-460f-b903-6d24f92ec98d req-641bb122-b398-40f0-a1c4-4da5de7b1487 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:47.361224 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.compute.server_external_events [req-c67d09e7-fed9-460f-b903-6d24f92ec98d req-641bb122-b398-40f0-a1c4-4da5de7b1487 service nova] Creating event network-changed:ab17bc28-ab3f-46b1-be9d-d202c3e9d04f for instance 1c488812-68f5-41d9-9d25-7f0fb61125f5 on hv-cinder-83009 Mar 08 14:54:47.368491 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [req-c67d09e7-fed9-460f-b903-6d24f92ec98d req-641bb122-b398-40f0-a1c4-4da5de7b1487 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044452 Mar 08 14:54:47.369598 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 260/529] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 14:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:54:47.388255 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-895c843f-ca19-461a-aaba-586580762893 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d080fb7bd6049dea53fe1912d46b11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53fd1057c44dffb358b098d5f190fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:47.397397 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-91c94b81-6f1d-4be7-80b1-fe28812bf06b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:47.398866 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-91c94b81-6f1d-4be7-80b1-fe28812bf06b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:47.400166 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-895c843f-ca19-461a-aaba-586580762893 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "GET /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52" status: 200 len: 1319 microversion: 2.1 time: 0.830946 Mar 08 14:54:47.408838 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-91c94b81-6f1d-4be7-80b1-fe28812bf06b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:47.409692 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-91c94b81-6f1d-4be7-80b1-fe28812bf06b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:47.411878 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-91c94b81-6f1d-4be7-80b1-fe28812bf06b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:47.412087 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 270/530] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:46 2022] GET /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52 => generated 1319 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:47.415078 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-91c94b81-6f1d-4be7-80b1-fe28812bf06b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:47.425293 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b87900bf-d8b6-41e3-8c60-b06789e43b3f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:47.425953 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b87900bf-d8b6-41e3-8c60-b06789e43b3f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:47.448135 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b87900bf-d8b6-41e3-8c60-b06789e43b3f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:47.450622 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b87900bf-d8b6-41e3-8c60-b06789e43b3f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:47.452394 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b87900bf-d8b6-41e3-8c60-b06789e43b3f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:47.454453 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b87900bf-d8b6-41e3-8c60-b06789e43b3f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:47.826076 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-91c94b81-6f1d-4be7-80b1-fe28812bf06b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:47.837836 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-91c94b81-6f1d-4be7-80b1-fe28812bf06b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1258 microversion: 2.1 time: 0.466819 Mar 08 14:54:47.849328 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 261/531] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:47 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1258 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:47.854817 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-de22225d-a5f3-4e5c-9a34-51ed50e1d91b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:47.855858 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-de22225d-a5f3-4e5c-9a34-51ed50e1d91b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:47.863700 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-de22225d-a5f3-4e5c-9a34-51ed50e1d91b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:47.864481 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-de22225d-a5f3-4e5c-9a34-51ed50e1d91b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:47.865540 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-de22225d-a5f3-4e5c-9a34-51ed50e1d91b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:47.866222 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-de22225d-a5f3-4e5c-9a34-51ed50e1d91b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:47.987510 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b87900bf-d8b6-41e3-8c60-b06789e43b3f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:47.997651 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b87900bf-d8b6-41e3-8c60-b06789e43b3f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1266 microversion: 2.1 time: 0.583676 Mar 08 14:54:47.998390 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 271/532] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:47 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1266 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:48.004777 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-598b49f7-0484-411e-aff3-696715e4d388 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:48.005637 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-598b49f7-0484-411e-aff3-696715e4d388 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:48.013160 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-598b49f7-0484-411e-aff3-696715e4d388 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:48.014022 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-598b49f7-0484-411e-aff3-696715e4d388 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:48.014993 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-598b49f7-0484-411e-aff3-696715e4d388 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:48.015429 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-598b49f7-0484-411e-aff3-696715e4d388 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:48.457269 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-598b49f7-0484-411e-aff3-696715e4d388 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:48.476384 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-598b49f7-0484-411e-aff3-696715e4d388 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1677 microversion: 2.1 time: 0.475915 Mar 08 14:54:48.477171 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 272/533] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:47 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1677 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:48.483419 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ff6fcde1-4808-46f1-9d80-d87de7a3190a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:48.484788 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ff6fcde1-4808-46f1-9d80-d87de7a3190a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:48.493688 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ff6fcde1-4808-46f1-9d80-d87de7a3190a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:48.494369 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ff6fcde1-4808-46f1-9d80-d87de7a3190a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:48.494745 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-de22225d-a5f3-4e5c-9a34-51ed50e1d91b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00aa26c0dc804f949002193e1919183d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ac3fd6058904fbabe43c68e8d7c7654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:48.496516 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ff6fcde1-4808-46f1-9d80-d87de7a3190a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:48.497121 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ff6fcde1-4808-46f1-9d80-d87de7a3190a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:48.506685 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-de22225d-a5f3-4e5c-9a34-51ed50e1d91b tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 200 len: 1522 microversion: 2.1 time: 0.655964 Mar 08 14:54:48.507602 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 262/534] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:47 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 1522 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:48.520546 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-738267d5-3a26-44e4-94c4-c6cf01de28bc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:48.521139 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-738267d5-3a26-44e4-94c4-c6cf01de28bc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:48.527950 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-738267d5-3a26-44e4-94c4-c6cf01de28bc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:48.528790 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-738267d5-3a26-44e4-94c4-c6cf01de28bc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:48.529810 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-738267d5-3a26-44e4-94c4-c6cf01de28bc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:48.530480 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-738267d5-3a26-44e4-94c4-c6cf01de28bc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:48.860384 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-738267d5-3a26-44e4-94c4-c6cf01de28bc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:48.868735 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-738267d5-3a26-44e4-94c4-c6cf01de28bc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:48.871073 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-738267d5-3a26-44e4-94c4-c6cf01de28bc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:48.872641 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-738267d5-3a26-44e4-94c4-c6cf01de28bc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1810 microversion: 2.20 time: 0.363775 Mar 08 14:54:48.884118 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 263/535] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:54:48 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1810 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:54:48.889513 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-4eaf190d-5901-4616-887d-13265d53aa77 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:48.890154 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-4eaf190d-5901-4616-887d-13265d53aa77 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: ecac51d1-33c3-49df-9926-d953f7315f52] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:48.896300 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4eaf190d-5901-4616-887d-13265d53aa77 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:48.896997 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4eaf190d-5901-4616-887d-13265d53aa77 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:48.897975 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4eaf190d-5901-4616-887d-13265d53aa77 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:48.898571 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4eaf190d-5901-4616-887d-13265d53aa77 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:48.956426 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ff6fcde1-4808-46f1-9d80-d87de7a3190a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:48.965819 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ff6fcde1-4808-46f1-9d80-d87de7a3190a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1359 microversion: 2.1 time: 0.486134 Mar 08 14:54:48.967142 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 273/536] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:48 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1359 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:48.972043 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [req-1b6c74a5-041d-4636-a537-f91197058b0b req-5fa8aa91-d019-4de2-84cf-e5371e89843e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "251780d0-025f-4a29-b292-9a73dce671e6", "tag": "b4376b4c-6cf3-4dbf-b874-e5bde382acad"}, {"name": "network-changed", "server_uuid": "3b13cbf6-22b6-4acc-bbc2-1baead4cb29a", "tag": "ab8b501c-d93f-421a-bbc2-a770d69214bf"}]} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:54:48.981109 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-1b6c74a5-041d-4636-a537-f91197058b0b req-5fa8aa91-d019-4de2-84cf-e5371e89843e service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:48.981831 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-1b6c74a5-041d-4636-a537-f91197058b0b req-5fa8aa91-d019-4de2-84cf-e5371e89843e service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:48.995794 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.compute.server_external_events [req-1b6c74a5-041d-4636-a537-f91197058b0b req-5fa8aa91-d019-4de2-84cf-e5371e89843e service nova] Creating event network-changed:b4376b4c-6cf3-4dbf-b874-e5bde382acad for instance 251780d0-025f-4a29-b292-9a73dce671e6 on hv-cinder-83009 Mar 08 14:54:48.997068 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.compute.server_external_events [req-1b6c74a5-041d-4636-a537-f91197058b0b req-5fa8aa91-d019-4de2-84cf-e5371e89843e service nova] Creating event network-changed:ab8b501c-d93f-421a-bbc2-a770d69214bf for instance 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a on hv-cinder-83009 Mar 08 14:54:49.004349 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [req-1b6c74a5-041d-4636-a537-f91197058b0b req-5fa8aa91-d019-4de2-84cf-e5371e89843e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.035926 Mar 08 14:54:49.005727 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 274/537] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 14:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:54:49.012984 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-e1cd922c-4c33-4f4a-837f-e76b8fa7fa81 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:49.013895 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-e1cd922c-4c33-4f4a-837f-e76b8fa7fa81 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:49.020357 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e1cd922c-4c33-4f4a-837f-e76b8fa7fa81 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:49.020815 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e1cd922c-4c33-4f4a-837f-e76b8fa7fa81 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:49.031289 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e1cd922c-4c33-4f4a-837f-e76b8fa7fa81 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:49.034318 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e1cd922c-4c33-4f4a-837f-e76b8fa7fa81 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:49.283196 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-4eaf190d-5901-4616-887d-13265d53aa77 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d080fb7bd6049dea53fe1912d46b11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53fd1057c44dffb358b098d5f190fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:49.310275 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-4eaf190d-5901-4616-887d-13265d53aa77 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "GET /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52" status: 200 len: 1319 microversion: 2.1 time: 0.411494 Mar 08 14:54:49.310694 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-e1cd922c-4c33-4f4a-837f-e76b8fa7fa81 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:49.310935 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 264/538] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:48 2022] GET /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52 => generated 1319 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:49.318986 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-e1cd922c-4c33-4f4a-837f-e76b8fa7fa81 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1258 microversion: 2.1 time: 0.311911 Mar 08 14:54:49.322799 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 275/539] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:49 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1258 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:49.330818 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-fc7c344f-203b-4a43-973a-311316bc7370 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:49.331445 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-fc7c344f-203b-4a43-973a-311316bc7370 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:49.344402 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fc7c344f-203b-4a43-973a-311316bc7370 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:49.345590 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fc7c344f-203b-4a43-973a-311316bc7370 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:49.346448 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fc7c344f-203b-4a43-973a-311316bc7370 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:49.346897 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fc7c344f-203b-4a43-973a-311316bc7370 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:49.370796 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [req-15765da1-f286-4eed-9c85-250de0c1e828 req-5ab063b8-b335-4bdc-9056-5cf4202bf155 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b7917ad-8941-400f-ae66-d22e26633416", "name": "network-vif-plugged", "status": "completed", "tag": "14e51cd2-ee26-4f88-bdde-048115f528a7"}]} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:54:49.382923 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-15765da1-f286-4eed-9c85-250de0c1e828 req-5ab063b8-b335-4bdc-9056-5cf4202bf155 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:49.383738 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-15765da1-f286-4eed-9c85-250de0c1e828 req-5ab063b8-b335-4bdc-9056-5cf4202bf155 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:49.399423 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.compute.server_external_events [req-15765da1-f286-4eed-9c85-250de0c1e828 req-5ab063b8-b335-4bdc-9056-5cf4202bf155 service nova] Creating event network-vif-plugged:14e51cd2-ee26-4f88-bdde-048115f528a7 for instance 1b7917ad-8941-400f-ae66-d22e26633416 on hv-cinder-83009 Mar 08 14:54:49.404793 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [req-15765da1-f286-4eed-9c85-250de0c1e828 req-5ab063b8-b335-4bdc-9056-5cf4202bf155 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039198 Mar 08 14:54:49.406134 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 276/540] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 14:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:54:49.411131 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [req-9d86cbdd-db46-401b-9a3e-6af32fa4bad3 req-611508c6-a698-4ed0-88d5-68d92a58fe39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f936e19e-08fe-43d1-8c05-2fc52d3a5a67", "name": "network-vif-deleted", "tag": "99e3fcea-0b0c-49ed-b6a7-b37449f1b07c"}]} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:54:49.419983 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-9d86cbdd-db46-401b-9a3e-6af32fa4bad3 req-611508c6-a698-4ed0-88d5-68d92a58fe39 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:49.420432 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-9d86cbdd-db46-401b-9a3e-6af32fa4bad3 req-611508c6-a698-4ed0-88d5-68d92a58fe39 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:49.447130 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.compute.server_external_events [req-9d86cbdd-db46-401b-9a3e-6af32fa4bad3 req-611508c6-a698-4ed0-88d5-68d92a58fe39 service nova] Creating event network-vif-deleted:99e3fcea-0b0c-49ed-b6a7-b37449f1b07c for instance f936e19e-08fe-43d1-8c05-2fc52d3a5a67 on hv-cinder-83009 Mar 08 14:54:49.454225 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [req-9d86cbdd-db46-401b-9a3e-6af32fa4bad3 req-611508c6-a698-4ed0-88d5-68d92a58fe39 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045977 Mar 08 14:54:49.455120 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 277/541] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 14:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:54:49.494683 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-bbf4864d-00d0-456c-9e2d-868eb524609d tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:49.495403 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-bbf4864d-00d0-456c-9e2d-868eb524609d tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:49.502324 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bbf4864d-00d0-456c-9e2d-868eb524609d tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:49.502878 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bbf4864d-00d0-456c-9e2d-868eb524609d tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:49.503744 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bbf4864d-00d0-456c-9e2d-868eb524609d tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:49.504239 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bbf4864d-00d0-456c-9e2d-868eb524609d tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:49.575092 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-fc7c344f-203b-4a43-973a-311316bc7370 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:49.583283 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-fc7c344f-203b-4a43-973a-311316bc7370 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1266 microversion: 2.1 time: 0.269620 Mar 08 14:54:49.593297 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 265/542] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:49 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1266 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:49.593297 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-61b30c64-2a6c-4a7f-81d5-ae7123d6b523 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:49.593297 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-61b30c64-2a6c-4a7f-81d5-ae7123d6b523 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] [instance: f936e19e-08fe-43d1-8c05-2fc52d3a5a67] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:49.597020 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-61b30c64-2a6c-4a7f-81d5-ae7123d6b523 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:49.597464 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-61b30c64-2a6c-4a7f-81d5-ae7123d6b523 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:49.598418 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-61b30c64-2a6c-4a7f-81d5-ae7123d6b523 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:49.598858 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-61b30c64-2a6c-4a7f-81d5-ae7123d6b523 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:49.616819 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.wsgi [None req-61b30c64-2a6c-4a7f-81d5-ae7123d6b523 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] HTTP exception thrown: Instance f936e19e-08fe-43d1-8c05-2fc52d3a5a67 could not be found. Mar 08 14:54:49.617419 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-61b30c64-2a6c-4a7f-81d5-ae7123d6b523 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] Returning 404 to user: Instance f936e19e-08fe-43d1-8c05-2fc52d3a5a67 could not be found. {{(pid=128351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 14:54:49.618537 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-61b30c64-2a6c-4a7f-81d5-ae7123d6b523 tempest-ServerRescueNegativeTestJSON-1353664202 tempest-ServerRescueNegativeTestJSON-1353664202-project] 10.222.0.30 "GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67" status: 404 len: 111 microversion: 2.1 time: 0.033559 Mar 08 14:54:49.619180 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 266/543] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:49 2022] GET /compute/v2.1/servers/f936e19e-08fe-43d1-8c05-2fc52d3a5a67 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 14:54:49.667203 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-bbf4864d-00d0-456c-9e2d-868eb524609d tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:49.675734 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-bbf4864d-00d0-456c-9e2d-868eb524609d tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1677 microversion: 2.1 time: 0.185670 Mar 08 14:54:49.676506 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 278/544] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:49 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1677 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:54:49.891692 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-2874b790-48ba-47a4-ac04-42a256a218b6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:49.892420 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-2874b790-48ba-47a4-ac04-42a256a218b6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:49.899501 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2874b790-48ba-47a4-ac04-42a256a218b6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:49.900180 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2874b790-48ba-47a4-ac04-42a256a218b6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:49.901118 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2874b790-48ba-47a4-ac04-42a256a218b6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:49.901639 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2874b790-48ba-47a4-ac04-42a256a218b6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:49.984206 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5f3b435d-ca0e-459c-8470-786518ab9d7e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:49.984983 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5f3b435d-ca0e-459c-8470-786518ab9d7e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:49.991344 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5f3b435d-ca0e-459c-8470-786518ab9d7e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:49.991807 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5f3b435d-ca0e-459c-8470-786518ab9d7e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:49.992631 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5f3b435d-ca0e-459c-8470-786518ab9d7e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:49.993071 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5f3b435d-ca0e-459c-8470-786518ab9d7e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:50.132333 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-5f3b435d-ca0e-459c-8470-786518ab9d7e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:50.140392 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5f3b435d-ca0e-459c-8470-786518ab9d7e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1359 microversion: 2.1 time: 0.161038 Mar 08 14:54:50.141065 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 279/545] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:49 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:54:50.185489 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-2874b790-48ba-47a4-ac04-42a256a218b6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:50.193779 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-2874b790-48ba-47a4-ac04-42a256a218b6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:50.195316 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-2874b790-48ba-47a4-ac04-42a256a218b6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:50.196474 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-2874b790-48ba-47a4-ac04-42a256a218b6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1810 microversion: 2.20 time: 0.308969 Mar 08 14:54:50.197991 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 267/546] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:54:49 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1810 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:54:50.327969 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-98ed0ca6-a34d-4c88-ad37-4031362d5770 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:50.328711 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-98ed0ca6-a34d-4c88-ad37-4031362d5770 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: ecac51d1-33c3-49df-9926-d953f7315f52] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:50.334579 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-98ed0ca6-a34d-4c88-ad37-4031362d5770 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:50.335233 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-98ed0ca6-a34d-4c88-ad37-4031362d5770 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:50.336015 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-98ed0ca6-a34d-4c88-ad37-4031362d5770 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:50.336431 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-98ed0ca6-a34d-4c88-ad37-4031362d5770 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:50.339560 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-4ef2902d-4b0a-4bf6-b6e7-7bd2dabf5f33 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:50.340238 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-4ef2902d-4b0a-4bf6-b6e7-7bd2dabf5f33 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:50.346122 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4ef2902d-4b0a-4bf6-b6e7-7bd2dabf5f33 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:50.346580 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4ef2902d-4b0a-4bf6-b6e7-7bd2dabf5f33 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:50.347650 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4ef2902d-4b0a-4bf6-b6e7-7bd2dabf5f33 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:50.348091 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4ef2902d-4b0a-4bf6-b6e7-7bd2dabf5f33 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:50.476769 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-98ed0ca6-a34d-4c88-ad37-4031362d5770 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d080fb7bd6049dea53fe1912d46b11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53fd1057c44dffb358b098d5f190fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:50.484537 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-98ed0ca6-a34d-4c88-ad37-4031362d5770 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "GET /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52" status: 200 len: 1319 microversion: 2.1 time: 0.161219 Mar 08 14:54:50.485122 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 280/547] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:50 2022] GET /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:50.600893 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-89cb71f8-240e-48b8-9088-bd39d7f9d224 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:50.601572 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-89cb71f8-240e-48b8-9088-bd39d7f9d224 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:50.608842 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-89cb71f8-240e-48b8-9088-bd39d7f9d224 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:50.609319 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-89cb71f8-240e-48b8-9088-bd39d7f9d224 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:50.610129 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-89cb71f8-240e-48b8-9088-bd39d7f9d224 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:50.610567 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-89cb71f8-240e-48b8-9088-bd39d7f9d224 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:50.958728 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-89cb71f8-240e-48b8-9088-bd39d7f9d224 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:50.966150 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-89cb71f8-240e-48b8-9088-bd39d7f9d224 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1266 microversion: 2.1 time: 0.369102 Mar 08 14:54:50.966929 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 281/548] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:50 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1266 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:54:50.981106 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b272a652-25ec-44fd-a9d4-d60c5d795a43 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:50.981842 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b272a652-25ec-44fd-a9d4-d60c5d795a43 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:50.987496 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b272a652-25ec-44fd-a9d4-d60c5d795a43 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:50.987951 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b272a652-25ec-44fd-a9d4-d60c5d795a43 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:50.988727 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b272a652-25ec-44fd-a9d4-d60c5d795a43 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:50.989168 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b272a652-25ec-44fd-a9d4-d60c5d795a43 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:51.020550 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-4ef2902d-4b0a-4bf6-b6e7-7bd2dabf5f33 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:51.029058 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-4ef2902d-4b0a-4bf6-b6e7-7bd2dabf5f33 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1258 microversion: 2.1 time: 0.693169 Mar 08 14:54:51.029767 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 268/549] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:50 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1258 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:51.123575 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b272a652-25ec-44fd-a9d4-d60c5d795a43 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:51.130909 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b272a652-25ec-44fd-a9d4-d60c5d795a43 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1677 microversion: 2.1 time: 0.153999 Mar 08 14:54:51.131476 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 282/550] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:50 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:51.157719 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-f818d1c5-e570-4727-9bdf-d34fca54db4e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:51.158459 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-f818d1c5-e570-4727-9bdf-d34fca54db4e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:51.164424 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f818d1c5-e570-4727-9bdf-d34fca54db4e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:51.164957 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f818d1c5-e570-4727-9bdf-d34fca54db4e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:51.165807 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f818d1c5-e570-4727-9bdf-d34fca54db4e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:51.166358 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f818d1c5-e570-4727-9bdf-d34fca54db4e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:51.216949 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-01561aef-cde6-4d7b-a162-83943a0f717e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:51.217563 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-01561aef-cde6-4d7b-a162-83943a0f717e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:51.224411 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-01561aef-cde6-4d7b-a162-83943a0f717e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:51.224863 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-01561aef-cde6-4d7b-a162-83943a0f717e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:51.225637 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-01561aef-cde6-4d7b-a162-83943a0f717e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:51.226680 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-01561aef-cde6-4d7b-a162-83943a0f717e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:51.408319 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-01561aef-cde6-4d7b-a162-83943a0f717e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:51.422454 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-01561aef-cde6-4d7b-a162-83943a0f717e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:51.426746 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-01561aef-cde6-4d7b-a162-83943a0f717e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:51.429263 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-01561aef-cde6-4d7b-a162-83943a0f717e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1810 microversion: 2.20 time: 0.216635 Mar 08 14:54:51.440051 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 283/551] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:54:51 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1810 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 14:54:51.503040 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f85814a1-9886-4a12-89ae-5254066c3ff4 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:51.503667 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f85814a1-9886-4a12-89ae-5254066c3ff4 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: ecac51d1-33c3-49df-9926-d953f7315f52] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:51.516127 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f85814a1-9886-4a12-89ae-5254066c3ff4 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:51.516571 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f85814a1-9886-4a12-89ae-5254066c3ff4 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:51.518645 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f85814a1-9886-4a12-89ae-5254066c3ff4 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:51.519356 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f85814a1-9886-4a12-89ae-5254066c3ff4 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:51.552519 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-f818d1c5-e570-4727-9bdf-d34fca54db4e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:51.568091 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-f818d1c5-e570-4727-9bdf-d34fca54db4e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1359 microversion: 2.1 time: 0.415350 Mar 08 14:54:51.568679 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 269/552] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:51 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1359 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:51.705228 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f85814a1-9886-4a12-89ae-5254066c3ff4 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d080fb7bd6049dea53fe1912d46b11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53fd1057c44dffb358b098d5f190fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:51.714050 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f85814a1-9886-4a12-89ae-5254066c3ff4 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "GET /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52" status: 200 len: 1319 microversion: 2.1 time: 0.214043 Mar 08 14:54:51.715566 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 284/553] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:51 2022] GET /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52 => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:51.983461 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-bc6f5d25-5187-45a4-a466-7deaf4544986 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:51.984198 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-bc6f5d25-5187-45a4-a466-7deaf4544986 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:51.990739 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bc6f5d25-5187-45a4-a466-7deaf4544986 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:51.991284 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bc6f5d25-5187-45a4-a466-7deaf4544986 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:51.992307 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bc6f5d25-5187-45a4-a466-7deaf4544986 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:51.992828 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bc6f5d25-5187-45a4-a466-7deaf4544986 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:52.045819 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-4ffcc74e-646a-4df6-9a0a-71b8b6341665 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:52.047671 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-4ffcc74e-646a-4df6-9a0a-71b8b6341665 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:52.053610 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4ffcc74e-646a-4df6-9a0a-71b8b6341665 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:52.054175 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4ffcc74e-646a-4df6-9a0a-71b8b6341665 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:52.055025 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4ffcc74e-646a-4df6-9a0a-71b8b6341665 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:52.055536 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4ffcc74e-646a-4df6-9a0a-71b8b6341665 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:52.209484 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-4ffcc74e-646a-4df6-9a0a-71b8b6341665 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:52.220731 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-4ffcc74e-646a-4df6-9a0a-71b8b6341665 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1258 microversion: 2.1 time: 0.179616 Mar 08 14:54:52.221568 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 285/554] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:52 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1258 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:52.228043 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-9a66da24-2977-4124-9098-b398344816aa tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:52.228891 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-9a66da24-2977-4124-9098-b398344816aa tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:52.237273 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9a66da24-2977-4124-9098-b398344816aa tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:52.237704 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9a66da24-2977-4124-9098-b398344816aa tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:52.238590 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9a66da24-2977-4124-9098-b398344816aa tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:52.239032 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9a66da24-2977-4124-9098-b398344816aa tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:52.271751 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-bc6f5d25-5187-45a4-a466-7deaf4544986 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:52.283965 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-bc6f5d25-5187-45a4-a466-7deaf4544986 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1266 microversion: 2.1 time: 0.305075 Mar 08 14:54:52.285002 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 270/555] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:51 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1266 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:52.396538 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-9a66da24-2977-4124-9098-b398344816aa tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:52.408558 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-9a66da24-2977-4124-9098-b398344816aa tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1677 microversion: 2.1 time: 0.185757 Mar 08 14:54:52.409774 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 286/556] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:52 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1677 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:52.447955 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-713ea848-c9f2-4ded-9804-4ba498d15536 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:52.448566 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-713ea848-c9f2-4ded-9804-4ba498d15536 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:52.454504 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-713ea848-c9f2-4ded-9804-4ba498d15536 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:52.454954 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-713ea848-c9f2-4ded-9804-4ba498d15536 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:52.455733 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-713ea848-c9f2-4ded-9804-4ba498d15536 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:52.456176 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-713ea848-c9f2-4ded-9804-4ba498d15536 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:52.585441 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-4dbf9761-9669-4303-9ed7-e330e85c153f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:52.585977 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-4dbf9761-9669-4303-9ed7-e330e85c153f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:52.594585 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4dbf9761-9669-4303-9ed7-e330e85c153f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:52.595258 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4dbf9761-9669-4303-9ed7-e330e85c153f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:52.596219 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4dbf9761-9669-4303-9ed7-e330e85c153f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:52.596663 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4dbf9761-9669-4303-9ed7-e330e85c153f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:52.742428 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-4dbf9761-9669-4303-9ed7-e330e85c153f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:52.750622 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-713ea848-c9f2-4ded-9804-4ba498d15536 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:52.750833 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-4dbf9761-9669-4303-9ed7-e330e85c153f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1359 microversion: 2.1 time: 0.169124 Mar 08 14:54:52.760418 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 287/557] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:52 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:54:52.763686 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-713ea848-c9f2-4ded-9804-4ba498d15536 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:52.765543 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-713ea848-c9f2-4ded-9804-4ba498d15536 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:52.765803 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-755438a8-927f-4099-81cd-0def8bffe88f tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:52.766452 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-755438a8-927f-4099-81cd-0def8bffe88f tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: ecac51d1-33c3-49df-9926-d953f7315f52] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:52.767019 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-713ea848-c9f2-4ded-9804-4ba498d15536 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1797 microversion: 2.20 time: 0.323117 Mar 08 14:54:52.772889 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-755438a8-927f-4099-81cd-0def8bffe88f tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:52.773343 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-755438a8-927f-4099-81cd-0def8bffe88f tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:52.774149 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-755438a8-927f-4099-81cd-0def8bffe88f tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:52.774590 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-755438a8-927f-4099-81cd-0def8bffe88f tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:52.779145 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 271/558] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 14:54:52 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1797 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 14:54:52.917456 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-755438a8-927f-4099-81cd-0def8bffe88f tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d080fb7bd6049dea53fe1912d46b11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53fd1057c44dffb358b098d5f190fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:52.925263 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-755438a8-927f-4099-81cd-0def8bffe88f tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "GET /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52" status: 200 len: 1319 microversion: 2.1 time: 0.163645 Mar 08 14:54:52.926048 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 288/559] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:52 2022] GET /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:53.236669 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b4cd3c12-b71b-41dc-9c76-1bb5eef78eb3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:53.237337 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-b4cd3c12-b71b-41dc-9c76-1bb5eef78eb3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:53.243895 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b4cd3c12-b71b-41dc-9c76-1bb5eef78eb3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:53.244592 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b4cd3c12-b71b-41dc-9c76-1bb5eef78eb3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:53.245664 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b4cd3c12-b71b-41dc-9c76-1bb5eef78eb3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:53.246674 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b4cd3c12-b71b-41dc-9c76-1bb5eef78eb3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:53.303854 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-085bb561-8e2a-45ad-b660-b125b82a4745 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:53.304398 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-085bb561-8e2a-45ad-b660-b125b82a4745 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:53.310767 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-085bb561-8e2a-45ad-b660-b125b82a4745 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:53.311230 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-085bb561-8e2a-45ad-b660-b125b82a4745 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:53.312014 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-085bb561-8e2a-45ad-b660-b125b82a4745 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:53.312459 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-085bb561-8e2a-45ad-b660-b125b82a4745 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:53.505474 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-085bb561-8e2a-45ad-b660-b125b82a4745 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:53.515923 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-085bb561-8e2a-45ad-b660-b125b82a4745 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1266 microversion: 2.1 time: 0.215213 Mar 08 14:54:53.518269 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 289/560] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:53 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:54:53.524288 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [req-c16acacb-34f8-4b82-b3f0-9c6441762fc9 req-63c728fa-f39b-4800-8084-e53c365f76fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecac51d1-33c3-49df-9926-d953f7315f52", "name": "network-vif-plugged", "status": "completed", "tag": "d38e5f9e-ffa2-4f42-a867-9e00bb20973a"}]} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:54:53.534617 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-c16acacb-34f8-4b82-b3f0-9c6441762fc9 req-63c728fa-f39b-4800-8084-e53c365f76fd service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:53.535419 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-c16acacb-34f8-4b82-b3f0-9c6441762fc9 req-63c728fa-f39b-4800-8084-e53c365f76fd service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:53.552923 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.compute.server_external_events [req-c16acacb-34f8-4b82-b3f0-9c6441762fc9 req-63c728fa-f39b-4800-8084-e53c365f76fd service nova] Creating event network-vif-plugged:d38e5f9e-ffa2-4f42-a867-9e00bb20973a for instance ecac51d1-33c3-49df-9926-d953f7315f52 on hv-cinder-83009 Mar 08 14:54:53.561547 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [req-c16acacb-34f8-4b82-b3f0-9c6441762fc9 req-63c728fa-f39b-4800-8084-e53c365f76fd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041106 Mar 08 14:54:53.562189 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 290/561] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 14:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:54:53.569290 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-bd140f51-c854-4871-a261-7ccbc2648b9b tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:53.571262 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-bd140f51-c854-4871-a261-7ccbc2648b9b tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:53.579601 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bd140f51-c854-4871-a261-7ccbc2648b9b tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:53.582874 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bd140f51-c854-4871-a261-7ccbc2648b9b tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:53.584423 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bd140f51-c854-4871-a261-7ccbc2648b9b tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:53.589139 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bd140f51-c854-4871-a261-7ccbc2648b9b tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:53.784555 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-bd140f51-c854-4871-a261-7ccbc2648b9b tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:53.796823 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-bd140f51-c854-4871-a261-7ccbc2648b9b tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1677 microversion: 2.1 time: 0.233055 Mar 08 14:54:53.797964 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 291/562] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:53 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1677 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:53.802414 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-66aa1cee-4f7f-4d64-8738-4642290af2ee tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:53.803028 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-66aa1cee-4f7f-4d64-8738-4642290af2ee tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:53.814127 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-66aa1cee-4f7f-4d64-8738-4642290af2ee tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:53.814613 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-66aa1cee-4f7f-4d64-8738-4642290af2ee tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:53.815521 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-66aa1cee-4f7f-4d64-8738-4642290af2ee tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:53.815829 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-66aa1cee-4f7f-4d64-8738-4642290af2ee tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:53.970176 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-66aa1cee-4f7f-4d64-8738-4642290af2ee tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:53.979445 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-66aa1cee-4f7f-4d64-8738-4642290af2ee tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1359 microversion: 2.1 time: 0.180533 Mar 08 14:54:53.980484 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 292/563] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:53 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:53.985479 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-fd630bab-b54f-40f2-8951-0636eb1028f1 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:53.986203 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-fd630bab-b54f-40f2-8951-0636eb1028f1 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: ecac51d1-33c3-49df-9926-d953f7315f52] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:53.992548 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fd630bab-b54f-40f2-8951-0636eb1028f1 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:53.993187 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fd630bab-b54f-40f2-8951-0636eb1028f1 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:53.994303 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fd630bab-b54f-40f2-8951-0636eb1028f1 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:53.994673 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-b4cd3c12-b71b-41dc-9c76-1bb5eef78eb3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:53.995145 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fd630bab-b54f-40f2-8951-0636eb1028f1 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:54.004145 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-b4cd3c12-b71b-41dc-9c76-1bb5eef78eb3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1258 microversion: 2.1 time: 0.770658 Mar 08 14:54:54.005441 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 272/564] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:53 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1258 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:54.161393 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-fd630bab-b54f-40f2-8951-0636eb1028f1 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d080fb7bd6049dea53fe1912d46b11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53fd1057c44dffb358b098d5f190fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:54.169050 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-fd630bab-b54f-40f2-8951-0636eb1028f1 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "GET /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52" status: 200 len: 1319 microversion: 2.1 time: 0.187143 Mar 08 14:54:54.177619 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 293/565] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:53 2022] GET /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52 => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:54.532536 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-9521a746-b481-480f-9e5e-c5482be091a8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:54.533248 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-9521a746-b481-480f-9e5e-c5482be091a8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:54.540113 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9521a746-b481-480f-9e5e-c5482be091a8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:54.540655 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9521a746-b481-480f-9e5e-c5482be091a8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:54.541440 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9521a746-b481-480f-9e5e-c5482be091a8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:54.541903 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9521a746-b481-480f-9e5e-c5482be091a8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:54.685714 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-9521a746-b481-480f-9e5e-c5482be091a8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:54.692877 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-9521a746-b481-480f-9e5e-c5482be091a8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1266 microversion: 2.1 time: 0.164257 Mar 08 14:54:54.693437 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 273/566] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:54 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:54.814667 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-9324458f-2a78-4859-9820-1045f94dcf93 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:54.815378 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-9324458f-2a78-4859-9820-1045f94dcf93 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:54.821578 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9324458f-2a78-4859-9820-1045f94dcf93 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:54.822132 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9324458f-2a78-4859-9820-1045f94dcf93 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:54.822978 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9324458f-2a78-4859-9820-1045f94dcf93 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:54.823479 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9324458f-2a78-4859-9820-1045f94dcf93 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:54.959201 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-9324458f-2a78-4859-9820-1045f94dcf93 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:54.966761 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-9324458f-2a78-4859-9820-1045f94dcf93 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1654 microversion: 2.1 time: 0.155868 Mar 08 14:54:54.967335 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 294/567] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:54 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1654 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:54:54.983482 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-1e2459f0-3264-47d2-a42c-1bd2f7f63885 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:54:54.989205 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1e2459f0-3264-47d2-a42c-1bd2f7f63885 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:54.989662 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1e2459f0-3264-47d2-a42c-1bd2f7f63885 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:54.996733 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b77be6db-0601-4982-b00c-e1a625417805 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:54.997361 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b77be6db-0601-4982-b00c-e1a625417805 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:55.003146 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b77be6db-0601-4982-b00c-e1a625417805 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:55.003675 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b77be6db-0601-4982-b00c-e1a625417805 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:55.004461 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b77be6db-0601-4982-b00c-e1a625417805 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:55.004904 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b77be6db-0601-4982-b00c-e1a625417805 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:55.013196 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-1e2459f0-3264-47d2-a42c-1bd2f7f63885 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Going to try to start instance {{(pid=128351) start /opt/stack/nova/nova/compute/api.py:2730}} Mar 08 14:54:55.062578 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-1e2459f0-3264-47d2-a42c-1bd2f7f63885 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "POST /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e/action" status: 202 len: 0 microversion: 2.1 time: 0.083428 Mar 08 14:54:55.063635 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 274/568] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Mar 8 14:54:54 2022] POST /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 14:54:55.071207 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-12a3b6e8-d176-4766-b449-dd4ff387ecc8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:55.072200 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-12a3b6e8-d176-4766-b449-dd4ff387ecc8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:55.079942 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-12a3b6e8-d176-4766-b449-dd4ff387ecc8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:55.080604 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-12a3b6e8-d176-4766-b449-dd4ff387ecc8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:55.081551 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-12a3b6e8-d176-4766-b449-dd4ff387ecc8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:55.082167 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-12a3b6e8-d176-4766-b449-dd4ff387ecc8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:55.194486 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b77be6db-0601-4982-b00c-e1a625417805 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:55.204273 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b77be6db-0601-4982-b00c-e1a625417805 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1359 microversion: 2.1 time: 0.211251 Mar 08 14:54:55.205007 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 295/569] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:54 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1359 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:54:55.218142 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-a340eaa9-efa0-49b1-9bd9-23e1dd7bad41 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:55.219028 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-a340eaa9-efa0-49b1-9bd9-23e1dd7bad41 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:55.242106 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a340eaa9-efa0-49b1-9bd9-23e1dd7bad41 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:55.242654 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a340eaa9-efa0-49b1-9bd9-23e1dd7bad41 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:55.244337 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a340eaa9-efa0-49b1-9bd9-23e1dd7bad41 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:55.245133 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a340eaa9-efa0-49b1-9bd9-23e1dd7bad41 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:55.299719 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-12a3b6e8-d176-4766-b449-dd4ff387ecc8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:55.307404 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-12a3b6e8-d176-4766-b449-dd4ff387ecc8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1258 microversion: 2.1 time: 0.242306 Mar 08 14:54:55.322453 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 275/570] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:55 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1258 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:55.329657 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-f8c5ff79-e073-461b-90fa-2bfa4edad248 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:55.330580 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-f8c5ff79-e073-461b-90fa-2bfa4edad248 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: ecac51d1-33c3-49df-9926-d953f7315f52] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:55.337571 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f8c5ff79-e073-461b-90fa-2bfa4edad248 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:55.341812 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f8c5ff79-e073-461b-90fa-2bfa4edad248 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:55.346509 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f8c5ff79-e073-461b-90fa-2bfa4edad248 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:55.346964 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f8c5ff79-e073-461b-90fa-2bfa4edad248 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:55.421043 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-a340eaa9-efa0-49b1-9bd9-23e1dd7bad41 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:55.430153 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-a340eaa9-efa0-49b1-9bd9-23e1dd7bad41 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1663 microversion: 2.1 time: 0.223115 Mar 08 14:54:55.437053 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 296/571] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:55 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1663 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:55.580563 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [req-7f791e20-ab44-4d94-adad-fbb44ea3041a req-eb0083ec-8a2d-438d-b4e5-31b29f8f8161 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "251780d0-025f-4a29-b292-9a73dce671e6", "name": "network-vif-plugged", "status": "completed", "tag": "b4376b4c-6cf3-4dbf-b874-e5bde382acad"}]} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:54:55.594565 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-7f791e20-ab44-4d94-adad-fbb44ea3041a req-eb0083ec-8a2d-438d-b4e5-31b29f8f8161 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:55.595182 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-7f791e20-ab44-4d94-adad-fbb44ea3041a req-eb0083ec-8a2d-438d-b4e5-31b29f8f8161 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:55.607565 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.compute.server_external_events [req-7f791e20-ab44-4d94-adad-fbb44ea3041a req-eb0083ec-8a2d-438d-b4e5-31b29f8f8161 service nova] Creating event network-vif-plugged:b4376b4c-6cf3-4dbf-b874-e5bde382acad for instance 251780d0-025f-4a29-b292-9a73dce671e6 on hv-cinder-83009 Mar 08 14:54:55.612780 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [req-7f791e20-ab44-4d94-adad-fbb44ea3041a req-eb0083ec-8a2d-438d-b4e5-31b29f8f8161 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036209 Mar 08 14:54:55.613466 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 297/572] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 14:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:54:55.678450 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-f8c5ff79-e073-461b-90fa-2bfa4edad248 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d080fb7bd6049dea53fe1912d46b11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53fd1057c44dffb358b098d5f190fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:55.690581 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-f8c5ff79-e073-461b-90fa-2bfa4edad248 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "GET /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52" status: 200 len: 1508 microversion: 2.1 time: 0.366184 Mar 08 14:54:55.691324 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 276/573] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:55 2022] GET /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52 => generated 1508 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:55.708429 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3e26d9a3-53a3-456c-bf59-cf651e58f5ea tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67fc183b-4d10-4f71-9e5d-14819fc5becd", "device": "/dev/sdb"}} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:54:55.710109 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-3e26d9a3-53a3-456c-bf59-cf651e58f5ea tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: ecac51d1-33c3-49df-9926-d953f7315f52] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:55.717701 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-1f0f04ed-c2c0-485e-9ffa-88720cac953f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:55.717968 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-1f0f04ed-c2c0-485e-9ffa-88720cac953f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:55.724562 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3e26d9a3-53a3-456c-bf59-cf651e58f5ea tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:55.725016 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3e26d9a3-53a3-456c-bf59-cf651e58f5ea tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:55.727598 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3e26d9a3-53a3-456c-bf59-cf651e58f5ea tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:55.728227 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3e26d9a3-53a3-456c-bf59-cf651e58f5ea tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:55.729970 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1f0f04ed-c2c0-485e-9ffa-88720cac953f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:55.734117 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1f0f04ed-c2c0-485e-9ffa-88720cac953f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:55.735063 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1f0f04ed-c2c0-485e-9ffa-88720cac953f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:55.737603 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1f0f04ed-c2c0-485e-9ffa-88720cac953f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:56.007676 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-1f0f04ed-c2c0-485e-9ffa-88720cac953f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:56.015290 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-1f0f04ed-c2c0-485e-9ffa-88720cac953f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1266 microversion: 2.1 time: 0.301888 Mar 08 14:54:56.016169 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 277/574] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:55 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1266 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:56.221036 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-6a247582-9cf1-49fd-a7e6-652de369d980 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:56.221747 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-6a247582-9cf1-49fd-a7e6-652de369d980 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:56.234447 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6a247582-9cf1-49fd-a7e6-652de369d980 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:56.234918 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6a247582-9cf1-49fd-a7e6-652de369d980 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:56.235719 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6a247582-9cf1-49fd-a7e6-652de369d980 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:56.236162 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6a247582-9cf1-49fd-a7e6-652de369d980 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:56.275769 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-3e26d9a3-53a3-456c-bf59-cf651e58f5ea tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "POST /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.571640 Mar 08 14:54:56.276517 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 298/575] 10.222.0.30 () {60 vars in 1322 bytes} [Tue Mar 8 14:54:55 2022] POST /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52/os-volume_attachments => generated 194 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:54:56.331561 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d15e787e-a8e8-472a-8ad3-f78fde8ec002 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:56.332270 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d15e787e-a8e8-472a-8ad3-f78fde8ec002 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:56.344749 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d15e787e-a8e8-472a-8ad3-f78fde8ec002 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:56.345218 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d15e787e-a8e8-472a-8ad3-f78fde8ec002 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:56.346049 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d15e787e-a8e8-472a-8ad3-f78fde8ec002 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:56.346487 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d15e787e-a8e8-472a-8ad3-f78fde8ec002 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:56.407099 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-6a247582-9cf1-49fd-a7e6-652de369d980 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:56.414328 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-6a247582-9cf1-49fd-a7e6-652de369d980 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1359 microversion: 2.1 time: 0.197010 Mar 08 14:54:56.424863 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 278/576] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:56 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1359 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:56.448611 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-eb3cc4d5-cfcd-4b39-8fbb-61665bf69289 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:56.448760 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-eb3cc4d5-cfcd-4b39-8fbb-61665bf69289 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:56.456252 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-eb3cc4d5-cfcd-4b39-8fbb-61665bf69289 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:56.456713 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-eb3cc4d5-cfcd-4b39-8fbb-61665bf69289 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:56.457481 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-eb3cc4d5-cfcd-4b39-8fbb-61665bf69289 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:56.457944 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-eb3cc4d5-cfcd-4b39-8fbb-61665bf69289 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:56.507779 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d15e787e-a8e8-472a-8ad3-f78fde8ec002 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:56.515157 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d15e787e-a8e8-472a-8ad3-f78fde8ec002 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1258 microversion: 2.1 time: 0.187954 Mar 08 14:54:56.515921 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 299/577] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:56 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1258 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:56.598904 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-eb3cc4d5-cfcd-4b39-8fbb-61665bf69289 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:56.606942 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-eb3cc4d5-cfcd-4b39-8fbb-61665bf69289 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1663 microversion: 2.1 time: 0.162532 Mar 08 14:54:56.607590 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 279/578] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:56 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1663 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:54:57.032485 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f56800c2-aa37-4e0e-9b11-b7cf7cefbf99 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:57.033055 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f56800c2-aa37-4e0e-9b11-b7cf7cefbf99 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:57.039628 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f56800c2-aa37-4e0e-9b11-b7cf7cefbf99 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:57.040083 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f56800c2-aa37-4e0e-9b11-b7cf7cefbf99 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:57.040862 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f56800c2-aa37-4e0e-9b11-b7cf7cefbf99 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:57.041307 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f56800c2-aa37-4e0e-9b11-b7cf7cefbf99 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:57.179678 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f56800c2-aa37-4e0e-9b11-b7cf7cefbf99 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:57.187774 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f56800c2-aa37-4e0e-9b11-b7cf7cefbf99 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1266 microversion: 2.1 time: 0.159209 Mar 08 14:54:57.188345 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 300/579] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:57 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:54:57.431563 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-09fead36-479c-4c7c-ad81-a0473a55e377 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:57.432173 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-09fead36-479c-4c7c-ad81-a0473a55e377 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:57.438727 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-09fead36-479c-4c7c-ad81-a0473a55e377 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:57.439174 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-09fead36-479c-4c7c-ad81-a0473a55e377 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:57.439939 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-09fead36-479c-4c7c-ad81-a0473a55e377 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:57.440370 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-09fead36-479c-4c7c-ad81-a0473a55e377 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:57.532216 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-1a4caf45-bdd3-4e30-bd46-12c8405cbe79 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:57.532840 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-1a4caf45-bdd3-4e30-bd46-12c8405cbe79 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:57.538879 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1a4caf45-bdd3-4e30-bd46-12c8405cbe79 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:57.539514 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1a4caf45-bdd3-4e30-bd46-12c8405cbe79 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:57.540301 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1a4caf45-bdd3-4e30-bd46-12c8405cbe79 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:57.540983 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1a4caf45-bdd3-4e30-bd46-12c8405cbe79 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:57.583238 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-09fead36-479c-4c7c-ad81-a0473a55e377 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:57.591825 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-09fead36-479c-4c7c-ad81-a0473a55e377 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1549 microversion: 2.1 time: 0.163989 Mar 08 14:54:57.592319 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 280/580] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:57 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1549 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:57.609405 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-e91af180-6fdf-43e2-9006-2597b5e8b40a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:57.610085 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-e91af180-6fdf-43e2-9006-2597b5e8b40a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:57.617488 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e91af180-6fdf-43e2-9006-2597b5e8b40a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:57.618123 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e91af180-6fdf-43e2-9006-2597b5e8b40a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:57.618906 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e91af180-6fdf-43e2-9006-2597b5e8b40a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:57.619535 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e91af180-6fdf-43e2-9006-2597b5e8b40a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:57.692290 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-1a4caf45-bdd3-4e30-bd46-12c8405cbe79 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:57.700578 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-1a4caf45-bdd3-4e30-bd46-12c8405cbe79 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1258 microversion: 2.1 time: 0.172166 Mar 08 14:54:57.701324 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 301/581] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:57 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1258 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:57.706315 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-da7cb748-5281-47d2-ad93-fb89aee096b8 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:57.706918 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-da7cb748-5281-47d2-ad93-fb89aee096b8 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:57.714143 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-da7cb748-5281-47d2-ad93-fb89aee096b8 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:57.715153 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-da7cb748-5281-47d2-ad93-fb89aee096b8 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:57.716011 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-da7cb748-5281-47d2-ad93-fb89aee096b8 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:57.716546 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-da7cb748-5281-47d2-ad93-fb89aee096b8 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:57.766589 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-e91af180-6fdf-43e2-9006-2597b5e8b40a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:57.774005 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-e91af180-6fdf-43e2-9006-2597b5e8b40a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1549 microversion: 2.1 time: 0.169518 Mar 08 14:54:57.774578 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 281/582] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:57 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1549 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:54:57.782597 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [req-9391f0ca-d3ee-4ee2-977d-d4f4227cb5d0 req-c6b0d3bd-4817-44d0-927b-e13247a21e1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c488812-68f5-41d9-9d25-7f0fb61125f5", "name": "network-vif-plugged", "status": "completed", "tag": "ab17bc28-ab3f-46b1-be9d-d202c3e9d04f"}]} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:54:57.790543 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-9391f0ca-d3ee-4ee2-977d-d4f4227cb5d0 req-c6b0d3bd-4817-44d0-927b-e13247a21e1d service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:57.790984 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-9391f0ca-d3ee-4ee2-977d-d4f4227cb5d0 req-c6b0d3bd-4817-44d0-927b-e13247a21e1d service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:57.802311 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.compute.server_external_events [req-9391f0ca-d3ee-4ee2-977d-d4f4227cb5d0 req-c6b0d3bd-4817-44d0-927b-e13247a21e1d service nova] Creating event network-vif-plugged:ab17bc28-ab3f-46b1-be9d-d202c3e9d04f for instance 1c488812-68f5-41d9-9d25-7f0fb61125f5 on hv-cinder-83009 Mar 08 14:54:57.807361 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [req-9391f0ca-d3ee-4ee2-977d-d4f4227cb5d0 req-c6b0d3bd-4817-44d0-927b-e13247a21e1d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028253 Mar 08 14:54:57.808457 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 282/583] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 14:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:54:57.814364 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-c7c76d5b-fb58-479c-9265-522778c63efc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:57.817724 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-c7c76d5b-fb58-479c-9265-522778c63efc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:57.818511 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-c7c76d5b-fb58-479c-9265-522778c63efc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Searching by: {'deleted': False, 'project_id': '3ecfade47630412b85598218c7c04664'} {{(pid=128351) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 08 14:54:57.826536 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c7c76d5b-fb58-479c-9265-522778c63efc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:57.826999 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c7c76d5b-fb58-479c-9265-522778c63efc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:57.827825 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c7c76d5b-fb58-479c-9265-522778c63efc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:57.828268 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c7c76d5b-fb58-479c-9265-522778c63efc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:57.864063 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-da7cb748-5281-47d2-ad93-fb89aee096b8 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:57.872928 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-da7cb748-5281-47d2-ad93-fb89aee096b8 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1667 microversion: 2.1 time: 0.170377 Mar 08 14:54:57.873652 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 302/584] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:57 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1667 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:57.927879 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.multi_cell_list [None req-c7c76d5b-fb58-479c-9265-522778c63efc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128351) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 08 14:54:58.032748 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-c7c76d5b-fb58-479c-9265-522778c63efc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.222198 Mar 08 14:54:58.033921 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 283/585] 10.222.0.30 () {58 vars in 1124 bytes} [Tue Mar 8 14:54:57 2022] GET /compute/v2.1/servers => generated 343 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:54:58.045634 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-fc0fa043-7e28-4dd2-ab3f-6525017ca611 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:58.046278 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-fc0fa043-7e28-4dd2-ab3f-6525017ca611 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:58.053526 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fc0fa043-7e28-4dd2-ab3f-6525017ca611 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:58.054256 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fc0fa043-7e28-4dd2-ab3f-6525017ca611 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:58.055212 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fc0fa043-7e28-4dd2-ab3f-6525017ca611 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:58.055652 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fc0fa043-7e28-4dd2-ab3f-6525017ca611 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:58.206054 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-8988e45c-e64b-4920-9067-7aafaae62862 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:58.207149 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-8988e45c-e64b-4920-9067-7aafaae62862 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:58.212682 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-fc0fa043-7e28-4dd2-ab3f-6525017ca611 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:58.219539 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8988e45c-e64b-4920-9067-7aafaae62862 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:58.224508 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-fc0fa043-7e28-4dd2-ab3f-6525017ca611 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1549 microversion: 2.1 time: 0.183875 Mar 08 14:54:58.225244 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8988e45c-e64b-4920-9067-7aafaae62862 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:58.226144 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8988e45c-e64b-4920-9067-7aafaae62862 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:58.226593 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8988e45c-e64b-4920-9067-7aafaae62862 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:58.230834 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 303/586] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:58 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1549 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:58.394797 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-8988e45c-e64b-4920-9067-7aafaae62862 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:58.402698 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-8988e45c-e64b-4920-9067-7aafaae62862 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1266 microversion: 2.1 time: 0.201143 Mar 08 14:54:58.404119 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 284/587] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:58 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:54:58.717822 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f918742b-f1fe-4cf7-94f2-5c85f511eb8e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:58.718400 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f918742b-f1fe-4cf7-94f2-5c85f511eb8e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:58.724561 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f918742b-f1fe-4cf7-94f2-5c85f511eb8e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:58.725013 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f918742b-f1fe-4cf7-94f2-5c85f511eb8e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:58.725782 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f918742b-f1fe-4cf7-94f2-5c85f511eb8e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:58.726270 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f918742b-f1fe-4cf7-94f2-5c85f511eb8e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:58.863439 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f918742b-f1fe-4cf7-94f2-5c85f511eb8e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:58.870901 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f918742b-f1fe-4cf7-94f2-5c85f511eb8e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1258 microversion: 2.1 time: 0.157331 Mar 08 14:54:58.871476 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 304/588] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:58 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:59.422289 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-bfb85e01-b76e-4399-b2f1-f253c28d300a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:59.423608 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-bfb85e01-b76e-4399-b2f1-f253c28d300a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:59.433377 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bfb85e01-b76e-4399-b2f1-f253c28d300a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:59.435373 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bfb85e01-b76e-4399-b2f1-f253c28d300a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:59.436645 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bfb85e01-b76e-4399-b2f1-f253c28d300a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:59.442993 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bfb85e01-b76e-4399-b2f1-f253c28d300a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:59.648279 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-bfb85e01-b76e-4399-b2f1-f253c28d300a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:54:59.662063 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-bfb85e01-b76e-4399-b2f1-f253c28d300a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1266 microversion: 2.1 time: 0.244384 Mar 08 14:54:59.662649 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 285/589] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:59 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:54:59.801921 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-92cd5f26-dc53-4e8f-9317-ab473bd85bd1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9ff4ba39-d5be-4514-8dac-561bb4b9e67e"}} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:54:59.803036 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-92cd5f26-dc53-4e8f-9317-ab473bd85bd1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:59.810084 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-92cd5f26-dc53-4e8f-9317-ab473bd85bd1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:59.810588 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-92cd5f26-dc53-4e8f-9317-ab473bd85bd1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:59.811336 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-92cd5f26-dc53-4e8f-9317-ab473bd85bd1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:59.811771 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-92cd5f26-dc53-4e8f-9317-ab473bd85bd1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:59.822109 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [req-834bea9f-7aa8-480e-ba74-d6118ef0bb37 req-6bc3ef0f-3180-4ab7-934f-96b35429241f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b13cbf6-22b6-4acc-bbc2-1baead4cb29a", "name": "network-vif-plugged", "status": "completed", "tag": "ab8b501c-d93f-421a-bbc2-a770d69214bf"}]} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:54:59.832179 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-834bea9f-7aa8-480e-ba74-d6118ef0bb37 req-6bc3ef0f-3180-4ab7-934f-96b35429241f service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:59.832624 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-834bea9f-7aa8-480e-ba74-d6118ef0bb37 req-6bc3ef0f-3180-4ab7-934f-96b35429241f service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:59.844300 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.compute.server_external_events [req-834bea9f-7aa8-480e-ba74-d6118ef0bb37 req-6bc3ef0f-3180-4ab7-934f-96b35429241f service nova] Creating event network-vif-plugged:ab8b501c-d93f-421a-bbc2-a770d69214bf for instance 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a on hv-cinder-83009 Mar 08 14:54:59.849544 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [req-834bea9f-7aa8-480e-ba74-d6118ef0bb37 req-6bc3ef0f-3180-4ab7-934f-96b35429241f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031126 Mar 08 14:54:59.850171 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 286/590] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 14:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:54:59.889498 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-6f1d9ff2-1cc3-44f3-b4ed-9283197579bb tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:54:59.890256 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-6f1d9ff2-1cc3-44f3-b4ed-9283197579bb tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:54:59.896639 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6f1d9ff2-1cc3-44f3-b4ed-9283197579bb tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:59.897216 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6f1d9ff2-1cc3-44f3-b4ed-9283197579bb tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:54:59.898406 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6f1d9ff2-1cc3-44f3-b4ed-9283197579bb tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:54:59.898552 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6f1d9ff2-1cc3-44f3-b4ed-9283197579bb tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:00.045541 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-6f1d9ff2-1cc3-44f3-b4ed-9283197579bb tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:55:00.052972 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-6f1d9ff2-1cc3-44f3-b4ed-9283197579bb tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1441 microversion: 2.1 time: 0.169030 Mar 08 14:55:00.053537 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 287/591] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:54:59 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1441 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:55:00.071899 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-3762f500-bea8-4310-9626-74c20bba305b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:55:00.072507 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-3762f500-bea8-4310-9626-74c20bba305b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:55:00.078858 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3762f500-bea8-4310-9626-74c20bba305b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:00.079301 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3762f500-bea8-4310-9626-74c20bba305b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:00.081583 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3762f500-bea8-4310-9626-74c20bba305b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:00.082103 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3762f500-bea8-4310-9626-74c20bba305b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:00.223638 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-3762f500-bea8-4310-9626-74c20bba305b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:55:00.231555 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-3762f500-bea8-4310-9626-74c20bba305b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1441 microversion: 2.1 time: 0.163605 Mar 08 14:55:00.232149 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 288/592] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:55:00 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1441 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:55:00.684103 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-55d51eb5-67f3-4773-af2b-0d71477f478e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:55:00.685092 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-55d51eb5-67f3-4773-af2b-0d71477f478e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:55:00.691295 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-55d51eb5-67f3-4773-af2b-0d71477f478e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:00.691814 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-55d51eb5-67f3-4773-af2b-0d71477f478e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:00.692688 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-55d51eb5-67f3-4773-af2b-0d71477f478e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:00.693192 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-55d51eb5-67f3-4773-af2b-0d71477f478e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:00.920657 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-55d51eb5-67f3-4773-af2b-0d71477f478e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:55:00.927853 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-55d51eb5-67f3-4773-af2b-0d71477f478e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1266 microversion: 2.1 time: 0.248888 Mar 08 14:55:00.928415 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 289/593] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:55:00 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1266 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:55:01.945592 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-1311226f-85dc-4fa7-b9af-6adf5f5d2079 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:55:01.946249 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-1311226f-85dc-4fa7-b9af-6adf5f5d2079 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:55:01.954199 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1311226f-85dc-4fa7-b9af-6adf5f5d2079 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:01.954729 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1311226f-85dc-4fa7-b9af-6adf5f5d2079 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:01.955557 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1311226f-85dc-4fa7-b9af-6adf5f5d2079 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:01.955992 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1311226f-85dc-4fa7-b9af-6adf5f5d2079 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:02.198905 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-1311226f-85dc-4fa7-b9af-6adf5f5d2079 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:55:02.206033 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-1311226f-85dc-4fa7-b9af-6adf5f5d2079 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1266 microversion: 2.1 time: 0.264276 Mar 08 14:55:02.206596 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 290/594] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:55:01 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1266 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:55:02.317257 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [req-558c1da0-86d5-49eb-b087-3d3ca14d86cb req-26a5bedb-fc4b-4435-aef8-ae1fd3caf340 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c488812-68f5-41d9-9d25-7f0fb61125f5", "tag": "ab17bc28-ab3f-46b1-be9d-d202c3e9d04f"}]} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:55:02.325016 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-558c1da0-86d5-49eb-b087-3d3ca14d86cb req-26a5bedb-fc4b-4435-aef8-ae1fd3caf340 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:02.325459 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-558c1da0-86d5-49eb-b087-3d3ca14d86cb req-26a5bedb-fc4b-4435-aef8-ae1fd3caf340 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:02.335898 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.compute.server_external_events [req-558c1da0-86d5-49eb-b087-3d3ca14d86cb req-26a5bedb-fc4b-4435-aef8-ae1fd3caf340 service nova] Creating event network-changed:ab17bc28-ab3f-46b1-be9d-d202c3e9d04f for instance 1c488812-68f5-41d9-9d25-7f0fb61125f5 on hv-cinder-83009 Mar 08 14:55:02.341008 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [req-558c1da0-86d5-49eb-b087-3d3ca14d86cb req-26a5bedb-fc4b-4435-aef8-ae1fd3caf340 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027271 Mar 08 14:55:02.341828 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 291/595] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 14:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:55:03.224035 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-d3532be6-e1f0-4ae2-939e-c289b10ec99a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:55:03.226550 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-d3532be6-e1f0-4ae2-939e-c289b10ec99a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:55:03.234075 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d3532be6-e1f0-4ae2-939e-c289b10ec99a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:03.234832 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d3532be6-e1f0-4ae2-939e-c289b10ec99a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:03.235854 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d3532be6-e1f0-4ae2-939e-c289b10ec99a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:03.236488 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d3532be6-e1f0-4ae2-939e-c289b10ec99a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:03.247065 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-92cd5f26-dc53-4e8f-9317-ab473bd85bd1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "POST /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.449251 Mar 08 14:55:03.253823 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 305/596] 10.222.0.30 () {60 vars in 1322 bytes} [Tue Mar 8 14:54:59 2022] POST /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 194 bytes in 3457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:55:03.762207 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-d3532be6-e1f0-4ae2-939e-c289b10ec99a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:55:03.772632 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-d3532be6-e1f0-4ae2-939e-c289b10ec99a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1266 microversion: 2.1 time: 0.553039 Mar 08 14:55:03.775425 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 292/597] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:55:03 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1266 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:55:04.791330 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-cd8a56d5-7c01-4324-a118-2063804ac320 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:55:04.791984 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-cd8a56d5-7c01-4324-a118-2063804ac320 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:55:04.798527 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cd8a56d5-7c01-4324-a118-2063804ac320 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:04.798983 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cd8a56d5-7c01-4324-a118-2063804ac320 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:04.799770 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cd8a56d5-7c01-4324-a118-2063804ac320 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:04.800213 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cd8a56d5-7c01-4324-a118-2063804ac320 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:04.956367 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-cd8a56d5-7c01-4324-a118-2063804ac320 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:55:04.964190 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-cd8a56d5-7c01-4324-a118-2063804ac320 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1266 microversion: 2.1 time: 0.177077 Mar 08 14:55:04.964767 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 306/598] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:55:04 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:55:05.981583 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-0cd09fa3-3055-4800-bd08-ec607b1625e9 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:55:05.982263 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-0cd09fa3-3055-4800-bd08-ec607b1625e9 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:55:05.988556 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0cd09fa3-3055-4800-bd08-ec607b1625e9 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:05.989015 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0cd09fa3-3055-4800-bd08-ec607b1625e9 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:05.989780 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0cd09fa3-3055-4800-bd08-ec607b1625e9 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:05.990246 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0cd09fa3-3055-4800-bd08-ec607b1625e9 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:06.126161 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-0cd09fa3-3055-4800-bd08-ec607b1625e9 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:55:06.133333 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-0cd09fa3-3055-4800-bd08-ec607b1625e9 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1453 microversion: 2.1 time: 0.156158 Mar 08 14:55:06.133902 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 293/599] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:55:05 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:55:06.149706 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-8463b6f4-554a-4ee2-bbae-7b38cc4e5d1a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:55:06.150368 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-8463b6f4-554a-4ee2-bbae-7b38cc4e5d1a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:55:06.156891 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8463b6f4-554a-4ee2-bbae-7b38cc4e5d1a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:06.157344 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8463b6f4-554a-4ee2-bbae-7b38cc4e5d1a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:06.158156 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8463b6f4-554a-4ee2-bbae-7b38cc4e5d1a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:06.158602 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8463b6f4-554a-4ee2-bbae-7b38cc4e5d1a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:06.289311 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-8463b6f4-554a-4ee2-bbae-7b38cc4e5d1a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:55:06.297359 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-8463b6f4-554a-4ee2-bbae-7b38cc4e5d1a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1453 microversion: 2.1 time: 0.151478 Mar 08 14:55:06.297947 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 307/600] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:55:06 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:55:08.489567 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [req-67038484-50f1-4de8-8e3d-e64a8795f953 req-7f2b762d-12dc-4a39-99c2-b00ae9b62b5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b13cbf6-22b6-4acc-bbc2-1baead4cb29a", "tag": "ab8b501c-d93f-421a-bbc2-a770d69214bf"}]} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:55:08.498567 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-67038484-50f1-4de8-8e3d-e64a8795f953 req-7f2b762d-12dc-4a39-99c2-b00ae9b62b5c service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:08.499250 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-67038484-50f1-4de8-8e3d-e64a8795f953 req-7f2b762d-12dc-4a39-99c2-b00ae9b62b5c service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:08.510079 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.compute.server_external_events [req-67038484-50f1-4de8-8e3d-e64a8795f953 req-7f2b762d-12dc-4a39-99c2-b00ae9b62b5c service nova] Creating event network-changed:ab8b501c-d93f-421a-bbc2-a770d69214bf for instance 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a on hv-cinder-83009 Mar 08 14:55:08.515902 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [req-67038484-50f1-4de8-8e3d-e64a8795f953 req-7f2b762d-12dc-4a39-99c2-b00ae9b62b5c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029841 Mar 08 14:55:08.516558 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 294/601] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 14:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:55:41.948908 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-efb91332-4d9a-4649-99c4-9b090e83e144 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:55:41.949462 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-efb91332-4d9a-4649-99c4-9b090e83e144 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:55:41.955599 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-efb91332-4d9a-4649-99c4-9b090e83e144 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:41.956050 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-efb91332-4d9a-4649-99c4-9b090e83e144 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:41.956831 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-efb91332-4d9a-4649-99c4-9b090e83e144 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:41.957271 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-efb91332-4d9a-4649-99c4-9b090e83e144 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:41.986085 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-efb91332-4d9a-4649-99c4-9b090e83e144 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments/0e5d04ad-3d3f-417f-9390-ec286037e38f" status: 200 len: 194 microversion: 2.20 time: 0.041376 Mar 08 14:55:41.986706 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 308/602] 10.222.0.30 () {60 vars in 1453 bytes} [Tue Mar 8 14:55:41 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments/0e5d04ad-3d3f-417f-9390-ec286037e38f => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:55:42.048366 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-863a6040-db39-4316-9b74-2648f6205710 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:55:42.048943 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-863a6040-db39-4316-9b74-2648f6205710 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:55:42.055138 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-863a6040-db39-4316-9b74-2648f6205710 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:42.055789 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-863a6040-db39-4316-9b74-2648f6205710 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:42.057289 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-863a6040-db39-4316-9b74-2648f6205710 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:42.057574 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-863a6040-db39-4316-9b74-2648f6205710 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:42.136674 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.objects.instance [None req-863a6040-db39-4316-9b74-2648f6205710 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lazy-loading 'services' on Instance uuid 1b7917ad-8941-400f-ae66-d22e26633416 {{(pid=128351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 14:55:42.205168 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-863a6040-db39-4316-9b74-2648f6205710 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments/0e5d04ad-3d3f-417f-9390-ec286037e38f" status: 202 len: 0 microversion: 2.20 time: 0.161408 Mar 08 14:55:42.205789 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 295/603] 10.222.0.30 () {60 vars in 1456 bytes} [Tue Mar 8 14:55:42 2022] DELETE /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments/0e5d04ad-3d3f-417f-9390-ec286037e38f => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Mar 08 14:55:42.214646 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-7be2ea07-97a1-4397-8dff-2de0abfca7f8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:55:42.215649 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-7be2ea07-97a1-4397-8dff-2de0abfca7f8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:55:42.221631 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7be2ea07-97a1-4397-8dff-2de0abfca7f8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:42.222110 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7be2ea07-97a1-4397-8dff-2de0abfca7f8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:42.222889 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7be2ea07-97a1-4397-8dff-2de0abfca7f8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:42.223325 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7be2ea07-97a1-4397-8dff-2de0abfca7f8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:42.255149 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-7be2ea07-97a1-4397-8dff-2de0abfca7f8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045021 Mar 08 14:55:42.255832 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 309/604] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:55:42 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:55:43.268119 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-4a5c0a86-100c-4782-8800-9bdaafc7d572 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:55:43.269159 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-4a5c0a86-100c-4782-8800-9bdaafc7d572 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:55:43.275879 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4a5c0a86-100c-4782-8800-9bdaafc7d572 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:43.276347 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4a5c0a86-100c-4782-8800-9bdaafc7d572 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:43.277122 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4a5c0a86-100c-4782-8800-9bdaafc7d572 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:43.277565 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4a5c0a86-100c-4782-8800-9bdaafc7d572 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:43.306259 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-4a5c0a86-100c-4782-8800-9bdaafc7d572 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042879 Mar 08 14:55:43.307708 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 296/605] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:55:43 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:55:44.318896 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3845149c-54aa-4938-847f-a272dae27d6d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:55:44.319802 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-3845149c-54aa-4938-847f-a272dae27d6d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:55:44.326777 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3845149c-54aa-4938-847f-a272dae27d6d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:44.327231 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3845149c-54aa-4938-847f-a272dae27d6d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:44.327995 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3845149c-54aa-4938-847f-a272dae27d6d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:44.328433 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3845149c-54aa-4938-847f-a272dae27d6d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:44.356216 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-3845149c-54aa-4938-847f-a272dae27d6d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041318 Mar 08 14:55:44.356767 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 310/606] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:55:44 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:55:45.368011 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b304370a-a0d5-47ff-92aa-39101841a9ce tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:55:45.369461 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-b304370a-a0d5-47ff-92aa-39101841a9ce tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:55:45.375573 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b304370a-a0d5-47ff-92aa-39101841a9ce tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:45.376024 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b304370a-a0d5-47ff-92aa-39101841a9ce tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:45.376792 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b304370a-a0d5-47ff-92aa-39101841a9ce tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:45.377232 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b304370a-a0d5-47ff-92aa-39101841a9ce tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:45.405456 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-b304370a-a0d5-47ff-92aa-39101841a9ce tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041533 Mar 08 14:55:45.406036 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 297/607] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:55:45 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:55:46.418234 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b3c3fe7b-d1c7-4578-a8f8-b6e4702f56ba tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:55:46.419165 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b3c3fe7b-d1c7-4578-a8f8-b6e4702f56ba tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:55:46.425363 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b3c3fe7b-d1c7-4578-a8f8-b6e4702f56ba tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:46.425816 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b3c3fe7b-d1c7-4578-a8f8-b6e4702f56ba tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:46.426616 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b3c3fe7b-d1c7-4578-a8f8-b6e4702f56ba tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:46.427050 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b3c3fe7b-d1c7-4578-a8f8-b6e4702f56ba tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:46.455527 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b3c3fe7b-d1c7-4578-a8f8-b6e4702f56ba tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042287 Mar 08 14:55:46.456071 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 311/608] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:55:46 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:55:47.073382 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-ba8e08f7-4b36-4eb6-8595-4b0802bf0348 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:55:47.074342 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-ba8e08f7-4b36-4eb6-8595-4b0802bf0348 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:55:47.081037 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ba8e08f7-4b36-4eb6-8595-4b0802bf0348 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:47.081514 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ba8e08f7-4b36-4eb6-8595-4b0802bf0348 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:47.082423 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ba8e08f7-4b36-4eb6-8595-4b0802bf0348 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:47.082903 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ba8e08f7-4b36-4eb6-8595-4b0802bf0348 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:47.111319 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-ba8e08f7-4b36-4eb6-8595-4b0802bf0348 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042443 Mar 08 14:55:47.111873 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 298/609] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:55:47 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 08 14:55:47.167644 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-953ff618-628a-41ab-8fff-64951a73e599 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:55:47.168137 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-953ff618-628a-41ab-8fff-64951a73e599 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:55:47.173764 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-953ff618-628a-41ab-8fff-64951a73e599 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:47.174240 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-953ff618-628a-41ab-8fff-64951a73e599 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:47.175005 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-953ff618-628a-41ab-8fff-64951a73e599 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:47.175437 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-953ff618-628a-41ab-8fff-64951a73e599 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:47.199501 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-953ff618-628a-41ab-8fff-64951a73e599 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Going to try to terminate instance {{(pid=128352) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 14:55:47.271209 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-953ff618-628a-41ab-8fff-64951a73e599 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "DELETE /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 204 len: 0 microversion: 2.1 time: 0.107118 Mar 08 14:55:47.271967 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 312/610] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 14:55:47 2022] DELETE /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 08 14:55:47.280398 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-0b8c26c0-c5db-43c5-b099-a9e14b18713b tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:55:47.281165 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-0b8c26c0-c5db-43c5-b099-a9e14b18713b tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:55:47.286879 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0b8c26c0-c5db-43c5-b099-a9e14b18713b tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:47.287336 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0b8c26c0-c5db-43c5-b099-a9e14b18713b tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:47.288109 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0b8c26c0-c5db-43c5-b099-a9e14b18713b tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:47.288547 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0b8c26c0-c5db-43c5-b099-a9e14b18713b tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:47.426538 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-0b8c26c0-c5db-43c5-b099-a9e14b18713b tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:55:47.434054 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-0b8c26c0-c5db-43c5-b099-a9e14b18713b tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1673 microversion: 2.1 time: 0.157466 Mar 08 14:55:47.434620 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 299/611] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:55:47 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:55:47.468382 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ae89d835-2d42-4131-b553-563876e821a8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:55:47.469322 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ae89d835-2d42-4131-b553-563876e821a8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:55:47.475572 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ae89d835-2d42-4131-b553-563876e821a8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:47.476032 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ae89d835-2d42-4131-b553-563876e821a8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:47.476794 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ae89d835-2d42-4131-b553-563876e821a8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:47.477234 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ae89d835-2d42-4131-b553-563876e821a8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:47.505198 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ae89d835-2d42-4131-b553-563876e821a8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041166 Mar 08 14:55:47.505736 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 313/612] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:55:47 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:55:48.450778 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-5cab672e-76f6-42f7-975c-ad42ed38844f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:55:48.451413 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-5cab672e-76f6-42f7-975c-ad42ed38844f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:55:48.457569 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5cab672e-76f6-42f7-975c-ad42ed38844f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:48.458072 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5cab672e-76f6-42f7-975c-ad42ed38844f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:48.458833 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5cab672e-76f6-42f7-975c-ad42ed38844f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:48.459268 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5cab672e-76f6-42f7-975c-ad42ed38844f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:48.516685 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f212100d-b98c-4efe-b96c-6dad7ef6cff8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:55:48.517598 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f212100d-b98c-4efe-b96c-6dad7ef6cff8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:55:48.523703 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f212100d-b98c-4efe-b96c-6dad7ef6cff8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:48.524150 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f212100d-b98c-4efe-b96c-6dad7ef6cff8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:48.525430 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f212100d-b98c-4efe-b96c-6dad7ef6cff8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:48.525912 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f212100d-b98c-4efe-b96c-6dad7ef6cff8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:48.554239 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f212100d-b98c-4efe-b96c-6dad7ef6cff8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041407 Mar 08 14:55:48.554802 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 314/613] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:55:48 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:55:48.591999 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-5cab672e-76f6-42f7-975c-ad42ed38844f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:55:48.599464 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-5cab672e-76f6-42f7-975c-ad42ed38844f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1673 microversion: 2.1 time: 0.152431 Mar 08 14:55:48.599962 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 300/614] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:55:48 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:55:49.567260 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-fa3ea3ab-773f-48d3-b5c0-024015df1aed tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:55:49.568265 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-fa3ea3ab-773f-48d3-b5c0-024015df1aed tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:55:49.574650 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fa3ea3ab-773f-48d3-b5c0-024015df1aed tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:49.575103 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fa3ea3ab-773f-48d3-b5c0-024015df1aed tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:49.575887 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fa3ea3ab-773f-48d3-b5c0-024015df1aed tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:49.576322 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fa3ea3ab-773f-48d3-b5c0-024015df1aed tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:49.607069 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-fa3ea3ab-773f-48d3-b5c0-024015df1aed tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043708 Mar 08 14:55:49.607635 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 315/615] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:55:49 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:55:49.616570 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-3898ceae-442b-407e-ab93-5bb9f7061999 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:55:49.617186 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-3898ceae-442b-407e-ab93-5bb9f7061999 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:55:49.624924 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3898ceae-442b-407e-ab93-5bb9f7061999 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:49.624924 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3898ceae-442b-407e-ab93-5bb9f7061999 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:49.625465 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3898ceae-442b-407e-ab93-5bb9f7061999 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:49.625932 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3898ceae-442b-407e-ab93-5bb9f7061999 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:49.950419 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-3898ceae-442b-407e-ab93-5bb9f7061999 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:55:49.957662 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-3898ceae-442b-407e-ab93-5bb9f7061999 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1673 microversion: 2.1 time: 0.344992 Mar 08 14:55:49.958261 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 301/616] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:55:49 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1673 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:55:50.480303 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [req-eefc3615-8a63-46f7-bf90-3032a43e62f6 req-f014443d-438f-44fb-b6db-0d4909cc7b30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04409dca-0761-4f98-b039-a620e2bef81e", "name": "network-vif-deleted", "tag": "2a5a9e74-f475-4a3f-a2cc-034ea707cdeb"}]} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:55:50.490291 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-eefc3615-8a63-46f7-bf90-3032a43e62f6 req-f014443d-438f-44fb-b6db-0d4909cc7b30 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:50.491078 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-eefc3615-8a63-46f7-bf90-3032a43e62f6 req-f014443d-438f-44fb-b6db-0d4909cc7b30 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:50.510255 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.compute.server_external_events [req-eefc3615-8a63-46f7-bf90-3032a43e62f6 req-f014443d-438f-44fb-b6db-0d4909cc7b30 service nova] Creating event network-vif-deleted:2a5a9e74-f475-4a3f-a2cc-034ea707cdeb for instance 04409dca-0761-4f98-b039-a620e2bef81e on hv-cinder-83009 Mar 08 14:55:50.516857 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [req-eefc3615-8a63-46f7-bf90-3032a43e62f6 req-f014443d-438f-44fb-b6db-0d4909cc7b30 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040252 Mar 08 14:55:50.517842 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 316/617] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 14:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:55:50.620217 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-533012f5-6fdc-4a8a-a305-78a4d0a979c0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:55:50.621158 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-533012f5-6fdc-4a8a-a305-78a4d0a979c0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:55:50.628642 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-533012f5-6fdc-4a8a-a305-78a4d0a979c0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:50.629098 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-533012f5-6fdc-4a8a-a305-78a4d0a979c0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:50.629919 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-533012f5-6fdc-4a8a-a305-78a4d0a979c0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:50.630444 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-533012f5-6fdc-4a8a-a305-78a4d0a979c0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:50.661650 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-533012f5-6fdc-4a8a-a305-78a4d0a979c0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046845 Mar 08 14:55:50.662267 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 302/618] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:55:50 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:55:50.977273 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-98389a3f-c76a-4a2a-8458-3b1c2b959397 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:55:50.979562 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-98389a3f-c76a-4a2a-8458-3b1c2b959397 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:55:50.986099 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-98389a3f-c76a-4a2a-8458-3b1c2b959397 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:50.986551 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-98389a3f-c76a-4a2a-8458-3b1c2b959397 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:50.987320 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-98389a3f-c76a-4a2a-8458-3b1c2b959397 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:50.987926 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-98389a3f-c76a-4a2a-8458-3b1c2b959397 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:51.023404 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-98389a3f-c76a-4a2a-8458-3b1c2b959397 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:51.024046 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-98389a3f-c76a-4a2a-8458-3b1c2b959397 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:51.024574 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.objects.instance [None req-98389a3f-c76a-4a2a-8458-3b1c2b959397 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lazy-loading 'fault' on Instance uuid 04409dca-0761-4f98-b039-a620e2bef81e {{(pid=128352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 14:55:51.068682 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-98389a3f-c76a-4a2a-8458-3b1c2b959397 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:55:51.077623 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-98389a3f-c76a-4a2a-8458-3b1c2b959397 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 200 len: 1328 microversion: 2.1 time: 0.105981 Mar 08 14:55:51.078350 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 317/619] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:55:50 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 1328 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:55:51.672747 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-fd4e343c-f3c6-44d1-a02c-c0d66d744c3b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:55:51.673752 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-fd4e343c-f3c6-44d1-a02c-c0d66d744c3b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:55:51.680166 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fd4e343c-f3c6-44d1-a02c-c0d66d744c3b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:51.680704 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fd4e343c-f3c6-44d1-a02c-c0d66d744c3b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:51.682276 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fd4e343c-f3c6-44d1-a02c-c0d66d744c3b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:51.682796 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fd4e343c-f3c6-44d1-a02c-c0d66d744c3b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:51.714328 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-fd4e343c-f3c6-44d1-a02c-c0d66d744c3b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045338 Mar 08 14:55:51.715141 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 303/620] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:55:51 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:55:52.094863 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5a516237-c99c-4f2c-9504-2a09dcb089c9 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:55:52.095580 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5a516237-c99c-4f2c-9504-2a09dcb089c9 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:55:52.101977 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5a516237-c99c-4f2c-9504-2a09dcb089c9 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:52.102497 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5a516237-c99c-4f2c-9504-2a09dcb089c9 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:52.103996 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5a516237-c99c-4f2c-9504-2a09dcb089c9 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:52.104500 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5a516237-c99c-4f2c-9504-2a09dcb089c9 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:52.118266 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-5a516237-c99c-4f2c-9504-2a09dcb089c9 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] HTTP exception thrown: Instance 04409dca-0761-4f98-b039-a620e2bef81e could not be found. Mar 08 14:55:52.119009 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5a516237-c99c-4f2c-9504-2a09dcb089c9 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Returning 404 to user: Instance 04409dca-0761-4f98-b039-a620e2bef81e could not be found. {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 14:55:52.119858 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5a516237-c99c-4f2c-9504-2a09dcb089c9 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 404 len: 111 microversion: 2.1 time: 0.028992 Mar 08 14:55:52.120391 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 318/621] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:55:52 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 14:55:52.128862 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-6d0e11f5-b8cb-4849-82e6-d25084f782bd tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '.version_select at 0x7ff35cf90ee0>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:55:52.149420 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-6d0e11f5-b8cb-4849-82e6-d25084f782bd tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1050794834" status: 202 len: 0 microversion: 2.1 time: 0.024156 Mar 08 14:55:52.154044 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 304/622] 10.222.0.30 () {58 vars in 1220 bytes} [Tue Mar 8 14:55:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1050794834 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 14:55:52.726061 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-0b2fd13e-4e28-4a40-a689-38109f074511 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:55:52.727229 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-0b2fd13e-4e28-4a40-a689-38109f074511 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:55:52.733717 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0b2fd13e-4e28-4a40-a689-38109f074511 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:52.734202 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0b2fd13e-4e28-4a40-a689-38109f074511 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:52.735199 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0b2fd13e-4e28-4a40-a689-38109f074511 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:52.735822 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0b2fd13e-4e28-4a40-a689-38109f074511 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:52.766773 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-0b2fd13e-4e28-4a40-a689-38109f074511 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044599 Mar 08 14:55:52.767634 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 319/623] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:55:52 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:55:52.810350 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-c7514d7a-0351-462f-adaf-fcbbece0aad8 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Action: 'create', calling method: .version_select at 0x7ff35ce47160>, body: {"keypair": {"name": "tempest-keypair-513935596"}} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:55:52.825252 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.quota [None req-c7514d7a-0351-462f-adaf-fcbbece0aad8 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Getting quotas for project 3f98f6f0a9d945e88b01a9da19044aa1. Resources: {'key_pairs'} {{(pid=128351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 14:55:52.828955 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.quota [None req-c7514d7a-0351-462f-adaf-fcbbece0aad8 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Getting quotas for user 51ed61d0a16d465889c0474a4d2b7dee and project 3f98f6f0a9d945e88b01a9da19044aa1. Resources: {'key_pairs'} {{(pid=128351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 14:55:53.199563 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.quota [None req-c7514d7a-0351-462f-adaf-fcbbece0aad8 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Getting quotas for project 3f98f6f0a9d945e88b01a9da19044aa1. Resources: {'key_pairs'} {{(pid=128351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 14:55:53.203620 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.quota [None req-c7514d7a-0351-462f-adaf-fcbbece0aad8 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Getting quotas for user 51ed61d0a16d465889c0474a4d2b7dee and project 3f98f6f0a9d945e88b01a9da19044aa1. Resources: {'key_pairs'} {{(pid=128351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 14:55:53.217172 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-c7514d7a-0351-462f-adaf-fcbbece0aad8 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.411151 Mar 08 14:55:53.217917 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 305/624] 10.222.0.30 () {60 vars in 1157 bytes} [Tue Mar 8 14:55:52 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:55:53.779135 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-4aed671d-ad47-4d79-83f6-5bde1fd439cb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:55:53.780607 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-4aed671d-ad47-4d79-83f6-5bde1fd439cb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:55:53.790983 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4aed671d-ad47-4d79-83f6-5bde1fd439cb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:53.791533 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4aed671d-ad47-4d79-83f6-5bde1fd439cb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:53.792407 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4aed671d-ad47-4d79-83f6-5bde1fd439cb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:53.792959 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4aed671d-ad47-4d79-83f6-5bde1fd439cb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:53.823254 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-4aed671d-ad47-4d79-83f6-5bde1fd439cb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048738 Mar 08 14:55:53.823820 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 320/625] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:55:53 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:55:54.517097 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-5bf6ed82-991b-4e5c-ac09-66ebb7d9cfd3 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1698305570", "imageRef": "7541d53b-003d-4f1a-8d76-fc5f4bd8dabf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aaa227f6-cd71-48f7-9973-9ac995e5340d"}], "security_groups": [{"name": "tempest-securitygroup--393390003"}], "key_name": "tempest-keypair-513935596", "user_data": "}} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:55:54.625414 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.network.neutron [None req-5bf6ed82-991b-4e5c-ac09-66ebb7d9cfd3 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] validate_networks() for [('aaa227f6-cd71-48f7-9973-9ac995e5340d', None, None, None, None, None)] {{(pid=128351) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 14:55:54.835468 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d5dae445-9870-43bb-bcbb-0c27dbbab9f1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:55:54.836604 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d5dae445-9870-43bb-bcbb-0c27dbbab9f1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:55:54.844428 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d5dae445-9870-43bb-bcbb-0c27dbbab9f1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:54.845062 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d5dae445-9870-43bb-bcbb-0c27dbbab9f1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:54.846010 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d5dae445-9870-43bb-bcbb-0c27dbbab9f1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:54.846559 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d5dae445-9870-43bb-bcbb-0c27dbbab9f1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:54.879969 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d5dae445-9870-43bb-bcbb-0c27dbbab9f1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048518 Mar 08 14:55:54.884667 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 321/626] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:55:54 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:55:55.241725 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-5bf6ed82-991b-4e5c-ac09-66ebb7d9cfd3 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Flavor limits 0:0:0 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 14:55:55.242200 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-5bf6ed82-991b-4e5c-ac09-66ebb7d9cfd3 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Image limits 0:0:0 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 14:55:55.242677 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-5bf6ed82-991b-4e5c-ac09-66ebb7d9cfd3 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Flavor pref 0:0:0 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 14:55:55.243088 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-5bf6ed82-991b-4e5c-ac09-66ebb7d9cfd3 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Image pref 0:0:0 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 14:55:55.244000 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-5bf6ed82-991b-4e5c-ac09-66ebb7d9cfd3 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 14:55:55.252730 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5bf6ed82-991b-4e5c-ac09-66ebb7d9cfd3 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:55.253176 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5bf6ed82-991b-4e5c-ac09-66ebb7d9cfd3 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:55.254010 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5bf6ed82-991b-4e5c-ac09-66ebb7d9cfd3 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:55.254452 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5bf6ed82-991b-4e5c-ac09-66ebb7d9cfd3 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:55.271543 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.quota [None req-5bf6ed82-991b-4e5c-ac09-66ebb7d9cfd3 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Getting quotas for project 3f98f6f0a9d945e88b01a9da19044aa1. Resources: {'instances', 'ram', 'cores'} {{(pid=128351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 14:55:55.275611 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.quota [None req-5bf6ed82-991b-4e5c-ac09-66ebb7d9cfd3 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Getting quotas for user 51ed61d0a16d465889c0474a4d2b7dee and project 3f98f6f0a9d945e88b01a9da19044aa1. Resources: {'instances', 'ram', 'cores'} {{(pid=128351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 14:55:55.286271 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-5bf6ed82-991b-4e5c-ac09-66ebb7d9cfd3 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Going to run 1 instances... {{(pid=128351) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 14:55:55.288495 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-5bf6ed82-991b-4e5c-ac09-66ebb7d9cfd3 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7541d53b-003d-4f1a-8d76-fc5f4bd8dabf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 14:55:55.333960 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-5bf6ed82-991b-4e5c-ac09-66ebb7d9cfd3 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.821506 Mar 08 14:55:55.334601 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 306/627] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Mar 8 14:55:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 823 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 14:55:55.344454 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-eea405dd-fbe5-4889-8927-49bf5c2443d3 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:55:55.345058 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-eea405dd-fbe5-4889-8927-49bf5c2443d3 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:55:55.397584 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-eea405dd-fbe5-4889-8927-49bf5c2443d3 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:55:55.404126 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-eea405dd-fbe5-4889-8927-49bf5c2443d3 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42" status: 200 len: 1237 microversion: 2.1 time: 0.063354 Mar 08 14:55:55.404621 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 322/628] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:55:55 2022] GET /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 => generated 1237 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:55:55.892862 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-1e7763db-89fb-4905-b0b5-ec08fb0ab1cc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:55:55.894377 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-1e7763db-89fb-4905-b0b5-ec08fb0ab1cc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:55:55.901768 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1e7763db-89fb-4905-b0b5-ec08fb0ab1cc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:55.902391 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1e7763db-89fb-4905-b0b5-ec08fb0ab1cc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:55.903320 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1e7763db-89fb-4905-b0b5-ec08fb0ab1cc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:55.903767 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1e7763db-89fb-4905-b0b5-ec08fb0ab1cc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:55.932192 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-1e7763db-89fb-4905-b0b5-ec08fb0ab1cc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043551 Mar 08 14:55:55.932681 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 307/629] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:55:55 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:55:56.420968 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-0b83c331-8a6c-40fd-8456-2db51489df34 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:55:56.421582 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-0b83c331-8a6c-40fd-8456-2db51489df34 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:55:56.428027 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0b83c331-8a6c-40fd-8456-2db51489df34 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:56.428507 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0b83c331-8a6c-40fd-8456-2db51489df34 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:56.429280 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0b83c331-8a6c-40fd-8456-2db51489df34 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:56.429715 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0b83c331-8a6c-40fd-8456-2db51489df34 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:56.489939 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-0b83c331-8a6c-40fd-8456-2db51489df34 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:55:56.497899 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-0b83c331-8a6c-40fd-8456-2db51489df34 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42" status: 200 len: 1295 microversion: 2.1 time: 0.080726 Mar 08 14:55:56.498652 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 323/630] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:55:56 2022] GET /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 => generated 1295 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:55:56.944511 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-9e3c3b90-3201-4502-a1d9-7fc7221c61ba tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:55:56.946326 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-9e3c3b90-3201-4502-a1d9-7fc7221c61ba tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:55:56.953433 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9e3c3b90-3201-4502-a1d9-7fc7221c61ba tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:56.953901 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9e3c3b90-3201-4502-a1d9-7fc7221c61ba tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:56.954846 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9e3c3b90-3201-4502-a1d9-7fc7221c61ba tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:56.955289 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9e3c3b90-3201-4502-a1d9-7fc7221c61ba tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:56.987348 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-9e3c3b90-3201-4502-a1d9-7fc7221c61ba tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047149 Mar 08 14:55:56.988248 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 308/631] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:55:56 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:55:57.514805 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-a369bee8-a4d4-48ad-8301-542409c98598 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:55:57.515558 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-a369bee8-a4d4-48ad-8301-542409c98598 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:55:57.522053 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a369bee8-a4d4-48ad-8301-542409c98598 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:57.522529 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a369bee8-a4d4-48ad-8301-542409c98598 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:57.523305 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a369bee8-a4d4-48ad-8301-542409c98598 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:57.523762 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a369bee8-a4d4-48ad-8301-542409c98598 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:57.593737 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [req-255e9e08-962d-4959-89cc-16626ba8a1e4 req-49b0a72d-c3a4-47f8-a28f-f1835b4ffe65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42", "tag": "47990633-f90b-4bac-989c-4141bf8ff314"}]} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:55:57.604249 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-255e9e08-962d-4959-89cc-16626ba8a1e4 req-49b0a72d-c3a4-47f8-a28f-f1835b4ffe65 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:57.605044 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-255e9e08-962d-4959-89cc-16626ba8a1e4 req-49b0a72d-c3a4-47f8-a28f-f1835b4ffe65 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:57.637670 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.compute.server_external_events [req-255e9e08-962d-4959-89cc-16626ba8a1e4 req-49b0a72d-c3a4-47f8-a28f-f1835b4ffe65 service nova] Creating event network-changed:47990633-f90b-4bac-989c-4141bf8ff314 for instance 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 on hv-cinder-83009 Mar 08 14:55:57.643092 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [req-255e9e08-962d-4959-89cc-16626ba8a1e4 req-49b0a72d-c3a4-47f8-a28f-f1835b4ffe65 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056170 Mar 08 14:55:57.644269 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 309/632] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 14:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:55:57.685191 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-a369bee8-a4d4-48ad-8301-542409c98598 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:55:57.692534 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-a369bee8-a4d4-48ad-8301-542409c98598 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42" status: 200 len: 1362 microversion: 2.1 time: 0.181543 Mar 08 14:55:57.693110 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 324/633] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:55:57 2022] GET /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:55:58.000728 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-712c75ba-1d8e-4a49-9e8e-7ae988791dfd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:55:58.001710 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-712c75ba-1d8e-4a49-9e8e-7ae988791dfd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:55:58.007796 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-712c75ba-1d8e-4a49-9e8e-7ae988791dfd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:58.008235 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-712c75ba-1d8e-4a49-9e8e-7ae988791dfd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:58.009622 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-712c75ba-1d8e-4a49-9e8e-7ae988791dfd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:58.010315 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-712c75ba-1d8e-4a49-9e8e-7ae988791dfd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:58.037928 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-712c75ba-1d8e-4a49-9e8e-7ae988791dfd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041947 Mar 08 14:55:58.038494 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 310/634] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:55:57 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:55:58.710364 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-075f1047-6b35-4dcf-aa2b-12db03f6482e tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:55:58.710969 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-075f1047-6b35-4dcf-aa2b-12db03f6482e tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:55:58.717215 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-075f1047-6b35-4dcf-aa2b-12db03f6482e tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:58.717668 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-075f1047-6b35-4dcf-aa2b-12db03f6482e tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:58.718462 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-075f1047-6b35-4dcf-aa2b-12db03f6482e tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:58.718898 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-075f1047-6b35-4dcf-aa2b-12db03f6482e tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:58.852522 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-075f1047-6b35-4dcf-aa2b-12db03f6482e tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:55:58.860387 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-075f1047-6b35-4dcf-aa2b-12db03f6482e tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42" status: 200 len: 1362 microversion: 2.1 time: 0.153860 Mar 08 14:55:58.860937 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 325/635] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:55:58 2022] GET /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:55:59.049571 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-616cb0ae-8ecc-43f0-8f0a-e6a288fa105e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:55:59.051157 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-616cb0ae-8ecc-43f0-8f0a-e6a288fa105e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:55:59.056940 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-616cb0ae-8ecc-43f0-8f0a-e6a288fa105e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:59.057328 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-616cb0ae-8ecc-43f0-8f0a-e6a288fa105e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:59.058385 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-616cb0ae-8ecc-43f0-8f0a-e6a288fa105e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:59.058823 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-616cb0ae-8ecc-43f0-8f0a-e6a288fa105e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:59.088919 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-616cb0ae-8ecc-43f0-8f0a-e6a288fa105e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043276 Mar 08 14:55:59.089468 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 311/636] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:55:59 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:55:59.877179 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-299797e7-43f8-437f-90c6-e4256d28371b tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:55:59.877692 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-299797e7-43f8-437f-90c6-e4256d28371b tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:55:59.884503 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-299797e7-43f8-437f-90c6-e4256d28371b tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:59.884965 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-299797e7-43f8-437f-90c6-e4256d28371b tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:55:59.885798 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-299797e7-43f8-437f-90c6-e4256d28371b tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:55:59.886263 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-299797e7-43f8-437f-90c6-e4256d28371b tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:00.015346 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-299797e7-43f8-437f-90c6-e4256d28371b tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:56:00.022479 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-299797e7-43f8-437f-90c6-e4256d28371b tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42" status: 200 len: 1362 microversion: 2.1 time: 0.149190 Mar 08 14:56:00.023048 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 326/637] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:55:59 2022] GET /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:56:00.100532 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-a44e79be-f07c-43a4-8cdb-2b6765cc2759 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:00.101457 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-a44e79be-f07c-43a4-8cdb-2b6765cc2759 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:00.109105 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a44e79be-f07c-43a4-8cdb-2b6765cc2759 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:00.109841 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a44e79be-f07c-43a4-8cdb-2b6765cc2759 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:00.110670 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a44e79be-f07c-43a4-8cdb-2b6765cc2759 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:00.111108 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a44e79be-f07c-43a4-8cdb-2b6765cc2759 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:00.139761 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-a44e79be-f07c-43a4-8cdb-2b6765cc2759 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043111 Mar 08 14:56:00.140237 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 312/638] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:00 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:56:01.039004 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-a7e180d5-30dc-4017-a33a-851bdc55ba7b tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:01.039610 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-a7e180d5-30dc-4017-a33a-851bdc55ba7b tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:01.046063 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a7e180d5-30dc-4017-a33a-851bdc55ba7b tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:01.046512 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a7e180d5-30dc-4017-a33a-851bdc55ba7b tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:01.047273 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a7e180d5-30dc-4017-a33a-851bdc55ba7b tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:01.047709 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a7e180d5-30dc-4017-a33a-851bdc55ba7b tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:01.151333 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-17ed6f4c-f4b3-441b-aa35-7fd526194584 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:01.152240 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-17ed6f4c-f4b3-441b-aa35-7fd526194584 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:01.158360 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-17ed6f4c-f4b3-441b-aa35-7fd526194584 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:01.158813 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-17ed6f4c-f4b3-441b-aa35-7fd526194584 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:01.159575 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-17ed6f4c-f4b3-441b-aa35-7fd526194584 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:01.160012 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-17ed6f4c-f4b3-441b-aa35-7fd526194584 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:01.190275 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-17ed6f4c-f4b3-441b-aa35-7fd526194584 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042719 Mar 08 14:56:01.190768 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 313/639] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:01 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:56:01.291521 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-a7e180d5-30dc-4017-a33a-851bdc55ba7b tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:56:01.298812 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-a7e180d5-30dc-4017-a33a-851bdc55ba7b tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42" status: 200 len: 1362 microversion: 2.1 time: 0.263594 Mar 08 14:56:01.299372 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 327/640] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:56:01 2022] GET /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 => generated 1362 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:56:02.202709 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-a47c5df5-ea67-4103-8a8d-3668e06a8a92 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:02.203525 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-a47c5df5-ea67-4103-8a8d-3668e06a8a92 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:02.209791 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a47c5df5-ea67-4103-8a8d-3668e06a8a92 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:02.210271 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a47c5df5-ea67-4103-8a8d-3668e06a8a92 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:02.211038 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a47c5df5-ea67-4103-8a8d-3668e06a8a92 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:02.211477 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a47c5df5-ea67-4103-8a8d-3668e06a8a92 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:02.239304 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-a47c5df5-ea67-4103-8a8d-3668e06a8a92 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040671 Mar 08 14:56:02.239849 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 314/641] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:02 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:56:02.316313 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-29d9ac9f-97b6-49e4-a1bc-b15881f10852 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:02.316930 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-29d9ac9f-97b6-49e4-a1bc-b15881f10852 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:02.323736 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-29d9ac9f-97b6-49e4-a1bc-b15881f10852 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:02.324194 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-29d9ac9f-97b6-49e4-a1bc-b15881f10852 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:02.324977 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-29d9ac9f-97b6-49e4-a1bc-b15881f10852 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:02.325421 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-29d9ac9f-97b6-49e4-a1bc-b15881f10852 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:02.465349 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-29d9ac9f-97b6-49e4-a1bc-b15881f10852 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:56:02.474094 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-29d9ac9f-97b6-49e4-a1bc-b15881f10852 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42" status: 200 len: 1362 microversion: 2.1 time: 0.161027 Mar 08 14:56:02.474375 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 328/642] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:56:02 2022] GET /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:56:03.250541 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-9bdbc484-3870-4ecc-b7f9-6dfcabb9ffd6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:03.251452 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-9bdbc484-3870-4ecc-b7f9-6dfcabb9ffd6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:03.257764 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9bdbc484-3870-4ecc-b7f9-6dfcabb9ffd6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:03.258253 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9bdbc484-3870-4ecc-b7f9-6dfcabb9ffd6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:03.259061 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9bdbc484-3870-4ecc-b7f9-6dfcabb9ffd6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:03.259549 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9bdbc484-3870-4ecc-b7f9-6dfcabb9ffd6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:03.288221 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-9bdbc484-3870-4ecc-b7f9-6dfcabb9ffd6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041578 Mar 08 14:56:03.288782 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 315/643] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:03 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:56:03.490122 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-15b8e814-38a1-4142-a25a-0bfbcd78f337 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:03.490742 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-15b8e814-38a1-4142-a25a-0bfbcd78f337 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:03.497727 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-15b8e814-38a1-4142-a25a-0bfbcd78f337 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:03.498288 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-15b8e814-38a1-4142-a25a-0bfbcd78f337 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:03.499071 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-15b8e814-38a1-4142-a25a-0bfbcd78f337 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:03.499516 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-15b8e814-38a1-4142-a25a-0bfbcd78f337 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:03.640480 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-15b8e814-38a1-4142-a25a-0bfbcd78f337 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:56:03.647759 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-15b8e814-38a1-4142-a25a-0bfbcd78f337 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42" status: 200 len: 1362 microversion: 2.1 time: 0.161498 Mar 08 14:56:03.648316 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 329/644] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:56:03 2022] GET /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:56:03.651530 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-7e7ff276-2cb4-418d-a76c-984d82b10d35 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:03.652138 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-7e7ff276-2cb4-418d-a76c-984d82b10d35 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:03.658044 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7e7ff276-2cb4-418d-a76c-984d82b10d35 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:03.658504 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7e7ff276-2cb4-418d-a76c-984d82b10d35 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:03.659269 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7e7ff276-2cb4-418d-a76c-984d82b10d35 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:03.659703 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7e7ff276-2cb4-418d-a76c-984d82b10d35 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:03.850256 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-7e7ff276-2cb4-418d-a76c-984d82b10d35 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:56:03.858638 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-7e7ff276-2cb4-418d-a76c-984d82b10d35 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1595 microversion: 2.1 time: 0.212065 Mar 08 14:56:03.859197 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 316/645] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:56:03 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1595 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:56:04.300670 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-dc71fe5b-32e7-4e2e-b479-4f96cd795249 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:04.301588 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-dc71fe5b-32e7-4e2e-b479-4f96cd795249 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:04.308324 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dc71fe5b-32e7-4e2e-b479-4f96cd795249 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:04.308794 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dc71fe5b-32e7-4e2e-b479-4f96cd795249 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:04.310195 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dc71fe5b-32e7-4e2e-b479-4f96cd795249 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:04.310640 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dc71fe5b-32e7-4e2e-b479-4f96cd795249 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:04.339460 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-dc71fe5b-32e7-4e2e-b479-4f96cd795249 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042875 Mar 08 14:56:04.340032 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 330/646] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:04 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:56:04.664365 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-62086b7f-1b3a-492a-94ab-06558cfc2fa8 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:04.665485 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-62086b7f-1b3a-492a-94ab-06558cfc2fa8 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:04.672252 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-62086b7f-1b3a-492a-94ab-06558cfc2fa8 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:04.672703 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-62086b7f-1b3a-492a-94ab-06558cfc2fa8 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:04.673473 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-62086b7f-1b3a-492a-94ab-06558cfc2fa8 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:04.673935 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-62086b7f-1b3a-492a-94ab-06558cfc2fa8 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:04.905349 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-62086b7f-1b3a-492a-94ab-06558cfc2fa8 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:56:04.912453 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-62086b7f-1b3a-492a-94ab-06558cfc2fa8 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42" status: 200 len: 1362 microversion: 2.1 time: 0.251906 Mar 08 14:56:04.913016 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 317/647] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:56:04 2022] GET /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 => generated 1362 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:56:05.351744 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-0c4f19b6-458b-479f-9be1-0882997b4b2b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:05.352760 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-0c4f19b6-458b-479f-9be1-0882997b4b2b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:05.358811 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0c4f19b6-458b-479f-9be1-0882997b4b2b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:05.359258 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0c4f19b6-458b-479f-9be1-0882997b4b2b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:05.360020 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0c4f19b6-458b-479f-9be1-0882997b4b2b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:05.360453 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0c4f19b6-458b-479f-9be1-0882997b4b2b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:05.389050 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-0c4f19b6-458b-479f-9be1-0882997b4b2b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041709 Mar 08 14:56:05.389643 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 331/648] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:05 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:56:05.632344 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [req-cf1d33ae-5d35-4576-93e4-0f4f5c3eae45 req-04669fc9-9d79-43d2-b4a3-340e9c2f05c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42", "name": "network-vif-plugged", "status": "completed", "tag": "47990633-f90b-4bac-989c-4141bf8ff314"}]} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:56:05.641986 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-cf1d33ae-5d35-4576-93e4-0f4f5c3eae45 req-04669fc9-9d79-43d2-b4a3-340e9c2f05c0 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:05.642470 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-cf1d33ae-5d35-4576-93e4-0f4f5c3eae45 req-04669fc9-9d79-43d2-b4a3-340e9c2f05c0 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:05.654010 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.compute.server_external_events [req-cf1d33ae-5d35-4576-93e4-0f4f5c3eae45 req-04669fc9-9d79-43d2-b4a3-340e9c2f05c0 service nova] Creating event network-vif-plugged:47990633-f90b-4bac-989c-4141bf8ff314 for instance 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 on hv-cinder-83009 Mar 08 14:56:05.659941 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [req-cf1d33ae-5d35-4576-93e4-0f4f5c3eae45 req-04669fc9-9d79-43d2-b4a3-340e9c2f05c0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032786 Mar 08 14:56:05.661359 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 318/649] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 14:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:56:05.685408 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [req-1a8df9ba-bebc-47cc-a62d-7de7f1570d9c req-f319f351-e4f5-4bef-a66e-b6ef5158f0ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "251780d0-025f-4a29-b292-9a73dce671e6", "tag": "b4376b4c-6cf3-4dbf-b874-e5bde382acad"}]} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:56:05.695299 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-1a8df9ba-bebc-47cc-a62d-7de7f1570d9c req-f319f351-e4f5-4bef-a66e-b6ef5158f0ee service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:05.695743 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-1a8df9ba-bebc-47cc-a62d-7de7f1570d9c req-f319f351-e4f5-4bef-a66e-b6ef5158f0ee service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:05.709390 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.compute.server_external_events [req-1a8df9ba-bebc-47cc-a62d-7de7f1570d9c req-f319f351-e4f5-4bef-a66e-b6ef5158f0ee service nova] Creating event network-changed:b4376b4c-6cf3-4dbf-b874-e5bde382acad for instance 251780d0-025f-4a29-b292-9a73dce671e6 on hv-cinder-83009 Mar 08 14:56:05.717259 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [req-1a8df9ba-bebc-47cc-a62d-7de7f1570d9c req-f319f351-e4f5-4bef-a66e-b6ef5158f0ee service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035977 Mar 08 14:56:05.717956 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 332/650] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 14:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:56:05.932020 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-8c7bec94-611d-4bda-a01c-e1f8a6612e3f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:05.932512 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-8c7bec94-611d-4bda-a01c-e1f8a6612e3f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:05.945212 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8c7bec94-611d-4bda-a01c-e1f8a6612e3f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:05.946515 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8c7bec94-611d-4bda-a01c-e1f8a6612e3f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:05.947704 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8c7bec94-611d-4bda-a01c-e1f8a6612e3f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:05.948357 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8c7bec94-611d-4bda-a01c-e1f8a6612e3f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:06.187134 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-8c7bec94-611d-4bda-a01c-e1f8a6612e3f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:56:06.195168 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-8c7bec94-611d-4bda-a01c-e1f8a6612e3f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42" status: 200 len: 1362 microversion: 2.1 time: 0.268553 Mar 08 14:56:06.195751 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 319/651] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:56:05 2022] GET /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 => generated 1362 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:56:06.403646 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d4f62790-cbca-4ab6-bb56-98145f38d622 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:06.404691 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d4f62790-cbca-4ab6-bb56-98145f38d622 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:06.417767 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d4f62790-cbca-4ab6-bb56-98145f38d622 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:06.418818 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d4f62790-cbca-4ab6-bb56-98145f38d622 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:06.421373 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d4f62790-cbca-4ab6-bb56-98145f38d622 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:06.422175 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d4f62790-cbca-4ab6-bb56-98145f38d622 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:06.473373 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d4f62790-cbca-4ab6-bb56-98145f38d622 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.076214 Mar 08 14:56:06.474251 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 333/652] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:06 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:56:07.136745 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-9f8e2003-5381-4eee-8d81-038e1ba74f73 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-679625147"}} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:56:07.137311 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-9f8e2003-5381-4eee-8d81-038e1ba74f73 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:07.143689 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9f8e2003-5381-4eee-8d81-038e1ba74f73 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:07.144144 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9f8e2003-5381-4eee-8d81-038e1ba74f73 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:07.144922 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9f8e2003-5381-4eee-8d81-038e1ba74f73 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:07.145360 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9f8e2003-5381-4eee-8d81-038e1ba74f73 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:07.212831 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b0bef402-19a1-4b8c-9752-ee63cbc20dda tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:07.213826 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b0bef402-19a1-4b8c-9752-ee63cbc20dda tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:07.220784 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b0bef402-19a1-4b8c-9752-ee63cbc20dda tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:07.221236 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b0bef402-19a1-4b8c-9752-ee63cbc20dda tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:07.222074 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b0bef402-19a1-4b8c-9752-ee63cbc20dda tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:07.222512 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b0bef402-19a1-4b8c-9752-ee63cbc20dda tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:07.305120 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.network.security_group_api [None req-9f8e2003-5381-4eee-8d81-038e1ba74f73 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Adding security group 0e39a5a5-3d7a-4185-becb-99f08a452dba to port b4376b4c-6cf3-4dbf-b874-e5bde382acad Mar 08 14:56:07.380349 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b0bef402-19a1-4b8c-9752-ee63cbc20dda tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:56:07.394953 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b0bef402-19a1-4b8c-9752-ee63cbc20dda tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42" status: 200 len: 1362 microversion: 2.1 time: 0.186429 Mar 08 14:56:07.395540 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 334/653] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:56:07 2022] GET /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:56:07.486076 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3930c3da-e756-4bef-b54e-b6d5183dae8a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:07.487160 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-3930c3da-e756-4bef-b54e-b6d5183dae8a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:07.497643 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3930c3da-e756-4bef-b54e-b6d5183dae8a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:07.498380 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3930c3da-e756-4bef-b54e-b6d5183dae8a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:07.499542 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3930c3da-e756-4bef-b54e-b6d5183dae8a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:07.500137 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3930c3da-e756-4bef-b54e-b6d5183dae8a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:07.531421 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-3930c3da-e756-4bef-b54e-b6d5183dae8a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050448 Mar 08 14:56:07.532006 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 335/654] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:07 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:56:07.923859 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-9f8e2003-5381-4eee-8d81-038e1ba74f73 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "POST /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/action" status: 202 len: 0 microversion: 2.1 time: 0.791812 Mar 08 14:56:07.924502 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 320/655] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Mar 8 14:56:07 2022] POST /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/action => generated 0 bytes in 793 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 14:56:07.939285 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b0b79a7a-89e5-4f21-a5b0-f544717361b4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:07.940267 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b0b79a7a-89e5-4f21-a5b0-f544717361b4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:07.949084 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b0b79a7a-89e5-4f21-a5b0-f544717361b4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:07.949823 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b0b79a7a-89e5-4f21-a5b0-f544717361b4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:07.951056 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b0b79a7a-89e5-4f21-a5b0-f544717361b4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:07.951714 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b0b79a7a-89e5-4f21-a5b0-f544717361b4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:07.957368 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [req-d450873b-06bd-4528-8647-da9b3b8c89cd req-5e5096c9-0f50-4de7-a690-f3d0b3ace6b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "251780d0-025f-4a29-b292-9a73dce671e6", "tag": "b4376b4c-6cf3-4dbf-b874-e5bde382acad"}]} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:56:07.975824 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-d450873b-06bd-4528-8647-da9b3b8c89cd req-5e5096c9-0f50-4de7-a690-f3d0b3ace6b3 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:07.977157 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-d450873b-06bd-4528-8647-da9b3b8c89cd req-5e5096c9-0f50-4de7-a690-f3d0b3ace6b3 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:07.992268 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.compute.server_external_events [req-d450873b-06bd-4528-8647-da9b3b8c89cd req-5e5096c9-0f50-4de7-a690-f3d0b3ace6b3 service nova] Creating event network-changed:b4376b4c-6cf3-4dbf-b874-e5bde382acad for instance 251780d0-025f-4a29-b292-9a73dce671e6 on hv-cinder-83009 Mar 08 14:56:07.998824 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [req-d450873b-06bd-4528-8647-da9b3b8c89cd req-5e5096c9-0f50-4de7-a690-f3d0b3ace6b3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044888 Mar 08 14:56:08.000155 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 321/656] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 14:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:56:08.236426 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b0b79a7a-89e5-4f21-a5b0-f544717361b4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:56:08.244940 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b0b79a7a-89e5-4f21-a5b0-f544717361b4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1760 microversion: 2.1 time: 0.313778 Mar 08 14:56:08.245656 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 336/657] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:56:07 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1760 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:56:08.414129 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-91e5515c-87b7-453d-a95b-db103cd2a6ba tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:08.414971 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-91e5515c-87b7-453d-a95b-db103cd2a6ba tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:08.422087 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-91e5515c-87b7-453d-a95b-db103cd2a6ba tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:08.422731 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-91e5515c-87b7-453d-a95b-db103cd2a6ba tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:08.423681 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-91e5515c-87b7-453d-a95b-db103cd2a6ba tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:08.424117 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-91e5515c-87b7-453d-a95b-db103cd2a6ba tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:08.544943 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-dc9a8561-41fa-4032-a76d-41df33d66ce6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:08.546833 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-dc9a8561-41fa-4032-a76d-41df33d66ce6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:08.558879 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dc9a8561-41fa-4032-a76d-41df33d66ce6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:08.559579 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dc9a8561-41fa-4032-a76d-41df33d66ce6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:08.561223 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dc9a8561-41fa-4032-a76d-41df33d66ce6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:08.562001 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dc9a8561-41fa-4032-a76d-41df33d66ce6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:08.607448 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-dc9a8561-41fa-4032-a76d-41df33d66ce6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.067410 Mar 08 14:56:08.608530 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 337/658] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:08 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:56:08.610068 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-91e5515c-87b7-453d-a95b-db103cd2a6ba tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ed61d0a16d465889c0474a4d2b7dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f98f6f0a9d945e88b01a9da19044aa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:56:08.619822 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-91e5515c-87b7-453d-a95b-db103cd2a6ba tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42" status: 200 len: 1548 microversion: 2.1 time: 0.210941 Mar 08 14:56:08.620408 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 322/659] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:56:08 2022] GET /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 => generated 1548 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:56:08.637023 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-9dc7c1c2-181e-421e-9791-2c8bec88566e tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:08.637513 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-9dc7c1c2-181e-421e-9791-2c8bec88566e tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:08.643924 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9dc7c1c2-181e-421e-9791-2c8bec88566e tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:08.644381 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9dc7c1c2-181e-421e-9791-2c8bec88566e tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:08.645177 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9dc7c1c2-181e-421e-9791-2c8bec88566e tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:08.645616 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9dc7c1c2-181e-421e-9791-2c8bec88566e tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:08.730605 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-9dc7c1c2-181e-421e-9791-2c8bec88566e tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098591 Mar 08 14:56:08.731204 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 338/660] 10.222.0.30 () {58 vars in 1274 bytes} [Tue Mar 8 14:56:08 2022] GET /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:56:09.501709 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-1bdf6b40-7ab5-4540-8798-adb6de137536 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:56:09.502708 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-1bdf6b40-7ab5-4540-8798-adb6de137536 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:09.511252 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1bdf6b40-7ab5-4540-8798-adb6de137536 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:09.511741 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1bdf6b40-7ab5-4540-8798-adb6de137536 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:09.512582 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1bdf6b40-7ab5-4540-8798-adb6de137536 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:09.513064 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1bdf6b40-7ab5-4540-8798-adb6de137536 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:09.589515 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-1bdf6b40-7ab5-4540-8798-adb6de137536 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "POST /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/action" status: 202 len: 0 microversion: 2.1 time: 0.091543 Mar 08 14:56:09.590365 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 323/661] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Mar 8 14:56:09 2022] POST /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 14:56:09.599781 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-0d26a456-f71a-4fe0-9539-f7b526a37040 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:09.601064 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-0d26a456-f71a-4fe0-9539-f7b526a37040 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:09.608461 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0d26a456-f71a-4fe0-9539-f7b526a37040 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:09.608970 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0d26a456-f71a-4fe0-9539-f7b526a37040 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:09.610121 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0d26a456-f71a-4fe0-9539-f7b526a37040 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:09.610580 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0d26a456-f71a-4fe0-9539-f7b526a37040 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:09.626073 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-92c4cc41-7a59-48c7-bff3-1505d9613981 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:09.627087 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-92c4cc41-7a59-48c7-bff3-1505d9613981 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:09.634326 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-92c4cc41-7a59-48c7-bff3-1505d9613981 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:09.635415 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-92c4cc41-7a59-48c7-bff3-1505d9613981 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:09.636445 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-92c4cc41-7a59-48c7-bff3-1505d9613981 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:09.637040 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-92c4cc41-7a59-48c7-bff3-1505d9613981 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:09.668811 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-92c4cc41-7a59-48c7-bff3-1505d9613981 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052837 Mar 08 14:56:09.669661 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 324/662] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:09 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:56:09.982331 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-0d26a456-f71a-4fe0-9539-f7b526a37040 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:56:09.990162 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-0d26a456-f71a-4fe0-9539-f7b526a37040 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1752 microversion: 2.1 time: 0.395804 Mar 08 14:56:09.990729 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 339/663] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:56:09 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1752 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:56:10.338659 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [req-f6df51a0-8140-4b71-9ca6-9ed068dd9786 req-fb153a95-d514-4b11-ac74-98ea25ab406a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42", "tag": "47990633-f90b-4bac-989c-4141bf8ff314"}]} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:56:10.346771 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-f6df51a0-8140-4b71-9ca6-9ed068dd9786 req-fb153a95-d514-4b11-ac74-98ea25ab406a service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:10.347221 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-f6df51a0-8140-4b71-9ca6-9ed068dd9786 req-fb153a95-d514-4b11-ac74-98ea25ab406a service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:10.361006 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.compute.server_external_events [req-f6df51a0-8140-4b71-9ca6-9ed068dd9786 req-fb153a95-d514-4b11-ac74-98ea25ab406a service nova] Creating event network-changed:47990633-f90b-4bac-989c-4141bf8ff314 for instance 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 on hv-cinder-83009 Mar 08 14:56:10.366023 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [req-f6df51a0-8140-4b71-9ca6-9ed068dd9786 req-fb153a95-d514-4b11-ac74-98ea25ab406a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032478 Mar 08 14:56:10.367445 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 325/664] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 14:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:56:10.684843 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b257018e-b3d7-4cf5-b8af-12ce0ce355af tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:10.685747 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b257018e-b3d7-4cf5-b8af-12ce0ce355af tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:10.693041 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b257018e-b3d7-4cf5-b8af-12ce0ce355af tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:10.693759 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b257018e-b3d7-4cf5-b8af-12ce0ce355af tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:10.694584 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b257018e-b3d7-4cf5-b8af-12ce0ce355af tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:10.695030 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b257018e-b3d7-4cf5-b8af-12ce0ce355af tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:10.729495 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b257018e-b3d7-4cf5-b8af-12ce0ce355af tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049457 Mar 08 14:56:10.734506 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 340/665] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:10 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:56:11.009503 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-542b0dd1-ddcb-4de7-becb-54de3efe076b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:11.010224 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-542b0dd1-ddcb-4de7-becb-54de3efe076b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:11.016135 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-542b0dd1-ddcb-4de7-becb-54de3efe076b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:11.016582 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-542b0dd1-ddcb-4de7-becb-54de3efe076b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:11.017343 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-542b0dd1-ddcb-4de7-becb-54de3efe076b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:11.017775 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-542b0dd1-ddcb-4de7-becb-54de3efe076b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:11.183328 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-542b0dd1-ddcb-4de7-becb-54de3efe076b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:56:11.191229 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-542b0dd1-ddcb-4de7-becb-54de3efe076b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1757 microversion: 2.1 time: 0.186432 Mar 08 14:56:11.191792 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 326/666] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:56:11 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1757 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:56:11.740433 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-9ec0434c-2862-458a-8b6f-a9342d940a79 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:11.741344 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-9ec0434c-2862-458a-8b6f-a9342d940a79 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:11.748091 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9ec0434c-2862-458a-8b6f-a9342d940a79 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:11.748547 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9ec0434c-2862-458a-8b6f-a9342d940a79 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:11.749324 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9ec0434c-2862-458a-8b6f-a9342d940a79 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:11.749765 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9ec0434c-2862-458a-8b6f-a9342d940a79 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:11.778395 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-9ec0434c-2862-458a-8b6f-a9342d940a79 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041832 Mar 08 14:56:11.778935 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 341/667] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:11 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:56:12.208414 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-c33e1b1b-f51d-4e40-ac67-b08d82c909b5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:12.209012 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-c33e1b1b-f51d-4e40-ac67-b08d82c909b5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:12.215647 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c33e1b1b-f51d-4e40-ac67-b08d82c909b5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:12.216097 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c33e1b1b-f51d-4e40-ac67-b08d82c909b5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:12.216902 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c33e1b1b-f51d-4e40-ac67-b08d82c909b5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:12.217336 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c33e1b1b-f51d-4e40-ac67-b08d82c909b5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:12.369099 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-c33e1b1b-f51d-4e40-ac67-b08d82c909b5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:56:12.376856 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-c33e1b1b-f51d-4e40-ac67-b08d82c909b5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1757 microversion: 2.1 time: 0.172266 Mar 08 14:56:12.377419 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 327/668] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:56:12 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:56:12.789929 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5ef03f1d-37af-41a6-a8c1-a7f9b09e7513 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:12.790855 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5ef03f1d-37af-41a6-a8c1-a7f9b09e7513 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:12.797032 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5ef03f1d-37af-41a6-a8c1-a7f9b09e7513 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:12.797501 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5ef03f1d-37af-41a6-a8c1-a7f9b09e7513 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:12.798298 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5ef03f1d-37af-41a6-a8c1-a7f9b09e7513 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:12.798742 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5ef03f1d-37af-41a6-a8c1-a7f9b09e7513 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:12.826599 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5ef03f1d-37af-41a6-a8c1-a7f9b09e7513 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040714 Mar 08 14:56:12.827145 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 342/669] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:12 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:56:13.394334 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-d7de4dd5-dc2a-4829-ad51-f635d19f8af9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:13.394949 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-d7de4dd5-dc2a-4829-ad51-f635d19f8af9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:13.401950 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d7de4dd5-dc2a-4829-ad51-f635d19f8af9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:13.402406 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d7de4dd5-dc2a-4829-ad51-f635d19f8af9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:13.403172 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d7de4dd5-dc2a-4829-ad51-f635d19f8af9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:13.403612 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d7de4dd5-dc2a-4829-ad51-f635d19f8af9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:13.556046 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-d7de4dd5-dc2a-4829-ad51-f635d19f8af9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:56:13.564402 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-d7de4dd5-dc2a-4829-ad51-f635d19f8af9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1757 microversion: 2.1 time: 0.174031 Mar 08 14:56:13.565176 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 328/670] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:56:13 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:56:13.838156 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-dea2d389-afe2-46e0-8509-80b0c48110d6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:13.838992 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-dea2d389-afe2-46e0-8509-80b0c48110d6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:13.845082 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dea2d389-afe2-46e0-8509-80b0c48110d6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:13.845528 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dea2d389-afe2-46e0-8509-80b0c48110d6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:13.846319 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dea2d389-afe2-46e0-8509-80b0c48110d6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:13.846756 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dea2d389-afe2-46e0-8509-80b0c48110d6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:13.874776 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-dea2d389-afe2-46e0-8509-80b0c48110d6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041327 Mar 08 14:56:13.875316 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 343/671] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:13 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:56:14.581918 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-26c7949f-724d-4ab3-ab97-daed06c7b159 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:14.582436 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-26c7949f-724d-4ab3-ab97-daed06c7b159 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:14.588815 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-26c7949f-724d-4ab3-ab97-daed06c7b159 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:14.589262 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-26c7949f-724d-4ab3-ab97-daed06c7b159 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:14.590061 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-26c7949f-724d-4ab3-ab97-daed06c7b159 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:14.590484 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-26c7949f-724d-4ab3-ab97-daed06c7b159 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:14.732128 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-26c7949f-724d-4ab3-ab97-daed06c7b159 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:56:14.739772 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-26c7949f-724d-4ab3-ab97-daed06c7b159 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1757 microversion: 2.1 time: 0.161805 Mar 08 14:56:14.740338 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 329/672] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:56:14 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:56:14.886876 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-9ce50b63-cc62-473f-8c54-7125a3ad66a3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:14.887747 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-9ce50b63-cc62-473f-8c54-7125a3ad66a3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:14.893884 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9ce50b63-cc62-473f-8c54-7125a3ad66a3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:14.894342 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9ce50b63-cc62-473f-8c54-7125a3ad66a3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:14.895108 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9ce50b63-cc62-473f-8c54-7125a3ad66a3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:14.895546 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9ce50b63-cc62-473f-8c54-7125a3ad66a3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:14.923174 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-9ce50b63-cc62-473f-8c54-7125a3ad66a3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040921 Mar 08 14:56:14.923711 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 344/673] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:14 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:56:15.757149 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-2637a53f-ed0d-4cbc-acde-2fa1ecda3a92 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:15.757764 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-2637a53f-ed0d-4cbc-acde-2fa1ecda3a92 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:15.764570 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2637a53f-ed0d-4cbc-acde-2fa1ecda3a92 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:15.765029 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2637a53f-ed0d-4cbc-acde-2fa1ecda3a92 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:15.765796 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2637a53f-ed0d-4cbc-acde-2fa1ecda3a92 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:15.766266 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2637a53f-ed0d-4cbc-acde-2fa1ecda3a92 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:15.917175 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-2637a53f-ed0d-4cbc-acde-2fa1ecda3a92 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:56:15.924910 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-2637a53f-ed0d-4cbc-acde-2fa1ecda3a92 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1757 microversion: 2.1 time: 0.171625 Mar 08 14:56:15.925472 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 330/674] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:56:15 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:56:15.934201 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-7da0e758-3c2e-47e9-8c30-7587e05bf12a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:15.936111 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-7da0e758-3c2e-47e9-8c30-7587e05bf12a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:15.942107 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7da0e758-3c2e-47e9-8c30-7587e05bf12a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:15.942561 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7da0e758-3c2e-47e9-8c30-7587e05bf12a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:15.943338 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7da0e758-3c2e-47e9-8c30-7587e05bf12a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:15.943776 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7da0e758-3c2e-47e9-8c30-7587e05bf12a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:15.974208 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-7da0e758-3c2e-47e9-8c30-7587e05bf12a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044141 Mar 08 14:56:15.974759 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 345/675] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:15 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:56:16.942247 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-d36f9a78-3e97-4fb2-9a6d-b3f8e73c711e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:16.942863 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-d36f9a78-3e97-4fb2-9a6d-b3f8e73c711e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:16.949782 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d36f9a78-3e97-4fb2-9a6d-b3f8e73c711e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:16.950264 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d36f9a78-3e97-4fb2-9a6d-b3f8e73c711e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:16.951044 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d36f9a78-3e97-4fb2-9a6d-b3f8e73c711e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:16.951489 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d36f9a78-3e97-4fb2-9a6d-b3f8e73c711e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:16.986170 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d6184427-783c-483f-beb9-4bb89dcdfa3e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:16.987197 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d6184427-783c-483f-beb9-4bb89dcdfa3e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:16.994069 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d6184427-783c-483f-beb9-4bb89dcdfa3e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:16.994604 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d6184427-783c-483f-beb9-4bb89dcdfa3e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:16.995453 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d6184427-783c-483f-beb9-4bb89dcdfa3e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:16.995964 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d6184427-783c-483f-beb9-4bb89dcdfa3e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:17.024671 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d6184427-783c-483f-beb9-4bb89dcdfa3e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042241 Mar 08 14:56:17.025341 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 346/676] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:16 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:56:17.097122 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-d36f9a78-3e97-4fb2-9a6d-b3f8e73c711e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:56:17.105133 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-d36f9a78-3e97-4fb2-9a6d-b3f8e73c711e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1757 microversion: 2.1 time: 0.166919 Mar 08 14:56:17.105696 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 331/677] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:56:16 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:56:18.036444 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-946e5da9-48f7-4371-8a78-841c9672ae92 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:18.037276 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-946e5da9-48f7-4371-8a78-841c9672ae92 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:18.044210 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-946e5da9-48f7-4371-8a78-841c9672ae92 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:18.044662 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-946e5da9-48f7-4371-8a78-841c9672ae92 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:18.045430 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-946e5da9-48f7-4371-8a78-841c9672ae92 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:18.045891 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-946e5da9-48f7-4371-8a78-841c9672ae92 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:18.074367 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-946e5da9-48f7-4371-8a78-841c9672ae92 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041817 Mar 08 14:56:18.074923 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 347/678] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:18 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:56:18.122815 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-99856392-a61e-4ab9-99e0-ff1a1a1351d5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:18.123455 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-99856392-a61e-4ab9-99e0-ff1a1a1351d5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:18.129636 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-99856392-a61e-4ab9-99e0-ff1a1a1351d5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:18.130127 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-99856392-a61e-4ab9-99e0-ff1a1a1351d5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:18.130899 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-99856392-a61e-4ab9-99e0-ff1a1a1351d5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:18.131343 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-99856392-a61e-4ab9-99e0-ff1a1a1351d5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:18.275283 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-99856392-a61e-4ab9-99e0-ff1a1a1351d5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:56:18.282918 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-99856392-a61e-4ab9-99e0-ff1a1a1351d5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1757 microversion: 2.1 time: 0.164853 Mar 08 14:56:18.283512 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 332/679] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:56:18 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:56:19.087157 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-43cfc1a9-0210-45d8-8641-39e2c0e09d22 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:19.088140 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-43cfc1a9-0210-45d8-8641-39e2c0e09d22 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:19.094574 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-43cfc1a9-0210-45d8-8641-39e2c0e09d22 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:19.095041 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-43cfc1a9-0210-45d8-8641-39e2c0e09d22 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:19.095875 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-43cfc1a9-0210-45d8-8641-39e2c0e09d22 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:19.096317 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-43cfc1a9-0210-45d8-8641-39e2c0e09d22 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:19.125072 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-43cfc1a9-0210-45d8-8641-39e2c0e09d22 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043297 Mar 08 14:56:19.125617 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 348/680] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:19 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:56:19.300099 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-a96a4644-9808-486b-b729-171f74e73ef8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:19.300704 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-a96a4644-9808-486b-b729-171f74e73ef8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:19.307242 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a96a4644-9808-486b-b729-171f74e73ef8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:19.307940 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a96a4644-9808-486b-b729-171f74e73ef8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:19.308698 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a96a4644-9808-486b-b729-171f74e73ef8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:19.309133 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a96a4644-9808-486b-b729-171f74e73ef8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:19.457669 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-a96a4644-9808-486b-b729-171f74e73ef8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:56:19.466387 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-a96a4644-9808-486b-b729-171f74e73ef8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1757 microversion: 2.1 time: 0.170096 Mar 08 14:56:19.466950 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 333/681] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:56:19 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:56:20.137834 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-6ff763f8-e81d-4310-a5e8-e79ef6666b84 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:20.138765 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-6ff763f8-e81d-4310-a5e8-e79ef6666b84 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:20.144888 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6ff763f8-e81d-4310-a5e8-e79ef6666b84 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:20.145332 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6ff763f8-e81d-4310-a5e8-e79ef6666b84 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:20.146127 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6ff763f8-e81d-4310-a5e8-e79ef6666b84 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:20.146559 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6ff763f8-e81d-4310-a5e8-e79ef6666b84 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:20.174674 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-6ff763f8-e81d-4310-a5e8-e79ef6666b84 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041926 Mar 08 14:56:20.175159 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 349/682] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:20 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:56:20.483832 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-5f572304-b316-4278-9176-97fc1390a0e5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:20.484478 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-5f572304-b316-4278-9176-97fc1390a0e5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:20.490788 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5f572304-b316-4278-9176-97fc1390a0e5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:20.491240 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5f572304-b316-4278-9176-97fc1390a0e5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:20.492006 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5f572304-b316-4278-9176-97fc1390a0e5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:20.492441 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5f572304-b316-4278-9176-97fc1390a0e5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:20.635752 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-5f572304-b316-4278-9176-97fc1390a0e5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:56:20.643498 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-5f572304-b316-4278-9176-97fc1390a0e5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1757 microversion: 2.1 time: 0.163626 Mar 08 14:56:20.644057 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 334/683] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:56:20 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:56:20.912072 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 14:56:20.912279 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: Tue Mar 8 14:56:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 14:56:21.283578 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-7782218c-492b-43d7-ac36-dae4286ef030 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:21.284557 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-7782218c-492b-43d7-ac36-dae4286ef030 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:21.292040 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7782218c-492b-43d7-ac36-dae4286ef030 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:21.292491 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7782218c-492b-43d7-ac36-dae4286ef030 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:21.293282 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7782218c-492b-43d7-ac36-dae4286ef030 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:21.293718 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7782218c-492b-43d7-ac36-dae4286ef030 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:21.320349 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-7782218c-492b-43d7-ac36-dae4286ef030 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.137261 Mar 08 14:56:21.320932 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 350/684] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:21 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:56:21.660357 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b083697a-a729-4ccb-b990-b6135c4f570b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:21.660964 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-b083697a-a729-4ccb-b990-b6135c4f570b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:21.667368 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b083697a-a729-4ccb-b990-b6135c4f570b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:21.667818 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b083697a-a729-4ccb-b990-b6135c4f570b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:21.668587 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b083697a-a729-4ccb-b990-b6135c4f570b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:21.669018 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b083697a-a729-4ccb-b990-b6135c4f570b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:21.817602 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-b083697a-a729-4ccb-b990-b6135c4f570b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:56:21.826224 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-b083697a-a729-4ccb-b990-b6135c4f570b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1757 microversion: 2.1 time: 0.169669 Mar 08 14:56:21.826787 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 335/685] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:56:21 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:56:22.332593 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-13fefb1b-2643-43de-a377-66e22884b734 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:22.333536 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-13fefb1b-2643-43de-a377-66e22884b734 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:22.339969 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-13fefb1b-2643-43de-a377-66e22884b734 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:22.340424 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-13fefb1b-2643-43de-a377-66e22884b734 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:22.341209 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-13fefb1b-2643-43de-a377-66e22884b734 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:22.341649 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-13fefb1b-2643-43de-a377-66e22884b734 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:22.369262 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-13fefb1b-2643-43de-a377-66e22884b734 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040622 Mar 08 14:56:22.369795 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 351/686] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:22 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:56:22.843767 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-85bdd2cc-65b8-4fde-acdc-66466f892573 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:22.844349 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-85bdd2cc-65b8-4fde-acdc-66466f892573 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:22.850948 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-85bdd2cc-65b8-4fde-acdc-66466f892573 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:22.851393 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-85bdd2cc-65b8-4fde-acdc-66466f892573 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:22.852742 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-85bdd2cc-65b8-4fde-acdc-66466f892573 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:22.853422 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-85bdd2cc-65b8-4fde-acdc-66466f892573 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:22.998006 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-85bdd2cc-65b8-4fde-acdc-66466f892573 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:56:23.005747 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-85bdd2cc-65b8-4fde-acdc-66466f892573 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1757 microversion: 2.1 time: 0.166051 Mar 08 14:56:23.006346 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 336/687] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:56:22 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:56:23.380903 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ca77571b-126c-4ecd-86e4-0bb863350083 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:23.381882 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ca77571b-126c-4ecd-86e4-0bb863350083 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:23.388976 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ca77571b-126c-4ecd-86e4-0bb863350083 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:23.389424 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ca77571b-126c-4ecd-86e4-0bb863350083 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:23.390215 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ca77571b-126c-4ecd-86e4-0bb863350083 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:23.390647 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ca77571b-126c-4ecd-86e4-0bb863350083 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:23.418682 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ca77571b-126c-4ecd-86e4-0bb863350083 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041739 Mar 08 14:56:23.419228 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 352/688] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:23 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:56:24.023559 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-5e574413-7a1e-4f98-a383-0e8e18486741 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:24.024339 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-5e574413-7a1e-4f98-a383-0e8e18486741 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:24.030456 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5e574413-7a1e-4f98-a383-0e8e18486741 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:24.030902 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5e574413-7a1e-4f98-a383-0e8e18486741 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:24.031683 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5e574413-7a1e-4f98-a383-0e8e18486741 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:24.032114 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5e574413-7a1e-4f98-a383-0e8e18486741 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:24.184735 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-5e574413-7a1e-4f98-a383-0e8e18486741 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:56:24.192373 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-5e574413-7a1e-4f98-a383-0e8e18486741 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1757 microversion: 2.1 time: 0.172627 Mar 08 14:56:24.192929 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 337/689] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:56:24 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:56:24.429909 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-44d87dde-ef35-4d99-ae54-d3f81aee7a05 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:24.431268 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-44d87dde-ef35-4d99-ae54-d3f81aee7a05 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:24.438032 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-44d87dde-ef35-4d99-ae54-d3f81aee7a05 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:24.438427 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-44d87dde-ef35-4d99-ae54-d3f81aee7a05 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:24.439238 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-44d87dde-ef35-4d99-ae54-d3f81aee7a05 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:24.439678 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-44d87dde-ef35-4d99-ae54-d3f81aee7a05 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:24.468136 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-44d87dde-ef35-4d99-ae54-d3f81aee7a05 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042280 Mar 08 14:56:24.468683 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 353/690] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:24 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:56:25.209773 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-be6ca73c-4402-41fb-aa1b-791f5daaa56a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:25.210336 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-be6ca73c-4402-41fb-aa1b-791f5daaa56a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:25.216633 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-be6ca73c-4402-41fb-aa1b-791f5daaa56a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:25.217082 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-be6ca73c-4402-41fb-aa1b-791f5daaa56a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:25.217847 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-be6ca73c-4402-41fb-aa1b-791f5daaa56a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:25.218301 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-be6ca73c-4402-41fb-aa1b-791f5daaa56a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:25.360436 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-be6ca73c-4402-41fb-aa1b-791f5daaa56a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:56:25.368692 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-be6ca73c-4402-41fb-aa1b-791f5daaa56a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1757 microversion: 2.1 time: 0.162730 Mar 08 14:56:25.369248 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 338/691] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:56:25 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:56:25.480387 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3057e2ab-e534-450b-8e71-a93ebb3550a9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:25.481325 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-3057e2ab-e534-450b-8e71-a93ebb3550a9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:25.487867 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3057e2ab-e534-450b-8e71-a93ebb3550a9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:25.488314 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3057e2ab-e534-450b-8e71-a93ebb3550a9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:25.489076 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3057e2ab-e534-450b-8e71-a93ebb3550a9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:25.489508 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3057e2ab-e534-450b-8e71-a93ebb3550a9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:25.517185 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-3057e2ab-e534-450b-8e71-a93ebb3550a9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041416 Mar 08 14:56:25.517722 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 354/692] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:25 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:56:26.386625 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-81ac253b-b5cb-4e6c-90ce-593264d3d803 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:26.387237 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-81ac253b-b5cb-4e6c-90ce-593264d3d803 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:26.393411 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-81ac253b-b5cb-4e6c-90ce-593264d3d803 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:26.393870 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-81ac253b-b5cb-4e6c-90ce-593264d3d803 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:26.394651 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-81ac253b-b5cb-4e6c-90ce-593264d3d803 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:26.395088 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-81ac253b-b5cb-4e6c-90ce-593264d3d803 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:26.529029 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-8defa5cf-5879-400a-a2e6-aaf0929505c0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:26.529972 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-8defa5cf-5879-400a-a2e6-aaf0929505c0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:26.536291 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8defa5cf-5879-400a-a2e6-aaf0929505c0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:26.536747 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8defa5cf-5879-400a-a2e6-aaf0929505c0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:26.537574 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8defa5cf-5879-400a-a2e6-aaf0929505c0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:26.538166 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8defa5cf-5879-400a-a2e6-aaf0929505c0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:26.541636 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-81ac253b-b5cb-4e6c-90ce-593264d3d803 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:56:26.549411 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-81ac253b-b5cb-4e6c-90ce-593264d3d803 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1757 microversion: 2.1 time: 0.167562 Mar 08 14:56:26.550027 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 339/693] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:56:26 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:56:26.567333 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-8defa5cf-5879-400a-a2e6-aaf0929505c0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042299 Mar 08 14:56:26.567878 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 355/694] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:26 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:56:27.567890 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-629afdcb-6da1-47b2-8e54-9fb308e9f404 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:27.568545 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-629afdcb-6da1-47b2-8e54-9fb308e9f404 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:27.575126 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-629afdcb-6da1-47b2-8e54-9fb308e9f404 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:27.575612 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-629afdcb-6da1-47b2-8e54-9fb308e9f404 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:27.576388 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-629afdcb-6da1-47b2-8e54-9fb308e9f404 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:27.576833 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-629afdcb-6da1-47b2-8e54-9fb308e9f404 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:27.579946 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-13c09ab1-74f2-49f7-b9d1-c5ca9374105f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:27.580849 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-13c09ab1-74f2-49f7-b9d1-c5ca9374105f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:27.587469 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-13c09ab1-74f2-49f7-b9d1-c5ca9374105f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:27.587918 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-13c09ab1-74f2-49f7-b9d1-c5ca9374105f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:27.588680 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-13c09ab1-74f2-49f7-b9d1-c5ca9374105f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:27.589111 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-13c09ab1-74f2-49f7-b9d1-c5ca9374105f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:27.617990 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-13c09ab1-74f2-49f7-b9d1-c5ca9374105f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041508 Mar 08 14:56:27.618540 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 356/695] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:27 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:56:27.725141 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-629afdcb-6da1-47b2-8e54-9fb308e9f404 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:56:27.732943 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-629afdcb-6da1-47b2-8e54-9fb308e9f404 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1757 microversion: 2.1 time: 0.168943 Mar 08 14:56:27.733510 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 340/696] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:56:27 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:56:28.628636 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-34991713-0254-461e-af10-9bdb0aa13965 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:28.629538 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-34991713-0254-461e-af10-9bdb0aa13965 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:28.636822 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-34991713-0254-461e-af10-9bdb0aa13965 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:28.637272 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-34991713-0254-461e-af10-9bdb0aa13965 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:28.638091 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-34991713-0254-461e-af10-9bdb0aa13965 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:28.638525 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-34991713-0254-461e-af10-9bdb0aa13965 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:28.666693 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-34991713-0254-461e-af10-9bdb0aa13965 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042017 Mar 08 14:56:28.667231 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 357/697] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:28 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:56:28.750193 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-08d0a67a-d7db-42a3-b12d-8a8ca7cacc37 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:28.750836 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-08d0a67a-d7db-42a3-b12d-8a8ca7cacc37 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:28.757176 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-08d0a67a-d7db-42a3-b12d-8a8ca7cacc37 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:28.757636 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-08d0a67a-d7db-42a3-b12d-8a8ca7cacc37 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:28.759103 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-08d0a67a-d7db-42a3-b12d-8a8ca7cacc37 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:28.759733 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-08d0a67a-d7db-42a3-b12d-8a8ca7cacc37 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:28.904242 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-08d0a67a-d7db-42a3-b12d-8a8ca7cacc37 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:56:28.912045 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-08d0a67a-d7db-42a3-b12d-8a8ca7cacc37 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1757 microversion: 2.1 time: 0.165640 Mar 08 14:56:28.912605 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 341/698] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:56:28 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:56:29.678443 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-e37a56c3-7532-4579-9b7a-fd1fb068ae7f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:29.679264 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-e37a56c3-7532-4579-9b7a-fd1fb068ae7f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:29.686202 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e37a56c3-7532-4579-9b7a-fd1fb068ae7f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:29.686652 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e37a56c3-7532-4579-9b7a-fd1fb068ae7f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:29.687410 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e37a56c3-7532-4579-9b7a-fd1fb068ae7f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:29.687843 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e37a56c3-7532-4579-9b7a-fd1fb068ae7f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:29.715264 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-e37a56c3-7532-4579-9b7a-fd1fb068ae7f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040975 Mar 08 14:56:29.715790 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 358/699] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:29 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:56:29.928014 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-80f5ef1f-8653-4be5-b46d-b2a336118ce7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:29.928668 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-80f5ef1f-8653-4be5-b46d-b2a336118ce7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:29.935383 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-80f5ef1f-8653-4be5-b46d-b2a336118ce7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:29.935862 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-80f5ef1f-8653-4be5-b46d-b2a336118ce7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:29.936621 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-80f5ef1f-8653-4be5-b46d-b2a336118ce7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:29.937053 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-80f5ef1f-8653-4be5-b46d-b2a336118ce7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:30.088558 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-80f5ef1f-8653-4be5-b46d-b2a336118ce7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:56:30.096779 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-80f5ef1f-8653-4be5-b46d-b2a336118ce7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1757 microversion: 2.1 time: 0.172668 Mar 08 14:56:30.097332 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 342/700] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:56:29 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:56:30.726941 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f623bd55-4d6b-43e8-9499-ce77d163be38 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:30.727848 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f623bd55-4d6b-43e8-9499-ce77d163be38 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:30.734599 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f623bd55-4d6b-43e8-9499-ce77d163be38 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:30.735050 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f623bd55-4d6b-43e8-9499-ce77d163be38 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:30.735810 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f623bd55-4d6b-43e8-9499-ce77d163be38 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:30.736245 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f623bd55-4d6b-43e8-9499-ce77d163be38 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:30.763901 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f623bd55-4d6b-43e8-9499-ce77d163be38 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040923 Mar 08 14:56:30.764420 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 359/701] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:30 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:56:31.113434 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-703604ff-328c-4e46-9bbe-07d9133fc150 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:31.113993 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-703604ff-328c-4e46-9bbe-07d9133fc150 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:31.120446 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-703604ff-328c-4e46-9bbe-07d9133fc150 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:31.120899 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-703604ff-328c-4e46-9bbe-07d9133fc150 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:31.121686 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-703604ff-328c-4e46-9bbe-07d9133fc150 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:31.122148 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-703604ff-328c-4e46-9bbe-07d9133fc150 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:31.264397 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-703604ff-328c-4e46-9bbe-07d9133fc150 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:56:31.272214 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-703604ff-328c-4e46-9bbe-07d9133fc150 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1757 microversion: 2.1 time: 0.162692 Mar 08 14:56:31.272812 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 343/702] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:56:31 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:56:31.775556 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-6f371c41-a4e5-464d-a39d-4a899ceac69a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:31.776532 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-6f371c41-a4e5-464d-a39d-4a899ceac69a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:31.782995 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6f371c41-a4e5-464d-a39d-4a899ceac69a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:31.783457 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6f371c41-a4e5-464d-a39d-4a899ceac69a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:31.784231 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6f371c41-a4e5-464d-a39d-4a899ceac69a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:31.784675 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6f371c41-a4e5-464d-a39d-4a899ceac69a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:31.815445 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-6f371c41-a4e5-464d-a39d-4a899ceac69a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043824 Mar 08 14:56:31.816009 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 360/703] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:31 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:56:32.289636 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-f45b0394-208e-4c2e-ae40-f2de06075bb2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:32.290276 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-f45b0394-208e-4c2e-ae40-f2de06075bb2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:32.296962 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f45b0394-208e-4c2e-ae40-f2de06075bb2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:32.297406 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f45b0394-208e-4c2e-ae40-f2de06075bb2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:32.298192 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f45b0394-208e-4c2e-ae40-f2de06075bb2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:32.298626 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f45b0394-208e-4c2e-ae40-f2de06075bb2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:32.443471 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-f45b0394-208e-4c2e-ae40-f2de06075bb2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:56:32.451723 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-f45b0394-208e-4c2e-ae40-f2de06075bb2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1757 microversion: 2.1 time: 0.165870 Mar 08 14:56:32.452293 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 344/704] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:56:32 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:56:32.828108 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-8c3fd89e-13f1-4562-84a9-591e17226064 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:32.829027 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-8c3fd89e-13f1-4562-84a9-591e17226064 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:32.835240 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8c3fd89e-13f1-4562-84a9-591e17226064 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:32.835688 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8c3fd89e-13f1-4562-84a9-591e17226064 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:32.836448 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8c3fd89e-13f1-4562-84a9-591e17226064 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:32.836878 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8c3fd89e-13f1-4562-84a9-591e17226064 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:32.864726 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-8c3fd89e-13f1-4562-84a9-591e17226064 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040679 Mar 08 14:56:32.865264 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 361/705] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:32 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:56:33.469053 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-d700f60d-802e-4196-bf84-849f17688a33 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:33.469655 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-d700f60d-802e-4196-bf84-849f17688a33 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:33.475898 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d700f60d-802e-4196-bf84-849f17688a33 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:33.476347 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d700f60d-802e-4196-bf84-849f17688a33 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:33.477130 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d700f60d-802e-4196-bf84-849f17688a33 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:33.477561 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d700f60d-802e-4196-bf84-849f17688a33 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:33.645762 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-d700f60d-802e-4196-bf84-849f17688a33 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:56:33.656148 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-d700f60d-802e-4196-bf84-849f17688a33 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1757 microversion: 2.1 time: 0.191106 Mar 08 14:56:33.657164 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 345/706] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:56:33 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1757 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:56:33.876928 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c9d28a2c-7e0d-4deb-8392-664fc00b17de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:33.877832 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-c9d28a2c-7e0d-4deb-8392-664fc00b17de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:33.886100 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c9d28a2c-7e0d-4deb-8392-664fc00b17de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:33.886870 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c9d28a2c-7e0d-4deb-8392-664fc00b17de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:33.888018 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c9d28a2c-7e0d-4deb-8392-664fc00b17de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:33.888642 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c9d28a2c-7e0d-4deb-8392-664fc00b17de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:33.920099 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-c9d28a2c-7e0d-4deb-8392-664fc00b17de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047070 Mar 08 14:56:33.920708 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 362/707] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:33 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:56:34.681774 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-233954b2-ce24-423a-836c-95bf163a115f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:34.683747 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-233954b2-ce24-423a-836c-95bf163a115f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:34.690143 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-233954b2-ce24-423a-836c-95bf163a115f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:34.690599 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-233954b2-ce24-423a-836c-95bf163a115f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:34.691359 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-233954b2-ce24-423a-836c-95bf163a115f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:34.691788 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-233954b2-ce24-423a-836c-95bf163a115f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:34.845127 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-233954b2-ce24-423a-836c-95bf163a115f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:56:34.853195 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-233954b2-ce24-423a-836c-95bf163a115f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1757 microversion: 2.1 time: 0.175334 Mar 08 14:56:34.853753 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 346/708] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:56:34 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:56:34.935738 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-aee8f8c4-5b22-4698-87ff-bdef7dbd9c92 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:34.936302 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-aee8f8c4-5b22-4698-87ff-bdef7dbd9c92 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:34.943011 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-aee8f8c4-5b22-4698-87ff-bdef7dbd9c92 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:34.943460 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-aee8f8c4-5b22-4698-87ff-bdef7dbd9c92 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:34.944246 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-aee8f8c4-5b22-4698-87ff-bdef7dbd9c92 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:34.944719 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-aee8f8c4-5b22-4698-87ff-bdef7dbd9c92 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:34.974994 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-aee8f8c4-5b22-4698-87ff-bdef7dbd9c92 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044813 Mar 08 14:56:34.975544 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 363/709] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:34 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:56:35.871126 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-cbf0f4f0-7392-4c70-b72b-4ac4c6512129 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:35.871732 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-cbf0f4f0-7392-4c70-b72b-4ac4c6512129 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:35.878266 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cbf0f4f0-7392-4c70-b72b-4ac4c6512129 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:35.878723 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cbf0f4f0-7392-4c70-b72b-4ac4c6512129 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:35.879943 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cbf0f4f0-7392-4c70-b72b-4ac4c6512129 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:35.880389 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cbf0f4f0-7392-4c70-b72b-4ac4c6512129 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:35.987388 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-7b90559b-b022-463a-8e85-523c06f83d98 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:35.988304 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-7b90559b-b022-463a-8e85-523c06f83d98 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:35.994559 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7b90559b-b022-463a-8e85-523c06f83d98 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:35.996256 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7b90559b-b022-463a-8e85-523c06f83d98 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:35.997056 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7b90559b-b022-463a-8e85-523c06f83d98 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:35.997502 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7b90559b-b022-463a-8e85-523c06f83d98 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:36.026978 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-7b90559b-b022-463a-8e85-523c06f83d98 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043060 Mar 08 14:56:36.027968 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 364/710] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:35 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:56:36.031228 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-cbf0f4f0-7392-4c70-b72b-4ac4c6512129 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:56:36.039035 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-cbf0f4f0-7392-4c70-b72b-4ac4c6512129 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1757 microversion: 2.1 time: 0.172511 Mar 08 14:56:36.039582 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 347/711] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:56:35 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:56:37.039819 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-1b369228-ca0e-4da8-b8fd-4ef26b1b3b64 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:37.040736 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-1b369228-ca0e-4da8-b8fd-4ef26b1b3b64 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:37.047798 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1b369228-ca0e-4da8-b8fd-4ef26b1b3b64 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:37.048251 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1b369228-ca0e-4da8-b8fd-4ef26b1b3b64 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:37.049022 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1b369228-ca0e-4da8-b8fd-4ef26b1b3b64 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:37.049459 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1b369228-ca0e-4da8-b8fd-4ef26b1b3b64 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:37.056675 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-980ba4d6-614c-4c4e-a420-f239b1f4054b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:37.057805 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-980ba4d6-614c-4c4e-a420-f239b1f4054b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:37.064307 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-980ba4d6-614c-4c4e-a420-f239b1f4054b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:37.064752 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-980ba4d6-614c-4c4e-a420-f239b1f4054b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:37.065518 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-980ba4d6-614c-4c4e-a420-f239b1f4054b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:37.066014 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-980ba4d6-614c-4c4e-a420-f239b1f4054b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:37.079499 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-1b369228-ca0e-4da8-b8fd-4ef26b1b3b64 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044249 Mar 08 14:56:37.080068 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 365/712] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:37 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:56:37.224716 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-980ba4d6-614c-4c4e-a420-f239b1f4054b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:56:37.233237 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-980ba4d6-614c-4c4e-a420-f239b1f4054b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1760 microversion: 2.1 time: 0.180550 Mar 08 14:56:37.233843 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 348/713] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:56:37 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1760 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:56:38.091218 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-908d9e94-5dc1-4810-be53-1d293cad7330 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:38.092053 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-908d9e94-5dc1-4810-be53-1d293cad7330 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:38.098272 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-908d9e94-5dc1-4810-be53-1d293cad7330 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:38.098726 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-908d9e94-5dc1-4810-be53-1d293cad7330 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:38.099499 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-908d9e94-5dc1-4810-be53-1d293cad7330 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:38.099939 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-908d9e94-5dc1-4810-be53-1d293cad7330 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:38.128272 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-908d9e94-5dc1-4810-be53-1d293cad7330 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041656 Mar 08 14:56:38.128814 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 366/714] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:38 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:56:39.140665 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-26a653b5-9e52-4918-addb-782700ce68cc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:39.141551 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-26a653b5-9e52-4918-addb-782700ce68cc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:39.147760 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-26a653b5-9e52-4918-addb-782700ce68cc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:39.148207 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-26a653b5-9e52-4918-addb-782700ce68cc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:39.148967 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-26a653b5-9e52-4918-addb-782700ce68cc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:39.149400 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-26a653b5-9e52-4918-addb-782700ce68cc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:39.176825 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-26a653b5-9e52-4918-addb-782700ce68cc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040292 Mar 08 14:56:39.177352 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 349/715] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:39 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:56:40.188893 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-e5d4f225-aab1-4458-97d2-733b29cba7bd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:40.189712 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-e5d4f225-aab1-4458-97d2-733b29cba7bd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:40.195864 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e5d4f225-aab1-4458-97d2-733b29cba7bd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:40.196312 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e5d4f225-aab1-4458-97d2-733b29cba7bd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:40.197069 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e5d4f225-aab1-4458-97d2-733b29cba7bd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:40.197502 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e5d4f225-aab1-4458-97d2-733b29cba7bd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:40.225049 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-e5d4f225-aab1-4458-97d2-733b29cba7bd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040296 Mar 08 14:56:40.225604 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 367/716] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:40 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:56:41.236847 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-5c433b6a-3d3f-4ab8-9ac8-279dc4b64b1c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:41.238240 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-5c433b6a-3d3f-4ab8-9ac8-279dc4b64b1c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:41.244666 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5c433b6a-3d3f-4ab8-9ac8-279dc4b64b1c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:41.245846 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5c433b6a-3d3f-4ab8-9ac8-279dc4b64b1c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:41.246684 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5c433b6a-3d3f-4ab8-9ac8-279dc4b64b1c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:41.247125 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5c433b6a-3d3f-4ab8-9ac8-279dc4b64b1c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:41.274634 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-5c433b6a-3d3f-4ab8-9ac8-279dc4b64b1c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041736 Mar 08 14:56:41.275185 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 350/717] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:41 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:56:42.286844 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-2ebce842-e3ea-4a4d-bf13-bf275acc6a62 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:42.287868 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-2ebce842-e3ea-4a4d-bf13-bf275acc6a62 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:42.294267 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2ebce842-e3ea-4a4d-bf13-bf275acc6a62 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:42.294720 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2ebce842-e3ea-4a4d-bf13-bf275acc6a62 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:42.295487 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2ebce842-e3ea-4a4d-bf13-bf275acc6a62 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:42.295926 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2ebce842-e3ea-4a4d-bf13-bf275acc6a62 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:42.325230 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-2ebce842-e3ea-4a4d-bf13-bf275acc6a62 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042316 Mar 08 14:56:42.325786 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 368/718] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:42 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:56:43.336706 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-d6a3cfeb-923d-40cb-af9a-7d62b10f4d50 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:43.337646 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-d6a3cfeb-923d-40cb-af9a-7d62b10f4d50 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:43.344608 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d6a3cfeb-923d-40cb-af9a-7d62b10f4d50 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:43.345053 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d6a3cfeb-923d-40cb-af9a-7d62b10f4d50 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:43.345811 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d6a3cfeb-923d-40cb-af9a-7d62b10f4d50 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:43.346273 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d6a3cfeb-923d-40cb-af9a-7d62b10f4d50 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:43.374434 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-d6a3cfeb-923d-40cb-af9a-7d62b10f4d50 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041627 Mar 08 14:56:43.374988 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 351/719] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:43 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:56:44.386171 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-392dbad1-2532-49d2-9c71-f35eb42f15d9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:44.387095 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-392dbad1-2532-49d2-9c71-f35eb42f15d9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:44.393288 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-392dbad1-2532-49d2-9c71-f35eb42f15d9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:44.393749 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-392dbad1-2532-49d2-9c71-f35eb42f15d9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:44.394550 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-392dbad1-2532-49d2-9c71-f35eb42f15d9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:44.395040 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-392dbad1-2532-49d2-9c71-f35eb42f15d9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:44.423745 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-392dbad1-2532-49d2-9c71-f35eb42f15d9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041684 Mar 08 14:56:44.424308 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 369/720] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:44 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:56:45.436212 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-79dc959f-8f7b-477c-9abb-3d22e11309f9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:45.437365 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-79dc959f-8f7b-477c-9abb-3d22e11309f9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:45.443212 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-79dc959f-8f7b-477c-9abb-3d22e11309f9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:45.443661 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-79dc959f-8f7b-477c-9abb-3d22e11309f9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:45.444424 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-79dc959f-8f7b-477c-9abb-3d22e11309f9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:45.444862 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-79dc959f-8f7b-477c-9abb-3d22e11309f9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:45.473078 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-79dc959f-8f7b-477c-9abb-3d22e11309f9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041672 Mar 08 14:56:45.473626 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 352/721] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:45 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:56:46.302414 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5cc5ebc4-ec2b-412a-aebe-d54f77b0c930 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:46.302907 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5cc5ebc4-ec2b-412a-aebe-d54f77b0c930 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:46.308852 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5cc5ebc4-ec2b-412a-aebe-d54f77b0c930 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:46.309299 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5cc5ebc4-ec2b-412a-aebe-d54f77b0c930 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:46.310098 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5cc5ebc4-ec2b-412a-aebe-d54f77b0c930 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:46.310533 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5cc5ebc4-ec2b-412a-aebe-d54f77b0c930 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:46.333117 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5cc5ebc4-ec2b-412a-aebe-d54f77b0c930 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42/ips" status: 200 len: 146 microversion: 2.1 time: 0.085594 Mar 08 14:56:46.333668 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 370/722] 10.222.0.30 () {58 vars in 1247 bytes} [Tue Mar 8 14:56:46 2022] GET /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42/ips => generated 146 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:56:46.484754 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-32b677b1-5dc6-4dd5-87bd-dbbd612919c2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:46.485651 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-32b677b1-5dc6-4dd5-87bd-dbbd612919c2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:46.491934 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-32b677b1-5dc6-4dd5-87bd-dbbd612919c2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:46.492386 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-32b677b1-5dc6-4dd5-87bd-dbbd612919c2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:46.493209 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-32b677b1-5dc6-4dd5-87bd-dbbd612919c2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:46.493643 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-32b677b1-5dc6-4dd5-87bd-dbbd612919c2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:46.522745 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-32b677b1-5dc6-4dd5-87bd-dbbd612919c2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041894 Mar 08 14:56:46.523299 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 353/723] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:46 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:56:47.534828 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-eecd9d6a-91e3-46f1-bc0b-8a0094dbfe9e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:47.535736 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-eecd9d6a-91e3-46f1-bc0b-8a0094dbfe9e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:47.542005 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-eecd9d6a-91e3-46f1-bc0b-8a0094dbfe9e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:47.542459 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-eecd9d6a-91e3-46f1-bc0b-8a0094dbfe9e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:47.543223 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-eecd9d6a-91e3-46f1-bc0b-8a0094dbfe9e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:47.543655 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-eecd9d6a-91e3-46f1-bc0b-8a0094dbfe9e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:47.571402 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-eecd9d6a-91e3-46f1-bc0b-8a0094dbfe9e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040862 Mar 08 14:56:47.571938 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 371/724] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:47 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:56:48.584933 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-ff58ce6a-05af-4864-b66d-bc7fa08aafe7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:48.585944 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-ff58ce6a-05af-4864-b66d-bc7fa08aafe7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:48.593250 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ff58ce6a-05af-4864-b66d-bc7fa08aafe7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:48.593738 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ff58ce6a-05af-4864-b66d-bc7fa08aafe7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:48.594548 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ff58ce6a-05af-4864-b66d-bc7fa08aafe7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:48.594991 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ff58ce6a-05af-4864-b66d-bc7fa08aafe7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:48.622398 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-ff58ce6a-05af-4864-b66d-bc7fa08aafe7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042782 Mar 08 14:56:48.622950 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 354/725] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:48 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:56:49.633827 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-42ff6cf9-2b6a-4643-8abc-e65522062641 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:49.634767 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-42ff6cf9-2b6a-4643-8abc-e65522062641 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:49.641636 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-42ff6cf9-2b6a-4643-8abc-e65522062641 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:49.642194 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-42ff6cf9-2b6a-4643-8abc-e65522062641 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:49.642974 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-42ff6cf9-2b6a-4643-8abc-e65522062641 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:49.643411 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-42ff6cf9-2b6a-4643-8abc-e65522062641 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:49.673114 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-42ff6cf9-2b6a-4643-8abc-e65522062641 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043202 Mar 08 14:56:49.673669 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 372/726] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:49 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:56:50.684807 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-3fb043f0-2b85-4425-a476-57c6bb525fec tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:50.686245 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-3fb043f0-2b85-4425-a476-57c6bb525fec tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:50.692670 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3fb043f0-2b85-4425-a476-57c6bb525fec tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:50.693124 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3fb043f0-2b85-4425-a476-57c6bb525fec tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:50.693913 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3fb043f0-2b85-4425-a476-57c6bb525fec tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:50.694357 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3fb043f0-2b85-4425-a476-57c6bb525fec tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:50.722191 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-3fb043f0-2b85-4425-a476-57c6bb525fec tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041576 Mar 08 14:56:50.722735 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 355/727] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:50 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:56:51.733618 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-4b79143f-89c0-4ece-ad57-8d881e85f0ee tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:51.734573 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-4b79143f-89c0-4ece-ad57-8d881e85f0ee tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:51.740761 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4b79143f-89c0-4ece-ad57-8d881e85f0ee tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:51.741209 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4b79143f-89c0-4ece-ad57-8d881e85f0ee tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:51.742015 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4b79143f-89c0-4ece-ad57-8d881e85f0ee tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:51.742439 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4b79143f-89c0-4ece-ad57-8d881e85f0ee tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:51.769648 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-4b79143f-89c0-4ece-ad57-8d881e85f0ee tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040010 Mar 08 14:56:51.770219 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 373/728] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:51 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:56:52.780803 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-214a9824-e0cd-4f31-9531-2dd28dfbb003 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:52.781739 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-214a9824-e0cd-4f31-9531-2dd28dfbb003 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:52.787990 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-214a9824-e0cd-4f31-9531-2dd28dfbb003 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:52.788446 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-214a9824-e0cd-4f31-9531-2dd28dfbb003 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:52.789207 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-214a9824-e0cd-4f31-9531-2dd28dfbb003 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:52.789646 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-214a9824-e0cd-4f31-9531-2dd28dfbb003 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:52.817460 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-214a9824-e0cd-4f31-9531-2dd28dfbb003 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040867 Mar 08 14:56:52.818034 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 356/729] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:52 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:56:53.829142 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-0727422c-2c44-4f76-aa5a-bde049ed2906 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:53.830082 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-0727422c-2c44-4f76-aa5a-bde049ed2906 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:53.836277 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0727422c-2c44-4f76-aa5a-bde049ed2906 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:53.836802 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0727422c-2c44-4f76-aa5a-bde049ed2906 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:53.837504 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0727422c-2c44-4f76-aa5a-bde049ed2906 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:53.837951 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0727422c-2c44-4f76-aa5a-bde049ed2906 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:53.866066 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-0727422c-2c44-4f76-aa5a-bde049ed2906 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041372 Mar 08 14:56:53.866620 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 374/730] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:53 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:56:54.877843 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-f09e4caa-c9a5-4a0a-9f60-faedf2a1bdbf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:54.878848 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-f09e4caa-c9a5-4a0a-9f60-faedf2a1bdbf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:54.884901 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f09e4caa-c9a5-4a0a-9f60-faedf2a1bdbf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:54.885352 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f09e4caa-c9a5-4a0a-9f60-faedf2a1bdbf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:54.886156 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f09e4caa-c9a5-4a0a-9f60-faedf2a1bdbf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:54.886591 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f09e4caa-c9a5-4a0a-9f60-faedf2a1bdbf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:54.917931 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-f09e4caa-c9a5-4a0a-9f60-faedf2a1bdbf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043908 Mar 08 14:56:54.918485 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 357/731] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:54 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:56:55.929493 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-453ffe42-88ef-45e1-a149-7fc6a0e97287 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:55.930515 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-453ffe42-88ef-45e1-a149-7fc6a0e97287 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:55.937050 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-453ffe42-88ef-45e1-a149-7fc6a0e97287 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:55.937511 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-453ffe42-88ef-45e1-a149-7fc6a0e97287 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:55.938344 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-453ffe42-88ef-45e1-a149-7fc6a0e97287 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:55.938793 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-453ffe42-88ef-45e1-a149-7fc6a0e97287 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:55.967893 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-453ffe42-88ef-45e1-a149-7fc6a0e97287 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042320 Mar 08 14:56:55.968449 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 375/732] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:55 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:56:56.979603 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-45633051-b019-4595-aae7-811ec21b51b6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:56.980507 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-45633051-b019-4595-aae7-811ec21b51b6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:56.987316 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-45633051-b019-4595-aae7-811ec21b51b6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:56.987774 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-45633051-b019-4595-aae7-811ec21b51b6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:56.988538 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-45633051-b019-4595-aae7-811ec21b51b6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:56.988964 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-45633051-b019-4595-aae7-811ec21b51b6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:57.018331 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-45633051-b019-4595-aae7-811ec21b51b6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042738 Mar 08 14:56:57.018891 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 358/733] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:56 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:56:58.029167 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5a6317dd-80cf-4315-a407-0f35cd43e46d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:58.030269 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5a6317dd-80cf-4315-a407-0f35cd43e46d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:58.036544 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5a6317dd-80cf-4315-a407-0f35cd43e46d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:58.036994 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5a6317dd-80cf-4315-a407-0f35cd43e46d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:58.037762 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5a6317dd-80cf-4315-a407-0f35cd43e46d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:58.038226 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5a6317dd-80cf-4315-a407-0f35cd43e46d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:58.072506 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5a6317dd-80cf-4315-a407-0f35cd43e46d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047411 Mar 08 14:56:58.073081 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 376/734] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:58 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:56:59.085585 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-8f26f24c-12d7-4ec7-814c-c42a742cca5b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:56:59.086538 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-8f26f24c-12d7-4ec7-814c-c42a742cca5b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:56:59.093395 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8f26f24c-12d7-4ec7-814c-c42a742cca5b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:59.093903 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8f26f24c-12d7-4ec7-814c-c42a742cca5b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:59.094669 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8f26f24c-12d7-4ec7-814c-c42a742cca5b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:56:59.095100 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8f26f24c-12d7-4ec7-814c-c42a742cca5b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:56:59.123241 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-8f26f24c-12d7-4ec7-814c-c42a742cca5b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041523 Mar 08 14:56:59.124091 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 359/735] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:56:59 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:57:00.135140 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-224b4ce1-0094-4539-a36b-c8ffca2f185d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:00.136048 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-224b4ce1-0094-4539-a36b-c8ffca2f185d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:00.142488 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-224b4ce1-0094-4539-a36b-c8ffca2f185d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:00.142941 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-224b4ce1-0094-4539-a36b-c8ffca2f185d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:00.143720 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-224b4ce1-0094-4539-a36b-c8ffca2f185d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:00.144161 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-224b4ce1-0094-4539-a36b-c8ffca2f185d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:00.173065 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-224b4ce1-0094-4539-a36b-c8ffca2f185d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041879 Mar 08 14:57:00.173605 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 377/736] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:00 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:57:01.184926 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-eb1a3071-cb9f-4acb-b87d-f8a4b3d0aabd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:01.185871 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-eb1a3071-cb9f-4acb-b87d-f8a4b3d0aabd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:01.192532 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-eb1a3071-cb9f-4acb-b87d-f8a4b3d0aabd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:01.192929 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-eb1a3071-cb9f-4acb-b87d-f8a4b3d0aabd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:01.193693 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-eb1a3071-cb9f-4acb-b87d-f8a4b3d0aabd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:01.194156 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-eb1a3071-cb9f-4acb-b87d-f8a4b3d0aabd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:01.222789 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-eb1a3071-cb9f-4acb-b87d-f8a4b3d0aabd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042123 Mar 08 14:57:01.223328 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 360/737] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:01 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:57:02.235619 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-e359e6c6-d0e3-4bc6-8ed7-bcb59fb9449a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:02.236525 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-e359e6c6-d0e3-4bc6-8ed7-bcb59fb9449a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:02.242740 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e359e6c6-d0e3-4bc6-8ed7-bcb59fb9449a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:02.243187 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e359e6c6-d0e3-4bc6-8ed7-bcb59fb9449a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:02.243970 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e359e6c6-d0e3-4bc6-8ed7-bcb59fb9449a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:02.244410 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e359e6c6-d0e3-4bc6-8ed7-bcb59fb9449a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:02.272677 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-e359e6c6-d0e3-4bc6-8ed7-bcb59fb9449a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042063 Mar 08 14:57:02.273220 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 378/738] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:02 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:57:03.283551 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-bd8b2c12-fcb0-498b-9aae-bf791e32734d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:03.284465 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-bd8b2c12-fcb0-498b-9aae-bf791e32734d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:03.290667 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bd8b2c12-fcb0-498b-9aae-bf791e32734d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:03.291119 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bd8b2c12-fcb0-498b-9aae-bf791e32734d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:03.291884 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bd8b2c12-fcb0-498b-9aae-bf791e32734d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:03.292322 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bd8b2c12-fcb0-498b-9aae-bf791e32734d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:03.320356 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-bd8b2c12-fcb0-498b-9aae-bf791e32734d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040784 Mar 08 14:57:03.320899 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 361/739] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:03 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:57:04.334677 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-794e7133-3940-4481-beec-d2221d0e7237 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:04.335585 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-794e7133-3940-4481-beec-d2221d0e7237 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:04.341937 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-794e7133-3940-4481-beec-d2221d0e7237 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:04.342410 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-794e7133-3940-4481-beec-d2221d0e7237 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:04.343254 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-794e7133-3940-4481-beec-d2221d0e7237 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:04.343692 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-794e7133-3940-4481-beec-d2221d0e7237 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:04.372067 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-794e7133-3940-4481-beec-d2221d0e7237 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043964 Mar 08 14:57:04.372627 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 379/740] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:04 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:57:05.384466 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-38858459-e505-465e-ad0c-2554e04b071c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:05.385379 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-38858459-e505-465e-ad0c-2554e04b071c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:05.392062 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-38858459-e505-465e-ad0c-2554e04b071c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:05.392520 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-38858459-e505-465e-ad0c-2554e04b071c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:05.393305 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-38858459-e505-465e-ad0c-2554e04b071c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:05.393748 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-38858459-e505-465e-ad0c-2554e04b071c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:05.422634 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-38858459-e505-465e-ad0c-2554e04b071c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042151 Mar 08 14:57:05.423193 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 362/741] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:05 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:57:06.434625 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-de739710-e8c2-487a-abe1-1ae18c93cd47 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:06.435550 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-de739710-e8c2-487a-abe1-1ae18c93cd47 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:06.442080 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-de739710-e8c2-487a-abe1-1ae18c93cd47 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:06.442539 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-de739710-e8c2-487a-abe1-1ae18c93cd47 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:06.443330 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-de739710-e8c2-487a-abe1-1ae18c93cd47 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:06.443768 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-de739710-e8c2-487a-abe1-1ae18c93cd47 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:06.471245 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-de739710-e8c2-487a-abe1-1ae18c93cd47 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040886 Mar 08 14:57:06.471809 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 380/742] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:06 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:57:07.483001 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-0163b43c-494e-45b0-9a09-841668f57af6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:07.483971 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-0163b43c-494e-45b0-9a09-841668f57af6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:07.490396 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0163b43c-494e-45b0-9a09-841668f57af6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:07.490848 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0163b43c-494e-45b0-9a09-841668f57af6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:07.491656 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0163b43c-494e-45b0-9a09-841668f57af6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:07.492096 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0163b43c-494e-45b0-9a09-841668f57af6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:07.521541 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-0163b43c-494e-45b0-9a09-841668f57af6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042480 Mar 08 14:57:07.522140 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 363/743] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:07 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:57:08.533905 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-a218846c-900a-4250-a0a2-4d74de9a3ea5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:08.534820 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-a218846c-900a-4250-a0a2-4d74de9a3ea5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:08.541119 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a218846c-900a-4250-a0a2-4d74de9a3ea5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:08.541598 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a218846c-900a-4250-a0a2-4d74de9a3ea5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:08.542399 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a218846c-900a-4250-a0a2-4d74de9a3ea5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:08.542842 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a218846c-900a-4250-a0a2-4d74de9a3ea5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:08.571268 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-a218846c-900a-4250-a0a2-4d74de9a3ea5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041869 Mar 08 14:57:08.571817 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 381/744] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:08 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:57:09.582926 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-fdc40f45-62d1-4701-a2f6-89fb94475b36 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:09.583852 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-fdc40f45-62d1-4701-a2f6-89fb94475b36 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:09.590255 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fdc40f45-62d1-4701-a2f6-89fb94475b36 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:09.590705 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fdc40f45-62d1-4701-a2f6-89fb94475b36 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:09.591466 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fdc40f45-62d1-4701-a2f6-89fb94475b36 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:09.592032 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fdc40f45-62d1-4701-a2f6-89fb94475b36 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:09.619751 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-fdc40f45-62d1-4701-a2f6-89fb94475b36 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040858 Mar 08 14:57:09.620298 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 364/745] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:09 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:57:10.632218 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-810888d8-765d-472a-9e2f-cbf55f361afd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:10.633132 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-810888d8-765d-472a-9e2f-cbf55f361afd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:10.639622 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-810888d8-765d-472a-9e2f-cbf55f361afd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:10.640079 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-810888d8-765d-472a-9e2f-cbf55f361afd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:10.640857 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-810888d8-765d-472a-9e2f-cbf55f361afd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:10.641299 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-810888d8-765d-472a-9e2f-cbf55f361afd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:10.670596 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-810888d8-765d-472a-9e2f-cbf55f361afd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041671 Mar 08 14:57:10.671169 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 382/746] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:10 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:57:10.748428 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-99b72391-f241-456f-93b1-0cf6b0727919 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-679625147"}} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:57:10.749094 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-99b72391-f241-456f-93b1-0cf6b0727919 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:10.755336 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-99b72391-f241-456f-93b1-0cf6b0727919 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:10.755787 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-99b72391-f241-456f-93b1-0cf6b0727919 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:10.756542 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-99b72391-f241-456f-93b1-0cf6b0727919 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:10.756972 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-99b72391-f241-456f-93b1-0cf6b0727919 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:10.892503 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.network.security_group_api [None req-99b72391-f241-456f-93b1-0cf6b0727919 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Removing security group 0e39a5a5-3d7a-4185-becb-99f08a452dba from port b4376b4c-6cf3-4dbf-b874-e5bde382acad Mar 08 14:57:11.247985 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-99b72391-f241-456f-93b1-0cf6b0727919 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "POST /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/action" status: 202 len: 0 microversion: 2.1 time: 0.503400 Mar 08 14:57:11.252727 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 365/747] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Mar 8 14:57:10 2022] POST /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/action => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 14:57:11.346534 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-0c880fab-93cf-4a0b-9e4e-41969c4736df tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:57:11.347421 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-0c880fab-93cf-4a0b-9e4e-41969c4736df tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:11.355553 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0c880fab-93cf-4a0b-9e4e-41969c4736df tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:11.356883 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0c880fab-93cf-4a0b-9e4e-41969c4736df tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:11.358210 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [req-d936fa79-1216-4646-a36a-b73be7c39fc9 req-1865e9ee-60c0-44e0-b898-6d7562b056d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "251780d0-025f-4a29-b292-9a73dce671e6", "tag": "b4376b4c-6cf3-4dbf-b874-e5bde382acad"}]} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:57:11.358877 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0c880fab-93cf-4a0b-9e4e-41969c4736df tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:11.359543 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0c880fab-93cf-4a0b-9e4e-41969c4736df tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:11.373666 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-d936fa79-1216-4646-a36a-b73be7c39fc9 req-1865e9ee-60c0-44e0-b898-6d7562b056d2 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:11.374616 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-d936fa79-1216-4646-a36a-b73be7c39fc9 req-1865e9ee-60c0-44e0-b898-6d7562b056d2 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:11.385798 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.objects.instance [None req-0c880fab-93cf-4a0b-9e4e-41969c4736df tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lazy-loading 'flavor' on Instance uuid 1c488812-68f5-41d9-9d25-7f0fb61125f5 {{(pid=128351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 14:57:11.393746 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.compute.server_external_events [req-d936fa79-1216-4646-a36a-b73be7c39fc9 req-1865e9ee-60c0-44e0-b898-6d7562b056d2 service nova] Creating event network-changed:b4376b4c-6cf3-4dbf-b874-e5bde382acad for instance 251780d0-025f-4a29-b292-9a73dce671e6 on hv-cinder-83009 Mar 08 14:57:11.417369 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [req-d936fa79-1216-4646-a36a-b73be7c39fc9 req-1865e9ee-60c0-44e0-b898-6d7562b056d2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154750 Mar 08 14:57:11.418264 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 383/748] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 14:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:57:11.483343 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-0c880fab-93cf-4a0b-9e4e-41969c4736df tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "POST /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5/action" status: 202 len: 0 microversion: 2.1 time: 0.140733 Mar 08 14:57:11.484617 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 366/749] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Mar 8 14:57:11 2022] POST /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 14:57:11.494521 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-982db532-19e6-4c4e-9de4-e007624a25e3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:11.495231 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-982db532-19e6-4c4e-9de4-e007624a25e3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:11.509611 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-982db532-19e6-4c4e-9de4-e007624a25e3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:11.510044 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-982db532-19e6-4c4e-9de4-e007624a25e3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:11.510848 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-982db532-19e6-4c4e-9de4-e007624a25e3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:11.517078 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-982db532-19e6-4c4e-9de4-e007624a25e3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:11.687821 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-a29c665c-10a8-4a1d-b8a1-f4eaaeba1b20 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:11.689181 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-a29c665c-10a8-4a1d-b8a1-f4eaaeba1b20 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:11.692779 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-982db532-19e6-4c4e-9de4-e007624a25e3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:11.696879 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a29c665c-10a8-4a1d-b8a1-f4eaaeba1b20 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:11.697422 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a29c665c-10a8-4a1d-b8a1-f4eaaeba1b20 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:11.698315 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a29c665c-10a8-4a1d-b8a1-f4eaaeba1b20 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:11.698831 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a29c665c-10a8-4a1d-b8a1-f4eaaeba1b20 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:11.702969 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-982db532-19e6-4c4e-9de4-e007624a25e3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.212878 Mar 08 14:57:11.704165 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 384/750] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:11 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:11.732558 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-a29c665c-10a8-4a1d-b8a1-f4eaaeba1b20 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053414 Mar 08 14:57:11.733131 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 367/751] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:11 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:57:12.720877 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b937f850-ee27-43df-b71e-076e859e10b4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:12.721501 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b937f850-ee27-43df-b71e-076e859e10b4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:12.727980 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b937f850-ee27-43df-b71e-076e859e10b4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:12.728600 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b937f850-ee27-43df-b71e-076e859e10b4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:12.729397 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b937f850-ee27-43df-b71e-076e859e10b4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:12.729841 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b937f850-ee27-43df-b71e-076e859e10b4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:12.743904 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-1cf2f153-b0bd-4835-86f4-1ea055dbab9f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:12.744915 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-1cf2f153-b0bd-4835-86f4-1ea055dbab9f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:12.752575 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1cf2f153-b0bd-4835-86f4-1ea055dbab9f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:12.752994 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1cf2f153-b0bd-4835-86f4-1ea055dbab9f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:12.753733 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1cf2f153-b0bd-4835-86f4-1ea055dbab9f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:12.754218 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1cf2f153-b0bd-4835-86f4-1ea055dbab9f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:12.785633 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-1cf2f153-b0bd-4835-86f4-1ea055dbab9f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045637 Mar 08 14:57:12.786261 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 368/752] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:12 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:57:12.879565 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b937f850-ee27-43df-b71e-076e859e10b4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:12.887462 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b937f850-ee27-43df-b71e-076e859e10b4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.170621 Mar 08 14:57:12.888046 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 385/753] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:12 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:13.054306 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-3cebcb31-7f26-4555-9062-4b4ba31478c9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:13.054306 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-3cebcb31-7f26-4555-9062-4b4ba31478c9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:13.057185 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3cebcb31-7f26-4555-9062-4b4ba31478c9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:13.057634 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3cebcb31-7f26-4555-9062-4b4ba31478c9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:13.058435 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3cebcb31-7f26-4555-9062-4b4ba31478c9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:13.058869 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3cebcb31-7f26-4555-9062-4b4ba31478c9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:13.144062 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.objects.instance [None req-3cebcb31-7f26-4555-9062-4b4ba31478c9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lazy-loading 'services' on Instance uuid 251780d0-025f-4a29-b292-9a73dce671e6 {{(pid=128351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 14:57:13.213631 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-3cebcb31-7f26-4555-9062-4b4ba31478c9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "DELETE /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments/9ff4ba39-d5be-4514-8dac-561bb4b9e67e" status: 202 len: 0 microversion: 2.1 time: 0.166849 Mar 08 14:57:13.214630 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 369/754] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Mar 8 14:57:13 2022] DELETE /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments/9ff4ba39-d5be-4514-8dac-561bb4b9e67e => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 14:57:13.224108 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-a0493548-3c37-437c-a874-13b893907ec7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:13.225025 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-a0493548-3c37-437c-a874-13b893907ec7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:13.231336 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a0493548-3c37-437c-a874-13b893907ec7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:13.231914 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a0493548-3c37-437c-a874-13b893907ec7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:13.233551 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a0493548-3c37-437c-a874-13b893907ec7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:13.234339 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a0493548-3c37-437c-a874-13b893907ec7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:13.265604 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-a0493548-3c37-437c-a874-13b893907ec7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046489 Mar 08 14:57:13.266267 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 386/755] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:57:13 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:57:13.436990 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [req-5538246d-4748-47e7-aa4e-915c6109d08c req-80abcc55-996b-4020-8203-73a16a25cfb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "251780d0-025f-4a29-b292-9a73dce671e6", "tag": "b4376b4c-6cf3-4dbf-b874-e5bde382acad"}]} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:57:13.445519 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-5538246d-4748-47e7-aa4e-915c6109d08c req-80abcc55-996b-4020-8203-73a16a25cfb8 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:13.445990 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-5538246d-4748-47e7-aa4e-915c6109d08c req-80abcc55-996b-4020-8203-73a16a25cfb8 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:13.458104 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.compute.server_external_events [req-5538246d-4748-47e7-aa4e-915c6109d08c req-80abcc55-996b-4020-8203-73a16a25cfb8 service nova] Creating event network-changed:b4376b4c-6cf3-4dbf-b874-e5bde382acad for instance 251780d0-025f-4a29-b292-9a73dce671e6 on hv-cinder-83009 Mar 08 14:57:13.463210 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [req-5538246d-4748-47e7-aa4e-915c6109d08c req-80abcc55-996b-4020-8203-73a16a25cfb8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031842 Mar 08 14:57:13.463944 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 370/756] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 14:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:57:13.798401 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-7ed1d1a5-5e0b-4067-b0dc-4f8fe0674458 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:13.799334 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-7ed1d1a5-5e0b-4067-b0dc-4f8fe0674458 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:13.809392 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7ed1d1a5-5e0b-4067-b0dc-4f8fe0674458 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:13.809870 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7ed1d1a5-5e0b-4067-b0dc-4f8fe0674458 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:13.810716 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7ed1d1a5-5e0b-4067-b0dc-4f8fe0674458 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:13.811187 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7ed1d1a5-5e0b-4067-b0dc-4f8fe0674458 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:13.842974 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-7ed1d1a5-5e0b-4067-b0dc-4f8fe0674458 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049422 Mar 08 14:57:13.843858 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 387/757] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:13 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:57:13.906479 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-c228d40c-a1a7-4d28-be68-4a7fc69226a2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:13.907208 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-c228d40c-a1a7-4d28-be68-4a7fc69226a2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:13.914061 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c228d40c-a1a7-4d28-be68-4a7fc69226a2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:13.914529 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c228d40c-a1a7-4d28-be68-4a7fc69226a2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:13.915316 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c228d40c-a1a7-4d28-be68-4a7fc69226a2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:13.915758 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c228d40c-a1a7-4d28-be68-4a7fc69226a2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:14.084093 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-c228d40c-a1a7-4d28-be68-4a7fc69226a2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:14.093291 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-c228d40c-a1a7-4d28-be68-4a7fc69226a2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.191836 Mar 08 14:57:14.094123 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 371/758] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:13 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:14.276769 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-a4d0a844-a0aa-41aa-a482-71f08ba7b30e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:14.277610 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-a4d0a844-a0aa-41aa-a482-71f08ba7b30e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:14.284405 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a4d0a844-a0aa-41aa-a482-71f08ba7b30e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:14.284853 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a4d0a844-a0aa-41aa-a482-71f08ba7b30e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:14.285636 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a4d0a844-a0aa-41aa-a482-71f08ba7b30e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:14.286075 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a4d0a844-a0aa-41aa-a482-71f08ba7b30e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:14.314224 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-a4d0a844-a0aa-41aa-a482-71f08ba7b30e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041477 Mar 08 14:57:14.314767 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 388/759] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:57:14 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:57:14.854678 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-54427a41-bed7-4b43-813d-de41019fbe5d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:14.855589 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-54427a41-bed7-4b43-813d-de41019fbe5d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:14.862594 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-54427a41-bed7-4b43-813d-de41019fbe5d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:14.863041 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-54427a41-bed7-4b43-813d-de41019fbe5d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:14.863809 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-54427a41-bed7-4b43-813d-de41019fbe5d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:14.864239 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-54427a41-bed7-4b43-813d-de41019fbe5d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:14.892635 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-54427a41-bed7-4b43-813d-de41019fbe5d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042001 Mar 08 14:57:14.893171 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 372/760] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:14 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:57:15.110463 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-19d2cceb-7237-4a26-b781-4c24911ada6e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:15.111079 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-19d2cceb-7237-4a26-b781-4c24911ada6e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:15.117446 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-19d2cceb-7237-4a26-b781-4c24911ada6e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:15.117921 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-19d2cceb-7237-4a26-b781-4c24911ada6e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:15.118699 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-19d2cceb-7237-4a26-b781-4c24911ada6e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:15.119139 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-19d2cceb-7237-4a26-b781-4c24911ada6e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:15.260603 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-19d2cceb-7237-4a26-b781-4c24911ada6e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:15.268375 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-19d2cceb-7237-4a26-b781-4c24911ada6e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.161793 Mar 08 14:57:15.268929 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 389/761] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:15 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:15.324833 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-f5e1d7db-838e-4aa9-a079-eb7cc160b3ec tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:15.325750 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-f5e1d7db-838e-4aa9-a079-eb7cc160b3ec tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:15.332279 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f5e1d7db-838e-4aa9-a079-eb7cc160b3ec tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:15.332731 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f5e1d7db-838e-4aa9-a079-eb7cc160b3ec tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:15.333502 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f5e1d7db-838e-4aa9-a079-eb7cc160b3ec tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:15.333972 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f5e1d7db-838e-4aa9-a079-eb7cc160b3ec tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:15.362046 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-f5e1d7db-838e-4aa9-a079-eb7cc160b3ec tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040996 Mar 08 14:57:15.362532 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 373/762] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:57:15 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:57:15.904719 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-87186dcb-5754-4215-b1d6-dca23ece0107 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:15.905839 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-87186dcb-5754-4215-b1d6-dca23ece0107 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:15.911647 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-87186dcb-5754-4215-b1d6-dca23ece0107 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:15.912096 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-87186dcb-5754-4215-b1d6-dca23ece0107 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:15.912854 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-87186dcb-5754-4215-b1d6-dca23ece0107 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:15.913288 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-87186dcb-5754-4215-b1d6-dca23ece0107 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:15.942009 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-87186dcb-5754-4215-b1d6-dca23ece0107 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041867 Mar 08 14:57:15.942573 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 390/763] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:15 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:57:16.285322 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-3077926a-098e-4e71-a146-8b232a2cfefa tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:16.285962 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-3077926a-098e-4e71-a146-8b232a2cfefa tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:16.292213 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3077926a-098e-4e71-a146-8b232a2cfefa tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:16.292660 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3077926a-098e-4e71-a146-8b232a2cfefa tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:16.293417 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3077926a-098e-4e71-a146-8b232a2cfefa tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:16.293847 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3077926a-098e-4e71-a146-8b232a2cfefa tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:16.372686 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3ee5cbbe-98bd-4a9d-9312-85a7f87be176 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:16.373796 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-3ee5cbbe-98bd-4a9d-9312-85a7f87be176 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:16.380178 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3ee5cbbe-98bd-4a9d-9312-85a7f87be176 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:16.380630 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3ee5cbbe-98bd-4a9d-9312-85a7f87be176 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:16.381633 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3ee5cbbe-98bd-4a9d-9312-85a7f87be176 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:16.382106 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3ee5cbbe-98bd-4a9d-9312-85a7f87be176 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:16.411218 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-3ee5cbbe-98bd-4a9d-9312-85a7f87be176 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042443 Mar 08 14:57:16.412668 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 391/764] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:57:16 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:57:16.431689 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-3077926a-098e-4e71-a146-8b232a2cfefa tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:16.439229 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-3077926a-098e-4e71-a146-8b232a2cfefa tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.157651 Mar 08 14:57:16.439783 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 374/765] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:16 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:16.700203 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-7a949c42-887b-42de-b141-0f1de03b2bdf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:16.700638 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-7a949c42-887b-42de-b141-0f1de03b2bdf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:16.707255 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7a949c42-887b-42de-b141-0f1de03b2bdf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:16.707715 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7a949c42-887b-42de-b141-0f1de03b2bdf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:16.708493 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7a949c42-887b-42de-b141-0f1de03b2bdf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:16.708940 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7a949c42-887b-42de-b141-0f1de03b2bdf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:16.731813 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-7a949c42-887b-42de-b141-0f1de03b2bdf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Going to try to terminate instance {{(pid=128352) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 14:57:16.802925 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-7a949c42-887b-42de-b141-0f1de03b2bdf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 204 len: 0 microversion: 2.1 time: 0.106365 Mar 08 14:57:16.803675 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 392/766] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 14:57:16 2022] DELETE /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 14:57:16.812608 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-e8e7f8c0-ebce-4849-b6dd-41d202c6fe2b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:16.813215 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-e8e7f8c0-ebce-4849-b6dd-41d202c6fe2b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:16.819029 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e8e7f8c0-ebce-4849-b6dd-41d202c6fe2b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:16.819595 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e8e7f8c0-ebce-4849-b6dd-41d202c6fe2b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:16.820360 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e8e7f8c0-ebce-4849-b6dd-41d202c6fe2b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:16.820797 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e8e7f8c0-ebce-4849-b6dd-41d202c6fe2b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:16.956000 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-881096d4-40e0-4c8d-a332-9f4c8916aebf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:16.956371 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-e8e7f8c0-ebce-4849-b6dd-41d202c6fe2b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:16.957019 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-881096d4-40e0-4c8d-a332-9f4c8916aebf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:16.962835 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-881096d4-40e0-4c8d-a332-9f4c8916aebf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:16.963294 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-881096d4-40e0-4c8d-a332-9f4c8916aebf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:16.963953 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-e8e7f8c0-ebce-4849-b6dd-41d202c6fe2b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1578 microversion: 2.1 time: 0.155858 Mar 08 14:57:16.964066 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-881096d4-40e0-4c8d-a332-9f4c8916aebf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:16.964503 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-881096d4-40e0-4c8d-a332-9f4c8916aebf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:16.964604 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 375/767] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:16 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:57:16.994267 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-881096d4-40e0-4c8d-a332-9f4c8916aebf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043146 Mar 08 14:57:16.995136 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 393/768] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:16 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:57:17.424131 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-3faf3931-e250-4e9e-b864-533934ca22c2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:17.425089 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-3faf3931-e250-4e9e-b864-533934ca22c2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:17.431606 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3faf3931-e250-4e9e-b864-533934ca22c2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:17.432058 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3faf3931-e250-4e9e-b864-533934ca22c2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:17.432812 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3faf3931-e250-4e9e-b864-533934ca22c2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:17.433244 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3faf3931-e250-4e9e-b864-533934ca22c2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:17.455470 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-000148e1-2f6c-4a89-b2f5-111ef9701663 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:17.456619 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-000148e1-2f6c-4a89-b2f5-111ef9701663 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:17.462178 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-3faf3931-e250-4e9e-b864-533934ca22c2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043259 Mar 08 14:57:17.462779 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 376/769] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:57:17 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:57:17.462910 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-000148e1-2f6c-4a89-b2f5-111ef9701663 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:17.463225 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-000148e1-2f6c-4a89-b2f5-111ef9701663 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:17.463993 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-000148e1-2f6c-4a89-b2f5-111ef9701663 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:17.464429 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-000148e1-2f6c-4a89-b2f5-111ef9701663 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:17.599765 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-000148e1-2f6c-4a89-b2f5-111ef9701663 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:17.606980 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-000148e1-2f6c-4a89-b2f5-111ef9701663 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.155486 Mar 08 14:57:17.608162 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 394/770] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:17 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:57:17.980888 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-80ec295b-46ab-428e-80d1-3b8567332d29 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:17.981495 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-80ec295b-46ab-428e-80d1-3b8567332d29 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:17.987455 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-80ec295b-46ab-428e-80d1-3b8567332d29 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:17.987911 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-80ec295b-46ab-428e-80d1-3b8567332d29 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:17.988688 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-80ec295b-46ab-428e-80d1-3b8567332d29 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:17.989128 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-80ec295b-46ab-428e-80d1-3b8567332d29 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:18.007200 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-58e116cf-b143-4813-8bca-a2c7366b9395 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:18.008195 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-58e116cf-b143-4813-8bca-a2c7366b9395 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:18.015395 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-58e116cf-b143-4813-8bca-a2c7366b9395 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:18.015844 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-58e116cf-b143-4813-8bca-a2c7366b9395 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:18.016606 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-58e116cf-b143-4813-8bca-a2c7366b9395 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:18.017041 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-58e116cf-b143-4813-8bca-a2c7366b9395 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:18.046324 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-58e116cf-b143-4813-8bca-a2c7366b9395 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043597 Mar 08 14:57:18.046877 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 395/771] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:18 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:57:18.127085 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-80ec295b-46ab-428e-80d1-3b8567332d29 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:18.134353 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-80ec295b-46ab-428e-80d1-3b8567332d29 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1578 microversion: 2.1 time: 0.157339 Mar 08 14:57:18.134942 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 377/772] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:17 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:18.473434 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-05312fb1-4e8f-4293-8311-da65883fdc85 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:18.474381 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-05312fb1-4e8f-4293-8311-da65883fdc85 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:18.480661 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-05312fb1-4e8f-4293-8311-da65883fdc85 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:18.481071 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-05312fb1-4e8f-4293-8311-da65883fdc85 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:18.481991 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-05312fb1-4e8f-4293-8311-da65883fdc85 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:18.483222 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-05312fb1-4e8f-4293-8311-da65883fdc85 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:18.510738 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-05312fb1-4e8f-4293-8311-da65883fdc85 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041222 Mar 08 14:57:18.511280 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 396/773] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:57:18 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:57:18.625087 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-3ff71643-af15-44bc-8c42-cbe00abc1a9f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:18.625750 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-3ff71643-af15-44bc-8c42-cbe00abc1a9f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:18.632027 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3ff71643-af15-44bc-8c42-cbe00abc1a9f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:18.632479 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3ff71643-af15-44bc-8c42-cbe00abc1a9f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:18.633244 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3ff71643-af15-44bc-8c42-cbe00abc1a9f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:18.633679 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3ff71643-af15-44bc-8c42-cbe00abc1a9f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:18.885782 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-3ff71643-af15-44bc-8c42-cbe00abc1a9f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:18.893168 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-3ff71643-af15-44bc-8c42-cbe00abc1a9f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.272506 Mar 08 14:57:18.893742 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 378/774] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:18 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:57:19.058211 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-feca9106-ccde-4b6b-9b84-8e35019ea612 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:19.059131 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-feca9106-ccde-4b6b-9b84-8e35019ea612 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:19.065183 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-feca9106-ccde-4b6b-9b84-8e35019ea612 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:19.065631 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-feca9106-ccde-4b6b-9b84-8e35019ea612 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:19.066454 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-feca9106-ccde-4b6b-9b84-8e35019ea612 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:19.066891 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-feca9106-ccde-4b6b-9b84-8e35019ea612 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:19.099513 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-feca9106-ccde-4b6b-9b84-8e35019ea612 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045377 Mar 08 14:57:19.100136 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 397/775] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:19 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:57:19.152376 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-43221671-0b01-47d9-a9e9-b5fe54d6c15d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:19.152909 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-43221671-0b01-47d9-a9e9-b5fe54d6c15d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:19.159217 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-43221671-0b01-47d9-a9e9-b5fe54d6c15d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:19.159678 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-43221671-0b01-47d9-a9e9-b5fe54d6c15d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:19.160460 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-43221671-0b01-47d9-a9e9-b5fe54d6c15d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:19.160906 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-43221671-0b01-47d9-a9e9-b5fe54d6c15d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:19.437289 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-43221671-0b01-47d9-a9e9-b5fe54d6c15d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:19.444988 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-43221671-0b01-47d9-a9e9-b5fe54d6c15d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1578 microversion: 2.1 time: 0.296437 Mar 08 14:57:19.445441 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 379/776] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:19 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1578 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:19.522511 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-0e733703-06c6-42e0-9366-35a70b98ded8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:19.523497 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-0e733703-06c6-42e0-9366-35a70b98ded8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:19.530630 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0e733703-06c6-42e0-9366-35a70b98ded8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:19.531182 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0e733703-06c6-42e0-9366-35a70b98ded8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:19.532018 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0e733703-06c6-42e0-9366-35a70b98ded8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:19.532521 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0e733703-06c6-42e0-9366-35a70b98ded8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:19.562176 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-0e733703-06c6-42e0-9366-35a70b98ded8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043418 Mar 08 14:57:19.562676 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 398/777] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:57:19 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:57:19.630524 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [req-51da8515-2008-4d48-ae77-130f4cbc166c req-be52d3d0-eb19-4ac6-8030-0d63c2be5d8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b13cbf6-22b6-4acc-bbc2-1baead4cb29a", "name": "network-vif-deleted", "tag": "ab8b501c-d93f-421a-bbc2-a770d69214bf"}]} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:57:19.641116 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-51da8515-2008-4d48-ae77-130f4cbc166c req-be52d3d0-eb19-4ac6-8030-0d63c2be5d8e service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:19.641687 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-51da8515-2008-4d48-ae77-130f4cbc166c req-be52d3d0-eb19-4ac6-8030-0d63c2be5d8e service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:19.658997 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.compute.server_external_events [req-51da8515-2008-4d48-ae77-130f4cbc166c req-be52d3d0-eb19-4ac6-8030-0d63c2be5d8e service nova] Creating event network-vif-deleted:ab8b501c-d93f-421a-bbc2-a770d69214bf for instance 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a on hv-cinder-83009 Mar 08 14:57:19.664383 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [req-51da8515-2008-4d48-ae77-130f4cbc166c req-be52d3d0-eb19-4ac6-8030-0d63c2be5d8e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037399 Mar 08 14:57:19.664985 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 380/778] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 14:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:57:19.910610 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d1b50e66-8913-4b58-bdd1-b71132726882 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:19.911120 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d1b50e66-8913-4b58-bdd1-b71132726882 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:19.916818 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d1b50e66-8913-4b58-bdd1-b71132726882 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:19.917316 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d1b50e66-8913-4b58-bdd1-b71132726882 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:19.918051 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d1b50e66-8913-4b58-bdd1-b71132726882 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:19.918492 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d1b50e66-8913-4b58-bdd1-b71132726882 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:20.058855 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d1b50e66-8913-4b58-bdd1-b71132726882 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:20.067467 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d1b50e66-8913-4b58-bdd1-b71132726882 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.160896 Mar 08 14:57:20.068067 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 399/779] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:19 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:20.112069 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-ef2b2ed9-b59b-49c9-937f-55939c45c348 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:20.113075 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-ef2b2ed9-b59b-49c9-937f-55939c45c348 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:20.119089 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ef2b2ed9-b59b-49c9-937f-55939c45c348 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:20.119555 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ef2b2ed9-b59b-49c9-937f-55939c45c348 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:20.120331 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ef2b2ed9-b59b-49c9-937f-55939c45c348 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:20.120776 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ef2b2ed9-b59b-49c9-937f-55939c45c348 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:20.149228 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-ef2b2ed9-b59b-49c9-937f-55939c45c348 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042058 Mar 08 14:57:20.149786 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 381/780] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:20 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:57:20.462318 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-2307ff28-2256-4525-9e31-5eeb6b6aa9ea tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:20.462932 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-2307ff28-2256-4525-9e31-5eeb6b6aa9ea tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:20.469642 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2307ff28-2256-4525-9e31-5eeb6b6aa9ea tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:20.470140 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2307ff28-2256-4525-9e31-5eeb6b6aa9ea tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:20.470921 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2307ff28-2256-4525-9e31-5eeb6b6aa9ea tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:20.471356 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2307ff28-2256-4525-9e31-5eeb6b6aa9ea tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:20.533240 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-2307ff28-2256-4525-9e31-5eeb6b6aa9ea tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:20.540490 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-2307ff28-2256-4525-9e31-5eeb6b6aa9ea tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.082015 Mar 08 14:57:20.541044 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 400/781] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:20 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:20.572660 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-48a898df-7a96-4d9f-bf88-ce3f3148d290 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:20.573603 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-48a898df-7a96-4d9f-bf88-ce3f3148d290 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:20.579460 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-48a898df-7a96-4d9f-bf88-ce3f3148d290 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:20.579917 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-48a898df-7a96-4d9f-bf88-ce3f3148d290 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:20.580690 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-48a898df-7a96-4d9f-bf88-ce3f3148d290 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:20.581282 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-48a898df-7a96-4d9f-bf88-ce3f3148d290 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:20.611192 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-48a898df-7a96-4d9f-bf88-ce3f3148d290 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042451 Mar 08 14:57:20.612140 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 382/782] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:57:20 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:57:21.084582 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-40330daa-036f-4d73-b890-57e1e8905d18 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:21.085190 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-40330daa-036f-4d73-b890-57e1e8905d18 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:21.091147 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-40330daa-036f-4d73-b890-57e1e8905d18 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:21.091735 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-40330daa-036f-4d73-b890-57e1e8905d18 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:21.092503 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-40330daa-036f-4d73-b890-57e1e8905d18 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:21.092948 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-40330daa-036f-4d73-b890-57e1e8905d18 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:21.160804 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-23b1e19c-0639-4f57-b918-e0fac12d63d2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:21.161713 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-23b1e19c-0639-4f57-b918-e0fac12d63d2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:21.168215 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-23b1e19c-0639-4f57-b918-e0fac12d63d2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:21.168808 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-23b1e19c-0639-4f57-b918-e0fac12d63d2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:21.169916 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-23b1e19c-0639-4f57-b918-e0fac12d63d2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:21.170417 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-23b1e19c-0639-4f57-b918-e0fac12d63d2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:21.199226 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-23b1e19c-0639-4f57-b918-e0fac12d63d2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042329 Mar 08 14:57:21.199708 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 383/783] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:21 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:57:21.225058 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-40330daa-036f-4d73-b890-57e1e8905d18 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:21.232646 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-40330daa-036f-4d73-b890-57e1e8905d18 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.151736 Mar 08 14:57:21.233218 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 401/784] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:21 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:21.558338 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-76417ece-82e0-4df7-b88a-cf903adb32a1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:21.558978 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-76417ece-82e0-4df7-b88a-cf903adb32a1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:21.565759 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-76417ece-82e0-4df7-b88a-cf903adb32a1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:21.566252 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-76417ece-82e0-4df7-b88a-cf903adb32a1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:21.567029 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-76417ece-82e0-4df7-b88a-cf903adb32a1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:21.567519 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-76417ece-82e0-4df7-b88a-cf903adb32a1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:21.622570 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-bce6f87f-7325-4bfc-869b-e1dc04c509aa tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:21.624193 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-bce6f87f-7325-4bfc-869b-e1dc04c509aa tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:21.628739 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-76417ece-82e0-4df7-b88a-cf903adb32a1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:21.630525 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bce6f87f-7325-4bfc-869b-e1dc04c509aa tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:21.630973 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bce6f87f-7325-4bfc-869b-e1dc04c509aa tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:21.631741 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bce6f87f-7325-4bfc-869b-e1dc04c509aa tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:21.632173 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bce6f87f-7325-4bfc-869b-e1dc04c509aa tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:21.636112 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-76417ece-82e0-4df7-b88a-cf903adb32a1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081877 Mar 08 14:57:21.636678 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 384/785] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:21 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:21.659648 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-bce6f87f-7325-4bfc-869b-e1dc04c509aa tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040947 Mar 08 14:57:21.660189 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 402/786] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:57:21 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:57:22.210970 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-25820dda-2d0b-4d89-a92a-4216e6b413ff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:22.211925 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-25820dda-2d0b-4d89-a92a-4216e6b413ff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:22.220148 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-25820dda-2d0b-4d89-a92a-4216e6b413ff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:22.220423 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-25820dda-2d0b-4d89-a92a-4216e6b413ff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:22.221409 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-25820dda-2d0b-4d89-a92a-4216e6b413ff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:22.222048 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-25820dda-2d0b-4d89-a92a-4216e6b413ff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:22.249419 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-7ac4ac32-9931-4034-b883-836e279716a4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:22.250320 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-7ac4ac32-9931-4034-b883-836e279716a4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:22.252168 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-25820dda-2d0b-4d89-a92a-4216e6b413ff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045250 Mar 08 14:57:22.252739 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 385/787] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:22 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:57:22.260301 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7ac4ac32-9931-4034-b883-836e279716a4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:22.260784 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7ac4ac32-9931-4034-b883-836e279716a4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:22.261559 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7ac4ac32-9931-4034-b883-836e279716a4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:22.262040 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7ac4ac32-9931-4034-b883-836e279716a4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:22.398833 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-7ac4ac32-9931-4034-b883-836e279716a4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:22.406805 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-7ac4ac32-9931-4034-b883-836e279716a4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.161371 Mar 08 14:57:22.407373 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 403/788] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:22 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:57:22.652212 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-e3a5d5ce-a088-4509-9fa6-c73f917f3c27 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:22.652773 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-e3a5d5ce-a088-4509-9fa6-c73f917f3c27 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:22.659123 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e3a5d5ce-a088-4509-9fa6-c73f917f3c27 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:22.659578 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e3a5d5ce-a088-4509-9fa6-c73f917f3c27 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:22.660344 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e3a5d5ce-a088-4509-9fa6-c73f917f3c27 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:22.660780 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e3a5d5ce-a088-4509-9fa6-c73f917f3c27 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:22.671450 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b56edc2f-8a98-466e-826c-ebb93da471ee tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:22.672364 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b56edc2f-8a98-466e-826c-ebb93da471ee tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:22.678654 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b56edc2f-8a98-466e-826c-ebb93da471ee tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:22.679108 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b56edc2f-8a98-466e-826c-ebb93da471ee tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:22.679878 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b56edc2f-8a98-466e-826c-ebb93da471ee tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:22.680315 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b56edc2f-8a98-466e-826c-ebb93da471ee tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:22.711191 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b56edc2f-8a98-466e-826c-ebb93da471ee tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044133 Mar 08 14:57:22.711761 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 404/789] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:57:22 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:57:22.720439 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-e3a5d5ce-a088-4509-9fa6-c73f917f3c27 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:22.727813 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-e3a5d5ce-a088-4509-9fa6-c73f917f3c27 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079485 Mar 08 14:57:22.728395 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 386/790] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:22 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:23.263720 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-4a6004f3-d71e-4ad2-8228-2e0bc30ab147 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:23.264644 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-4a6004f3-d71e-4ad2-8228-2e0bc30ab147 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:23.270428 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4a6004f3-d71e-4ad2-8228-2e0bc30ab147 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:23.270896 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4a6004f3-d71e-4ad2-8228-2e0bc30ab147 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:23.271639 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4a6004f3-d71e-4ad2-8228-2e0bc30ab147 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:23.272074 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4a6004f3-d71e-4ad2-8228-2e0bc30ab147 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:23.299610 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-4a6004f3-d71e-4ad2-8228-2e0bc30ab147 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040128 Mar 08 14:57:23.300143 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 405/791] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:23 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:57:23.424304 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-97b6ab80-0543-484d-8490-bdf0d4949aff tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:23.424910 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-97b6ab80-0543-484d-8490-bdf0d4949aff tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:23.431368 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-97b6ab80-0543-484d-8490-bdf0d4949aff tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:23.431816 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-97b6ab80-0543-484d-8490-bdf0d4949aff tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:23.432571 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-97b6ab80-0543-484d-8490-bdf0d4949aff tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:23.433004 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-97b6ab80-0543-484d-8490-bdf0d4949aff tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:23.569937 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-97b6ab80-0543-484d-8490-bdf0d4949aff tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:23.577290 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-97b6ab80-0543-484d-8490-bdf0d4949aff tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.157394 Mar 08 14:57:23.577847 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 387/792] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:23 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:23.723235 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-2cbddb02-fc0d-4a5a-abbd-93b14101e6b6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:23.724147 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-2cbddb02-fc0d-4a5a-abbd-93b14101e6b6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:23.730319 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2cbddb02-fc0d-4a5a-abbd-93b14101e6b6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:23.730766 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2cbddb02-fc0d-4a5a-abbd-93b14101e6b6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:23.731526 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2cbddb02-fc0d-4a5a-abbd-93b14101e6b6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:23.732000 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2cbddb02-fc0d-4a5a-abbd-93b14101e6b6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:23.744277 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-8a651ed3-f750-4fb2-8234-51cedf82916d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:23.744918 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-8a651ed3-f750-4fb2-8234-51cedf82916d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:23.751213 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8a651ed3-f750-4fb2-8234-51cedf82916d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:23.751668 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8a651ed3-f750-4fb2-8234-51cedf82916d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:23.752433 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8a651ed3-f750-4fb2-8234-51cedf82916d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:23.752871 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8a651ed3-f750-4fb2-8234-51cedf82916d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:23.759812 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-2cbddb02-fc0d-4a5a-abbd-93b14101e6b6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040533 Mar 08 14:57:23.760370 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 406/793] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:57:23 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:57:23.812679 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-8a651ed3-f750-4fb2-8234-51cedf82916d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:23.819893 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-8a651ed3-f750-4fb2-8234-51cedf82916d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079430 Mar 08 14:57:23.820626 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 388/794] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:23 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:57:24.312144 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-163f8ec3-1b46-4fb1-85dd-c04c670a3da5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:24.313070 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-163f8ec3-1b46-4fb1-85dd-c04c670a3da5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:24.319013 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-163f8ec3-1b46-4fb1-85dd-c04c670a3da5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:24.319467 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-163f8ec3-1b46-4fb1-85dd-c04c670a3da5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:24.320253 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-163f8ec3-1b46-4fb1-85dd-c04c670a3da5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:24.320688 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-163f8ec3-1b46-4fb1-85dd-c04c670a3da5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:24.350363 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-163f8ec3-1b46-4fb1-85dd-c04c670a3da5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042743 Mar 08 14:57:24.350908 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 407/795] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:24 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:57:24.594183 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-dc4fe47c-a94d-4d06-aa53-01838a36d82e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:24.594723 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-dc4fe47c-a94d-4d06-aa53-01838a36d82e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:24.600861 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-dc4fe47c-a94d-4d06-aa53-01838a36d82e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:24.601307 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-dc4fe47c-a94d-4d06-aa53-01838a36d82e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:24.602106 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-dc4fe47c-a94d-4d06-aa53-01838a36d82e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:24.602542 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-dc4fe47c-a94d-4d06-aa53-01838a36d82e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:24.737442 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-dc4fe47c-a94d-4d06-aa53-01838a36d82e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:24.744655 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-dc4fe47c-a94d-4d06-aa53-01838a36d82e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.155021 Mar 08 14:57:24.745213 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 389/796] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:24 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:24.771278 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-0ff677ce-1fee-4312-9b29-401332b3a059 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:24.772191 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-0ff677ce-1fee-4312-9b29-401332b3a059 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:24.778316 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0ff677ce-1fee-4312-9b29-401332b3a059 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:24.778865 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0ff677ce-1fee-4312-9b29-401332b3a059 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:24.779794 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0ff677ce-1fee-4312-9b29-401332b3a059 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:24.780255 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0ff677ce-1fee-4312-9b29-401332b3a059 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:24.807703 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-0ff677ce-1fee-4312-9b29-401332b3a059 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040351 Mar 08 14:57:24.808245 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 408/797] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:57:24 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:57:24.836247 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-65d73d43-8684-406c-bc92-ce0f0815699f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:24.836858 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-65d73d43-8684-406c-bc92-ce0f0815699f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:24.843155 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-65d73d43-8684-406c-bc92-ce0f0815699f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:24.843612 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-65d73d43-8684-406c-bc92-ce0f0815699f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:24.844428 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-65d73d43-8684-406c-bc92-ce0f0815699f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:24.844820 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-65d73d43-8684-406c-bc92-ce0f0815699f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:24.904975 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-65d73d43-8684-406c-bc92-ce0f0815699f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:24.912206 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-65d73d43-8684-406c-bc92-ce0f0815699f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079747 Mar 08 14:57:24.912781 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 390/798] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:24 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:25.361572 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-77a06f97-ac3f-4219-afa6-723bcb50cb56 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:25.362538 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-77a06f97-ac3f-4219-afa6-723bcb50cb56 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:25.368410 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-77a06f97-ac3f-4219-afa6-723bcb50cb56 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:25.368865 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-77a06f97-ac3f-4219-afa6-723bcb50cb56 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:25.369628 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-77a06f97-ac3f-4219-afa6-723bcb50cb56 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:25.370100 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-77a06f97-ac3f-4219-afa6-723bcb50cb56 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:25.397636 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-77a06f97-ac3f-4219-afa6-723bcb50cb56 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040039 Mar 08 14:57:25.398221 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 409/799] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:25 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:57:25.761003 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-c8eb3aa3-fcf6-466d-9d05-4f3a3f44c8b3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:25.761602 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-c8eb3aa3-fcf6-466d-9d05-4f3a3f44c8b3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:25.768656 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c8eb3aa3-fcf6-466d-9d05-4f3a3f44c8b3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:25.769103 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c8eb3aa3-fcf6-466d-9d05-4f3a3f44c8b3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:25.769936 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c8eb3aa3-fcf6-466d-9d05-4f3a3f44c8b3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:25.770305 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c8eb3aa3-fcf6-466d-9d05-4f3a3f44c8b3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:25.819764 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-267791c5-1db9-4ed3-ab3b-fb2ff039b883 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:25.820667 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-267791c5-1db9-4ed3-ab3b-fb2ff039b883 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:25.827604 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-267791c5-1db9-4ed3-ab3b-fb2ff039b883 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:25.828040 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-267791c5-1db9-4ed3-ab3b-fb2ff039b883 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:25.828803 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-267791c5-1db9-4ed3-ab3b-fb2ff039b883 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:25.829241 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-267791c5-1db9-4ed3-ab3b-fb2ff039b883 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:25.859282 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-267791c5-1db9-4ed3-ab3b-fb2ff039b883 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043312 Mar 08 14:57:25.862959 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 410/800] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:57:25 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:57:25.907478 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-c8eb3aa3-fcf6-466d-9d05-4f3a3f44c8b3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:25.914843 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-c8eb3aa3-fcf6-466d-9d05-4f3a3f44c8b3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.157676 Mar 08 14:57:25.915548 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 391/801] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:25 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:25.929483 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-30d970b2-a4e5-4844-a03c-a790ae1e69a7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:25.930157 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-30d970b2-a4e5-4844-a03c-a790ae1e69a7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:25.936841 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-30d970b2-a4e5-4844-a03c-a790ae1e69a7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:25.937299 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-30d970b2-a4e5-4844-a03c-a790ae1e69a7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:25.938101 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-30d970b2-a4e5-4844-a03c-a790ae1e69a7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:25.938538 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-30d970b2-a4e5-4844-a03c-a790ae1e69a7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:26.007253 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-30d970b2-a4e5-4844-a03c-a790ae1e69a7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:26.015096 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-30d970b2-a4e5-4844-a03c-a790ae1e69a7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.089410 Mar 08 14:57:26.024440 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 411/802] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:25 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:26.029697 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [req-d4530bec-6459-4534-835e-2699b08e5934 req-dad0c74e-e585-4d60-a211-8ba645edbbb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c488812-68f5-41d9-9d25-7f0fb61125f5", "name": "network-vif-unplugged", "status": "completed", "tag": "ab17bc28-ab3f-46b1-be9d-d202c3e9d04f"}]} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:57:26.039062 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-d4530bec-6459-4534-835e-2699b08e5934 req-dad0c74e-e585-4d60-a211-8ba645edbbb8 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:26.039504 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-d4530bec-6459-4534-835e-2699b08e5934 req-dad0c74e-e585-4d60-a211-8ba645edbbb8 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:26.050253 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.compute.server_external_events [req-d4530bec-6459-4534-835e-2699b08e5934 req-dad0c74e-e585-4d60-a211-8ba645edbbb8 service nova] Creating event network-vif-unplugged:ab17bc28-ab3f-46b1-be9d-d202c3e9d04f for instance 1c488812-68f5-41d9-9d25-7f0fb61125f5 on hv-cinder-83009 Mar 08 14:57:26.055212 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [req-d4530bec-6459-4534-835e-2699b08e5934 req-dad0c74e-e585-4d60-a211-8ba645edbbb8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106656 Mar 08 14:57:26.055792 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 392/803] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 14:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:57:26.410029 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3f8cc65f-216e-4866-99da-90af9f1288e1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:26.410977 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-3f8cc65f-216e-4866-99da-90af9f1288e1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:26.416808 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3f8cc65f-216e-4866-99da-90af9f1288e1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:26.417260 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3f8cc65f-216e-4866-99da-90af9f1288e1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:26.418058 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3f8cc65f-216e-4866-99da-90af9f1288e1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:26.418501 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3f8cc65f-216e-4866-99da-90af9f1288e1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:26.447202 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-3f8cc65f-216e-4866-99da-90af9f1288e1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041164 Mar 08 14:57:26.447796 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 412/804] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:26 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:57:26.872029 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-da21d143-0fa9-44d4-a11d-6bbb3d8110d1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:26.874004 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-da21d143-0fa9-44d4-a11d-6bbb3d8110d1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:26.880032 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-da21d143-0fa9-44d4-a11d-6bbb3d8110d1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:26.880475 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-da21d143-0fa9-44d4-a11d-6bbb3d8110d1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:26.881225 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-da21d143-0fa9-44d4-a11d-6bbb3d8110d1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:26.881686 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-da21d143-0fa9-44d4-a11d-6bbb3d8110d1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:26.909543 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-da21d143-0fa9-44d4-a11d-6bbb3d8110d1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042501 Mar 08 14:57:26.910109 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 393/805] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:57:26 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:57:26.932563 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f60632f2-55c1-457f-8231-4e4a72bf9026 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:26.933175 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f60632f2-55c1-457f-8231-4e4a72bf9026 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:26.940245 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f60632f2-55c1-457f-8231-4e4a72bf9026 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:26.940700 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f60632f2-55c1-457f-8231-4e4a72bf9026 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:26.941757 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f60632f2-55c1-457f-8231-4e4a72bf9026 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:26.941922 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f60632f2-55c1-457f-8231-4e4a72bf9026 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:27.032043 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-28bc40dd-8acf-4458-8899-3109aa5ffa7d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:27.032755 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-28bc40dd-8acf-4458-8899-3109aa5ffa7d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:27.038813 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-28bc40dd-8acf-4458-8899-3109aa5ffa7d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:27.039346 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-28bc40dd-8acf-4458-8899-3109aa5ffa7d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:27.040192 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-28bc40dd-8acf-4458-8899-3109aa5ffa7d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:27.040696 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-28bc40dd-8acf-4458-8899-3109aa5ffa7d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:27.075745 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f60632f2-55c1-457f-8231-4e4a72bf9026 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:27.083791 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f60632f2-55c1-457f-8231-4e4a72bf9026 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.155255 Mar 08 14:57:27.084549 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 413/806] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:26 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:27.103000 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-28bc40dd-8acf-4458-8899-3109aa5ffa7d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:27.111263 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-28bc40dd-8acf-4458-8899-3109aa5ffa7d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.083375 Mar 08 14:57:27.111817 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 394/807] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:27 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:57:27.458995 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-103a6d56-79d7-4995-9a68-a91735aee018 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:27.459930 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-103a6d56-79d7-4995-9a68-a91735aee018 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:27.465923 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-103a6d56-79d7-4995-9a68-a91735aee018 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:27.467030 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-103a6d56-79d7-4995-9a68-a91735aee018 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:27.467849 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-103a6d56-79d7-4995-9a68-a91735aee018 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:27.468283 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-103a6d56-79d7-4995-9a68-a91735aee018 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:27.495411 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-103a6d56-79d7-4995-9a68-a91735aee018 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040418 Mar 08 14:57:27.495953 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 414/808] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:27 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:57:27.921034 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-0ad9cce7-68bf-479f-b058-e0cfc02988c7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:27.921983 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-0ad9cce7-68bf-479f-b058-e0cfc02988c7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:27.928241 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0ad9cce7-68bf-479f-b058-e0cfc02988c7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:27.928693 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0ad9cce7-68bf-479f-b058-e0cfc02988c7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:27.929459 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0ad9cce7-68bf-479f-b058-e0cfc02988c7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:27.929919 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0ad9cce7-68bf-479f-b058-e0cfc02988c7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:27.959528 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-0ad9cce7-68bf-479f-b058-e0cfc02988c7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042528 Mar 08 14:57:27.960078 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 395/809] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:57:27 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:57:28.101066 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-53ecc167-5c01-46ad-89e0-42debb40d5d0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:28.101677 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-53ecc167-5c01-46ad-89e0-42debb40d5d0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:28.107939 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-53ecc167-5c01-46ad-89e0-42debb40d5d0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:28.108392 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-53ecc167-5c01-46ad-89e0-42debb40d5d0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:28.109166 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-53ecc167-5c01-46ad-89e0-42debb40d5d0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:28.109906 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-53ecc167-5c01-46ad-89e0-42debb40d5d0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:28.128478 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-3692ff9b-e7f3-47d9-b5e4-25ced312e1a0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:28.129026 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-3692ff9b-e7f3-47d9-b5e4-25ced312e1a0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:28.134777 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3692ff9b-e7f3-47d9-b5e4-25ced312e1a0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:28.135236 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3692ff9b-e7f3-47d9-b5e4-25ced312e1a0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:28.136013 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3692ff9b-e7f3-47d9-b5e4-25ced312e1a0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:28.136453 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3692ff9b-e7f3-47d9-b5e4-25ced312e1a0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:28.201490 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-3692ff9b-e7f3-47d9-b5e4-25ced312e1a0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:28.208806 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-3692ff9b-e7f3-47d9-b5e4-25ced312e1a0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.084208 Mar 08 14:57:28.209372 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 396/810] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:28 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:57:28.258010 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-53ecc167-5c01-46ad-89e0-42debb40d5d0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:28.265797 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-53ecc167-5c01-46ad-89e0-42debb40d5d0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.168611 Mar 08 14:57:28.266389 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 415/811] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:28 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:28.507032 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-60478ccc-a903-40fe-bbc4-88b849f03597 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:28.507932 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-60478ccc-a903-40fe-bbc4-88b849f03597 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:28.513936 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-60478ccc-a903-40fe-bbc4-88b849f03597 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:28.514383 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-60478ccc-a903-40fe-bbc4-88b849f03597 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:28.515137 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-60478ccc-a903-40fe-bbc4-88b849f03597 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:28.515571 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-60478ccc-a903-40fe-bbc4-88b849f03597 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:28.542541 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-60478ccc-a903-40fe-bbc4-88b849f03597 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039465 Mar 08 14:57:28.543080 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 397/812] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:28 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:57:28.971204 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-2a2377d1-6d48-48ca-b3c4-60f3cac7e5d5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:28.972124 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-2a2377d1-6d48-48ca-b3c4-60f3cac7e5d5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:28.977974 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2a2377d1-6d48-48ca-b3c4-60f3cac7e5d5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:28.978432 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2a2377d1-6d48-48ca-b3c4-60f3cac7e5d5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:28.979203 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2a2377d1-6d48-48ca-b3c4-60f3cac7e5d5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:28.979646 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2a2377d1-6d48-48ca-b3c4-60f3cac7e5d5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:29.007259 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-2a2377d1-6d48-48ca-b3c4-60f3cac7e5d5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039998 Mar 08 14:57:29.007808 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 416/813] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:57:28 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:57:29.226000 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-144cfc47-b7c5-4e25-af03-adee23f55624 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:29.226619 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-144cfc47-b7c5-4e25-af03-adee23f55624 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:29.232849 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-144cfc47-b7c5-4e25-af03-adee23f55624 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:29.233299 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-144cfc47-b7c5-4e25-af03-adee23f55624 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:29.234101 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-144cfc47-b7c5-4e25-af03-adee23f55624 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:29.234540 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-144cfc47-b7c5-4e25-af03-adee23f55624 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:29.283459 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-83dbddf5-e609-45ea-9a49-fbb7aa9b25d8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:29.284058 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-83dbddf5-e609-45ea-9a49-fbb7aa9b25d8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:29.290192 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-83dbddf5-e609-45ea-9a49-fbb7aa9b25d8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:29.290647 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-83dbddf5-e609-45ea-9a49-fbb7aa9b25d8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:29.291420 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-83dbddf5-e609-45ea-9a49-fbb7aa9b25d8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:29.291856 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-83dbddf5-e609-45ea-9a49-fbb7aa9b25d8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:29.293482 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-144cfc47-b7c5-4e25-af03-adee23f55624 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:29.300980 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-144cfc47-b7c5-4e25-af03-adee23f55624 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078846 Mar 08 14:57:29.301694 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 398/814] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:29 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:29.425025 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-83dbddf5-e609-45ea-9a49-fbb7aa9b25d8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:29.432674 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-83dbddf5-e609-45ea-9a49-fbb7aa9b25d8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.154001 Mar 08 14:57:29.433229 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 417/815] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:29 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:57:29.554546 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-31b46090-956a-4645-ae05-8853ff866c84 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:29.555378 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-31b46090-956a-4645-ae05-8853ff866c84 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:29.561507 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-31b46090-956a-4645-ae05-8853ff866c84 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:29.561982 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-31b46090-956a-4645-ae05-8853ff866c84 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:29.562747 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-31b46090-956a-4645-ae05-8853ff866c84 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:29.563179 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-31b46090-956a-4645-ae05-8853ff866c84 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:29.589845 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-31b46090-956a-4645-ae05-8853ff866c84 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039292 Mar 08 14:57:29.590396 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 399/816] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:29 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:57:30.018875 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c6d48414-c3e0-4c12-bf36-d59a62bb855a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:30.019796 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-c6d48414-c3e0-4c12-bf36-d59a62bb855a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:30.025629 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c6d48414-c3e0-4c12-bf36-d59a62bb855a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:30.026121 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c6d48414-c3e0-4c12-bf36-d59a62bb855a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:30.026891 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c6d48414-c3e0-4c12-bf36-d59a62bb855a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:30.027329 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c6d48414-c3e0-4c12-bf36-d59a62bb855a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:30.054398 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-c6d48414-c3e0-4c12-bf36-d59a62bb855a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039485 Mar 08 14:57:30.054937 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 418/817] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:57:30 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:57:30.319265 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-87ca08a7-92f9-4008-ab29-a3df3b0b7be8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:30.319875 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-87ca08a7-92f9-4008-ab29-a3df3b0b7be8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:30.326744 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-87ca08a7-92f9-4008-ab29-a3df3b0b7be8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:30.327198 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-87ca08a7-92f9-4008-ab29-a3df3b0b7be8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:30.327965 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-87ca08a7-92f9-4008-ab29-a3df3b0b7be8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:30.328406 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-87ca08a7-92f9-4008-ab29-a3df3b0b7be8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:30.387556 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-87ca08a7-92f9-4008-ab29-a3df3b0b7be8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:30.395502 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-87ca08a7-92f9-4008-ab29-a3df3b0b7be8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080121 Mar 08 14:57:30.396069 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 400/818] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:30 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:30.449902 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-fcfdc0fd-08cd-48a0-b184-754fccae6624 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:30.451117 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-fcfdc0fd-08cd-48a0-b184-754fccae6624 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:30.457208 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fcfdc0fd-08cd-48a0-b184-754fccae6624 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:30.457652 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fcfdc0fd-08cd-48a0-b184-754fccae6624 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:30.458441 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fcfdc0fd-08cd-48a0-b184-754fccae6624 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:30.458874 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fcfdc0fd-08cd-48a0-b184-754fccae6624 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:30.598260 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-fcfdc0fd-08cd-48a0-b184-754fccae6624 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:30.601313 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-08ed6322-539a-4f26-8639-166c5aa958c6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:30.602394 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-08ed6322-539a-4f26-8639-166c5aa958c6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:30.605918 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-fcfdc0fd-08cd-48a0-b184-754fccae6624 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.160101 Mar 08 14:57:30.606486 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 419/819] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:30 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:30.608831 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-08ed6322-539a-4f26-8639-166c5aa958c6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:30.609289 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-08ed6322-539a-4f26-8639-166c5aa958c6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:30.610086 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-08ed6322-539a-4f26-8639-166c5aa958c6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:30.610520 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-08ed6322-539a-4f26-8639-166c5aa958c6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:30.639447 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-08ed6322-539a-4f26-8639-166c5aa958c6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042061 Mar 08 14:57:30.639988 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 401/820] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:30 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:57:31.065473 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-17dd49c5-423c-48c5-9fd5-4a57f7093cc9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:31.066426 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-17dd49c5-423c-48c5-9fd5-4a57f7093cc9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:31.072261 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-17dd49c5-423c-48c5-9fd5-4a57f7093cc9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:31.072753 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-17dd49c5-423c-48c5-9fd5-4a57f7093cc9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:31.073532 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-17dd49c5-423c-48c5-9fd5-4a57f7093cc9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:31.074000 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-17dd49c5-423c-48c5-9fd5-4a57f7093cc9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:31.101844 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-17dd49c5-423c-48c5-9fd5-4a57f7093cc9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040328 Mar 08 14:57:31.102411 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 420/821] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:57:31 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:57:31.412123 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-ab4e4c92-55f3-4562-9623-2cef51a4112e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:31.412730 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-ab4e4c92-55f3-4562-9623-2cef51a4112e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:31.418920 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ab4e4c92-55f3-4562-9623-2cef51a4112e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:31.419420 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ab4e4c92-55f3-4562-9623-2cef51a4112e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:31.420181 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ab4e4c92-55f3-4562-9623-2cef51a4112e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:31.420613 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ab4e4c92-55f3-4562-9623-2cef51a4112e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:31.624818 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ebdf846c-6d2d-4fb1-b034-5ca42e17d8bc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:31.625579 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ebdf846c-6d2d-4fb1-b034-5ca42e17d8bc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:31.632057 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ebdf846c-6d2d-4fb1-b034-5ca42e17d8bc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:31.632603 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ebdf846c-6d2d-4fb1-b034-5ca42e17d8bc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:31.633458 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ebdf846c-6d2d-4fb1-b034-5ca42e17d8bc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:31.633997 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ebdf846c-6d2d-4fb1-b034-5ca42e17d8bc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:31.634127 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-ab4e4c92-55f3-4562-9623-2cef51a4112e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:31.641845 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-ab4e4c92-55f3-4562-9623-2cef51a4112e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.233499 Mar 08 14:57:31.642450 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 402/822] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:31 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:31.652019 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-19b0e9d1-01eb-4c4e-9475-acb77af86083 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:31.652914 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-19b0e9d1-01eb-4c4e-9475-acb77af86083 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:31.658769 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-19b0e9d1-01eb-4c4e-9475-acb77af86083 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:31.659226 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-19b0e9d1-01eb-4c4e-9475-acb77af86083 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:31.659992 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-19b0e9d1-01eb-4c4e-9475-acb77af86083 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:31.660431 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-19b0e9d1-01eb-4c4e-9475-acb77af86083 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:31.689176 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-19b0e9d1-01eb-4c4e-9475-acb77af86083 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040793 Mar 08 14:57:31.689643 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 403/823] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:31 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:57:31.768301 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ebdf846c-6d2d-4fb1-b034-5ca42e17d8bc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:31.775567 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ebdf846c-6d2d-4fb1-b034-5ca42e17d8bc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.155777 Mar 08 14:57:31.776136 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 421/824] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:31 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:32.113530 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b6d55c76-8cbc-43db-906e-9b75fe34f907 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:32.114474 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-b6d55c76-8cbc-43db-906e-9b75fe34f907 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:32.120386 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b6d55c76-8cbc-43db-906e-9b75fe34f907 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:32.120840 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b6d55c76-8cbc-43db-906e-9b75fe34f907 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:32.121608 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b6d55c76-8cbc-43db-906e-9b75fe34f907 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:32.122079 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b6d55c76-8cbc-43db-906e-9b75fe34f907 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:32.151162 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-b6d55c76-8cbc-43db-906e-9b75fe34f907 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041526 Mar 08 14:57:32.151710 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 404/825] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:57:32 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:57:32.659152 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-502c88de-9f07-4f6c-bbb0-0472d50c88fa tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:32.659760 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-502c88de-9f07-4f6c-bbb0-0472d50c88fa tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:32.666048 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-502c88de-9f07-4f6c-bbb0-0472d50c88fa tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:32.666504 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-502c88de-9f07-4f6c-bbb0-0472d50c88fa tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:32.667274 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-502c88de-9f07-4f6c-bbb0-0472d50c88fa tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:32.667713 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-502c88de-9f07-4f6c-bbb0-0472d50c88fa tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:32.699786 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-64711740-d0d8-443f-91ff-2b60c52df5d1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:32.701493 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-64711740-d0d8-443f-91ff-2b60c52df5d1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:32.707508 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-64711740-d0d8-443f-91ff-2b60c52df5d1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:32.707965 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-64711740-d0d8-443f-91ff-2b60c52df5d1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:32.708747 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-64711740-d0d8-443f-91ff-2b60c52df5d1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:32.709187 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-64711740-d0d8-443f-91ff-2b60c52df5d1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:32.728254 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-502c88de-9f07-4f6c-bbb0-0472d50c88fa tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:32.735675 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-502c88de-9f07-4f6c-bbb0-0472d50c88fa tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080364 Mar 08 14:57:32.736241 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 422/826] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:32 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:32.738219 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-64711740-d0d8-443f-91ff-2b60c52df5d1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042250 Mar 08 14:57:32.738775 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 405/827] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:32 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:57:32.791968 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-6efcbbe7-9640-467e-8196-e56cfb3cf3ff tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:32.792576 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-6efcbbe7-9640-467e-8196-e56cfb3cf3ff tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:32.798779 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6efcbbe7-9640-467e-8196-e56cfb3cf3ff tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:32.799239 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6efcbbe7-9640-467e-8196-e56cfb3cf3ff tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:32.800010 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6efcbbe7-9640-467e-8196-e56cfb3cf3ff tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:32.800449 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6efcbbe7-9640-467e-8196-e56cfb3cf3ff tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:32.938714 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-6efcbbe7-9640-467e-8196-e56cfb3cf3ff tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:32.946064 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-6efcbbe7-9640-467e-8196-e56cfb3cf3ff tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.157685 Mar 08 14:57:32.946623 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 423/828] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:32 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:33.163153 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-76c9b87f-5f2e-40e6-aade-fc3aab451797 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:33.164056 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-76c9b87f-5f2e-40e6-aade-fc3aab451797 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:33.169902 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-76c9b87f-5f2e-40e6-aade-fc3aab451797 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:33.170360 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-76c9b87f-5f2e-40e6-aade-fc3aab451797 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:33.171127 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-76c9b87f-5f2e-40e6-aade-fc3aab451797 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:33.171570 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-76c9b87f-5f2e-40e6-aade-fc3aab451797 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:33.199707 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-76c9b87f-5f2e-40e6-aade-fc3aab451797 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040534 Mar 08 14:57:33.200183 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 406/829] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:57:33 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:57:33.749757 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-1557c9cb-8d03-40da-bde0-c78e8b4a2289 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:33.750775 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-1557c9cb-8d03-40da-bde0-c78e8b4a2289 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:33.752221 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-231b0b21-2a32-4481-9c32-76044ca586f6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:33.752957 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-231b0b21-2a32-4481-9c32-76044ca586f6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:33.757096 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1557c9cb-8d03-40da-bde0-c78e8b4a2289 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:33.757542 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1557c9cb-8d03-40da-bde0-c78e8b4a2289 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:33.758342 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1557c9cb-8d03-40da-bde0-c78e8b4a2289 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:33.758776 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1557c9cb-8d03-40da-bde0-c78e8b4a2289 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:33.759174 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-231b0b21-2a32-4481-9c32-76044ca586f6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:33.759627 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-231b0b21-2a32-4481-9c32-76044ca586f6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:33.760513 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-231b0b21-2a32-4481-9c32-76044ca586f6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:33.760959 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-231b0b21-2a32-4481-9c32-76044ca586f6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:33.788025 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-1557c9cb-8d03-40da-bde0-c78e8b4a2289 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042270 Mar 08 14:57:33.788589 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 424/830] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:33 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:57:33.822256 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-231b0b21-2a32-4481-9c32-76044ca586f6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:33.830161 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-231b0b21-2a32-4481-9c32-76044ca586f6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081682 Mar 08 14:57:33.830713 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 407/831] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:33 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:57:33.964743 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5484ec86-d5dd-4911-878a-9d6a3e264e45 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:33.965353 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5484ec86-d5dd-4911-878a-9d6a3e264e45 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:33.971308 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5484ec86-d5dd-4911-878a-9d6a3e264e45 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:33.971760 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5484ec86-d5dd-4911-878a-9d6a3e264e45 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:33.972529 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5484ec86-d5dd-4911-878a-9d6a3e264e45 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:33.972973 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5484ec86-d5dd-4911-878a-9d6a3e264e45 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:34.103630 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-5484ec86-d5dd-4911-878a-9d6a3e264e45 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:34.111204 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5484ec86-d5dd-4911-878a-9d6a3e264e45 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.150356 Mar 08 14:57:34.111773 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 425/832] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:33 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:34.211857 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-6cc67740-2840-4aea-bdf5-de166e4f1f26 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:34.212759 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-6cc67740-2840-4aea-bdf5-de166e4f1f26 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:34.219294 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6cc67740-2840-4aea-bdf5-de166e4f1f26 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:34.219751 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6cc67740-2840-4aea-bdf5-de166e4f1f26 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:34.220523 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6cc67740-2840-4aea-bdf5-de166e4f1f26 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:34.220962 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6cc67740-2840-4aea-bdf5-de166e4f1f26 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:34.249681 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-6cc67740-2840-4aea-bdf5-de166e4f1f26 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041273 Mar 08 14:57:34.249911 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 408/833] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:57:34 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:57:34.800496 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-dd41e3fd-0680-4fbc-8991-3274d08ee338 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:34.801403 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-dd41e3fd-0680-4fbc-8991-3274d08ee338 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:34.807895 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dd41e3fd-0680-4fbc-8991-3274d08ee338 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:34.808343 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dd41e3fd-0680-4fbc-8991-3274d08ee338 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:34.809109 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dd41e3fd-0680-4fbc-8991-3274d08ee338 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:34.809559 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dd41e3fd-0680-4fbc-8991-3274d08ee338 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:34.837344 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-dd41e3fd-0680-4fbc-8991-3274d08ee338 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040817 Mar 08 14:57:34.837888 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 426/834] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:34 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:57:34.847200 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-98c5378f-20d7-414d-9355-7e7a41116555 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:34.847807 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-98c5378f-20d7-414d-9355-7e7a41116555 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:34.854092 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-98c5378f-20d7-414d-9355-7e7a41116555 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:34.854544 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-98c5378f-20d7-414d-9355-7e7a41116555 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:34.855313 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-98c5378f-20d7-414d-9355-7e7a41116555 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:34.855751 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-98c5378f-20d7-414d-9355-7e7a41116555 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:34.914301 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-98c5378f-20d7-414d-9355-7e7a41116555 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:34.922408 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-98c5378f-20d7-414d-9355-7e7a41116555 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079000 Mar 08 14:57:34.922952 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 409/835] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:34 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:35.128302 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-dacc5c80-34ea-4d4c-9b3f-938cef32ca75 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:35.128828 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-dacc5c80-34ea-4d4c-9b3f-938cef32ca75 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:35.134637 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dacc5c80-34ea-4d4c-9b3f-938cef32ca75 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:35.135082 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dacc5c80-34ea-4d4c-9b3f-938cef32ca75 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:35.135836 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dacc5c80-34ea-4d4c-9b3f-938cef32ca75 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:35.136265 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dacc5c80-34ea-4d4c-9b3f-938cef32ca75 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:35.259934 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b2d5e41a-6119-4785-8baa-3bb29ef55eae tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:35.261254 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-b2d5e41a-6119-4785-8baa-3bb29ef55eae tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:35.267980 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b2d5e41a-6119-4785-8baa-3bb29ef55eae tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:35.268506 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b2d5e41a-6119-4785-8baa-3bb29ef55eae tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:35.269342 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b2d5e41a-6119-4785-8baa-3bb29ef55eae tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:35.269847 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b2d5e41a-6119-4785-8baa-3bb29ef55eae tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:35.272400 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-dacc5c80-34ea-4d4c-9b3f-938cef32ca75 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:35.280674 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-dacc5c80-34ea-4d4c-9b3f-938cef32ca75 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.156113 Mar 08 14:57:35.281239 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 427/836] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:35 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:35.298450 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-b2d5e41a-6119-4785-8baa-3bb29ef55eae tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042393 Mar 08 14:57:35.298986 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 410/837] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:57:35 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:57:35.849796 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-80755281-d14c-4d36-9be2-b3cb98b0eb36 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:35.850733 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-80755281-d14c-4d36-9be2-b3cb98b0eb36 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:35.856974 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-80755281-d14c-4d36-9be2-b3cb98b0eb36 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:35.857418 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-80755281-d14c-4d36-9be2-b3cb98b0eb36 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:35.858205 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-80755281-d14c-4d36-9be2-b3cb98b0eb36 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:35.858640 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-80755281-d14c-4d36-9be2-b3cb98b0eb36 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:35.885703 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-80755281-d14c-4d36-9be2-b3cb98b0eb36 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039839 Mar 08 14:57:35.886262 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 428/838] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:35 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:57:35.939376 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-006fc0bd-b81c-4472-8f07-0faa60e449d1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:35.939985 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-006fc0bd-b81c-4472-8f07-0faa60e449d1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:35.946263 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-006fc0bd-b81c-4472-8f07-0faa60e449d1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:35.946712 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-006fc0bd-b81c-4472-8f07-0faa60e449d1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:35.947478 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-006fc0bd-b81c-4472-8f07-0faa60e449d1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:35.947914 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-006fc0bd-b81c-4472-8f07-0faa60e449d1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:36.011169 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-006fc0bd-b81c-4472-8f07-0faa60e449d1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:36.018588 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-006fc0bd-b81c-4472-8f07-0faa60e449d1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.082996 Mar 08 14:57:36.019141 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 411/839] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:35 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:36.297615 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-84b366f6-8638-4347-a058-453b41ae3648 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:36.298291 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-84b366f6-8638-4347-a058-453b41ae3648 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:36.304263 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-84b366f6-8638-4347-a058-453b41ae3648 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:36.304720 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-84b366f6-8638-4347-a058-453b41ae3648 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:36.305491 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-84b366f6-8638-4347-a058-453b41ae3648 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:36.306210 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-84b366f6-8638-4347-a058-453b41ae3648 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:36.310063 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-57f92df1-943c-4500-9f59-05855eeb1f14 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:36.310978 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-57f92df1-943c-4500-9f59-05855eeb1f14 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:36.316710 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-57f92df1-943c-4500-9f59-05855eeb1f14 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:36.317157 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-57f92df1-943c-4500-9f59-05855eeb1f14 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:36.317954 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-57f92df1-943c-4500-9f59-05855eeb1f14 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:36.318393 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-57f92df1-943c-4500-9f59-05855eeb1f14 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:36.346584 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-57f92df1-943c-4500-9f59-05855eeb1f14 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041168 Mar 08 14:57:36.347141 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 412/840] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:57:36 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:57:36.439999 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-84b366f6-8638-4347-a058-453b41ae3648 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:36.447252 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-84b366f6-8638-4347-a058-453b41ae3648 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.153526 Mar 08 14:57:36.447819 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 429/841] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:36 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:36.897596 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-6e7d2bf0-b558-4929-8a1d-c8b0f5d26642 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:36.898527 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-6e7d2bf0-b558-4929-8a1d-c8b0f5d26642 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:36.905108 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6e7d2bf0-b558-4929-8a1d-c8b0f5d26642 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:36.905558 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6e7d2bf0-b558-4929-8a1d-c8b0f5d26642 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:36.906345 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6e7d2bf0-b558-4929-8a1d-c8b0f5d26642 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:36.906781 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6e7d2bf0-b558-4929-8a1d-c8b0f5d26642 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:36.934440 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-6e7d2bf0-b558-4929-8a1d-c8b0f5d26642 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040796 Mar 08 14:57:36.934988 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 413/842] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:36 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:57:37.035767 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-69721aef-7453-49c2-8407-f7fca01003f7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:37.036389 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-69721aef-7453-49c2-8407-f7fca01003f7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:37.042202 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-69721aef-7453-49c2-8407-f7fca01003f7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:37.042654 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-69721aef-7453-49c2-8407-f7fca01003f7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:37.043424 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-69721aef-7453-49c2-8407-f7fca01003f7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:37.044479 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-69721aef-7453-49c2-8407-f7fca01003f7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:37.102977 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-69721aef-7453-49c2-8407-f7fca01003f7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:37.111205 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-69721aef-7453-49c2-8407-f7fca01003f7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079600 Mar 08 14:57:37.111763 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 430/843] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:37 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:37.358122 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-bd5802f9-0350-46cc-9ef1-0671edede36b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:37.359071 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-bd5802f9-0350-46cc-9ef1-0671edede36b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:37.365399 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bd5802f9-0350-46cc-9ef1-0671edede36b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:37.365874 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bd5802f9-0350-46cc-9ef1-0671edede36b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:37.366644 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bd5802f9-0350-46cc-9ef1-0671edede36b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:37.367076 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bd5802f9-0350-46cc-9ef1-0671edede36b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:37.394773 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-bd5802f9-0350-46cc-9ef1-0671edede36b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040693 Mar 08 14:57:37.395317 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 414/844] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:57:37 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:57:37.463809 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3909e672-fda8-47a6-81e3-5be5f187e67c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:37.464536 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-3909e672-fda8-47a6-81e3-5be5f187e67c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:37.471152 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3909e672-fda8-47a6-81e3-5be5f187e67c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:37.471607 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3909e672-fda8-47a6-81e3-5be5f187e67c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:37.472403 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3909e672-fda8-47a6-81e3-5be5f187e67c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:37.472839 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3909e672-fda8-47a6-81e3-5be5f187e67c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:37.608956 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-3909e672-fda8-47a6-81e3-5be5f187e67c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:37.616142 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-3909e672-fda8-47a6-81e3-5be5f187e67c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.156101 Mar 08 14:57:37.616697 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 431/845] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:37 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:37.946135 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-a64f12c2-1aa7-4539-9ebc-ee998fdb7aaf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:37.947039 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-a64f12c2-1aa7-4539-9ebc-ee998fdb7aaf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:37.953581 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a64f12c2-1aa7-4539-9ebc-ee998fdb7aaf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:37.954076 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a64f12c2-1aa7-4539-9ebc-ee998fdb7aaf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:37.954843 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a64f12c2-1aa7-4539-9ebc-ee998fdb7aaf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:37.955284 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a64f12c2-1aa7-4539-9ebc-ee998fdb7aaf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:37.982996 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-a64f12c2-1aa7-4539-9ebc-ee998fdb7aaf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040889 Mar 08 14:57:37.983542 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 415/846] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:37 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:57:38.128257 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-63cc4f10-ba55-4c28-82a6-18fe2c329b32 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:38.128873 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-63cc4f10-ba55-4c28-82a6-18fe2c329b32 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:38.134624 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-63cc4f10-ba55-4c28-82a6-18fe2c329b32 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:38.135080 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-63cc4f10-ba55-4c28-82a6-18fe2c329b32 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:38.135860 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-63cc4f10-ba55-4c28-82a6-18fe2c329b32 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:38.136302 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-63cc4f10-ba55-4c28-82a6-18fe2c329b32 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:38.196165 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-63cc4f10-ba55-4c28-82a6-18fe2c329b32 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:38.204671 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-63cc4f10-ba55-4c28-82a6-18fe2c329b32 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080271 Mar 08 14:57:38.205231 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 432/847] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:38 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:38.406313 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-35419d9a-821d-4c49-8307-677e04ee2025 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:38.407225 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-35419d9a-821d-4c49-8307-677e04ee2025 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:38.413471 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-35419d9a-821d-4c49-8307-677e04ee2025 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:38.413960 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-35419d9a-821d-4c49-8307-677e04ee2025 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:38.414731 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-35419d9a-821d-4c49-8307-677e04ee2025 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:38.415171 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-35419d9a-821d-4c49-8307-677e04ee2025 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:38.445701 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-35419d9a-821d-4c49-8307-677e04ee2025 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043338 Mar 08 14:57:38.446209 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 416/848] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:57:38 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:57:38.632407 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-e03e3c93-5c8a-427e-a104-dcbf96e0a850 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:38.633053 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-e03e3c93-5c8a-427e-a104-dcbf96e0a850 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:38.639912 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e03e3c93-5c8a-427e-a104-dcbf96e0a850 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:38.640365 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e03e3c93-5c8a-427e-a104-dcbf96e0a850 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:38.641137 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e03e3c93-5c8a-427e-a104-dcbf96e0a850 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:38.641573 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e03e3c93-5c8a-427e-a104-dcbf96e0a850 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:38.775102 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-e03e3c93-5c8a-427e-a104-dcbf96e0a850 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:38.782635 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-e03e3c93-5c8a-427e-a104-dcbf96e0a850 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.154083 Mar 08 14:57:38.783189 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 433/849] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:38 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:38.995069 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-bc9de892-0848-4a71-888b-f541e7ea6e5b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:38.996002 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-bc9de892-0848-4a71-888b-f541e7ea6e5b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:39.002957 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bc9de892-0848-4a71-888b-f541e7ea6e5b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:39.003417 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bc9de892-0848-4a71-888b-f541e7ea6e5b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:39.004176 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bc9de892-0848-4a71-888b-f541e7ea6e5b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:39.004629 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bc9de892-0848-4a71-888b-f541e7ea6e5b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:39.032680 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-bc9de892-0848-4a71-888b-f541e7ea6e5b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041635 Mar 08 14:57:39.033209 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 417/850] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:38 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:57:39.221737 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d7ab8cf8-3fa8-43dc-8d7a-49dd2bfc6ca4 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:39.222385 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d7ab8cf8-3fa8-43dc-8d7a-49dd2bfc6ca4 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:39.228227 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d7ab8cf8-3fa8-43dc-8d7a-49dd2bfc6ca4 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:39.228687 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d7ab8cf8-3fa8-43dc-8d7a-49dd2bfc6ca4 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:39.229463 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d7ab8cf8-3fa8-43dc-8d7a-49dd2bfc6ca4 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:39.229933 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d7ab8cf8-3fa8-43dc-8d7a-49dd2bfc6ca4 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:39.291810 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d7ab8cf8-3fa8-43dc-8d7a-49dd2bfc6ca4 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:39.299715 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d7ab8cf8-3fa8-43dc-8d7a-49dd2bfc6ca4 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081821 Mar 08 14:57:39.300272 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 434/851] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:39 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:39.457119 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-0461736f-2133-4ee4-973a-85fff0304029 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:39.458609 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-0461736f-2133-4ee4-973a-85fff0304029 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:39.464749 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0461736f-2133-4ee4-973a-85fff0304029 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:39.465215 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0461736f-2133-4ee4-973a-85fff0304029 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:39.466760 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0461736f-2133-4ee4-973a-85fff0304029 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:39.467200 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0461736f-2133-4ee4-973a-85fff0304029 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:39.493868 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-0461736f-2133-4ee4-973a-85fff0304029 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040593 Mar 08 14:57:39.494400 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 418/852] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:57:39 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:57:39.800003 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-2304185c-e706-4d23-a50b-e33f66268db2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:39.800617 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-2304185c-e706-4d23-a50b-e33f66268db2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:39.807072 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2304185c-e706-4d23-a50b-e33f66268db2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:39.807520 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2304185c-e706-4d23-a50b-e33f66268db2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:39.808286 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2304185c-e706-4d23-a50b-e33f66268db2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:39.808722 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2304185c-e706-4d23-a50b-e33f66268db2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:39.941016 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-2304185c-e706-4d23-a50b-e33f66268db2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:39.948376 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-2304185c-e706-4d23-a50b-e33f66268db2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.152205 Mar 08 14:57:39.948940 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 435/853] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:39 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:40.044348 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-e5ae3999-eaf1-42b7-a598-da5fee140d10 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:40.045251 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-e5ae3999-eaf1-42b7-a598-da5fee140d10 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:40.051096 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e5ae3999-eaf1-42b7-a598-da5fee140d10 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:40.051488 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e5ae3999-eaf1-42b7-a598-da5fee140d10 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:40.052249 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e5ae3999-eaf1-42b7-a598-da5fee140d10 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:40.052685 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e5ae3999-eaf1-42b7-a598-da5fee140d10 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:40.081265 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-e5ae3999-eaf1-42b7-a598-da5fee140d10 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041044 Mar 08 14:57:40.082184 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 419/854] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:40 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:57:40.316706 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-fa86bebc-cba4-414b-8ae6-eddf77521eda tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:40.317220 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-fa86bebc-cba4-414b-8ae6-eddf77521eda tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:40.323109 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fa86bebc-cba4-414b-8ae6-eddf77521eda tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:40.323587 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fa86bebc-cba4-414b-8ae6-eddf77521eda tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:40.324357 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fa86bebc-cba4-414b-8ae6-eddf77521eda tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:40.324822 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fa86bebc-cba4-414b-8ae6-eddf77521eda tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:40.383377 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-fa86bebc-cba4-414b-8ae6-eddf77521eda tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:40.390983 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-fa86bebc-cba4-414b-8ae6-eddf77521eda tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078197 Mar 08 14:57:40.391544 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 436/855] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:40 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:40.504528 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-d233f1e9-cd26-449f-a624-c77161974f55 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:40.505441 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-d233f1e9-cd26-449f-a624-c77161974f55 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:40.511851 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d233f1e9-cd26-449f-a624-c77161974f55 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:40.512301 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d233f1e9-cd26-449f-a624-c77161974f55 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:40.513131 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d233f1e9-cd26-449f-a624-c77161974f55 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:40.513591 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d233f1e9-cd26-449f-a624-c77161974f55 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:40.540527 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-d233f1e9-cd26-449f-a624-c77161974f55 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039941 Mar 08 14:57:40.541065 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 420/856] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:57:40 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:57:40.966356 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f80a20b5-a21a-4dad-b8bb-05d01ded77fb tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:40.967227 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f80a20b5-a21a-4dad-b8bb-05d01ded77fb tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:40.973423 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f80a20b5-a21a-4dad-b8bb-05d01ded77fb tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:40.973900 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f80a20b5-a21a-4dad-b8bb-05d01ded77fb tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:40.974676 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f80a20b5-a21a-4dad-b8bb-05d01ded77fb tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:40.975117 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f80a20b5-a21a-4dad-b8bb-05d01ded77fb tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:41.093085 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-d4667485-277b-453b-9188-dfcd006808ca tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:41.094060 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-d4667485-277b-453b-9188-dfcd006808ca tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:41.099769 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d4667485-277b-453b-9188-dfcd006808ca tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:41.100225 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d4667485-277b-453b-9188-dfcd006808ca tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:41.101005 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d4667485-277b-453b-9188-dfcd006808ca tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:41.101450 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d4667485-277b-453b-9188-dfcd006808ca tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:41.111334 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f80a20b5-a21a-4dad-b8bb-05d01ded77fb tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:41.118616 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f80a20b5-a21a-4dad-b8bb-05d01ded77fb tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.156792 Mar 08 14:57:41.119173 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 437/857] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:40 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:41.130963 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-d4667485-277b-453b-9188-dfcd006808ca tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042427 Mar 08 14:57:41.131503 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 421/858] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:41 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:57:41.408115 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-0f953e95-793c-46bd-851f-cb84ec7ca8c1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:41.408719 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-0f953e95-793c-46bd-851f-cb84ec7ca8c1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:41.414566 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0f953e95-793c-46bd-851f-cb84ec7ca8c1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:41.415012 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0f953e95-793c-46bd-851f-cb84ec7ca8c1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:41.415771 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0f953e95-793c-46bd-851f-cb84ec7ca8c1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:41.416200 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0f953e95-793c-46bd-851f-cb84ec7ca8c1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:41.477597 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-0f953e95-793c-46bd-851f-cb84ec7ca8c1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:41.485580 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-0f953e95-793c-46bd-851f-cb84ec7ca8c1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081250 Mar 08 14:57:41.486178 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 438/859] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:41 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:41.552778 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-eea3d3d4-1fb7-4342-8816-851344876bb6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:41.553711 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-eea3d3d4-1fb7-4342-8816-851344876bb6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:41.560612 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-eea3d3d4-1fb7-4342-8816-851344876bb6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:41.561066 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-eea3d3d4-1fb7-4342-8816-851344876bb6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:41.561870 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-eea3d3d4-1fb7-4342-8816-851344876bb6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:41.562307 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-eea3d3d4-1fb7-4342-8816-851344876bb6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:41.589282 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-eea3d3d4-1fb7-4342-8816-851344876bb6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040383 Mar 08 14:57:41.589827 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 422/860] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:57:41 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:57:42.136441 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c4566500-360b-4c4f-a315-2e6f7f1efe87 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:42.137056 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-c4566500-360b-4c4f-a315-2e6f7f1efe87 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:42.142063 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-67ee6d0d-6b23-4c01-bb6b-6fa3687d3284 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:42.142966 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-67ee6d0d-6b23-4c01-bb6b-6fa3687d3284 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:42.144844 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c4566500-360b-4c4f-a315-2e6f7f1efe87 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:42.145489 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c4566500-360b-4c4f-a315-2e6f7f1efe87 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:42.146467 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c4566500-360b-4c4f-a315-2e6f7f1efe87 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:42.147085 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c4566500-360b-4c4f-a315-2e6f7f1efe87 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:42.148941 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-67ee6d0d-6b23-4c01-bb6b-6fa3687d3284 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:42.149395 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-67ee6d0d-6b23-4c01-bb6b-6fa3687d3284 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:42.150185 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-67ee6d0d-6b23-4c01-bb6b-6fa3687d3284 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:42.150620 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-67ee6d0d-6b23-4c01-bb6b-6fa3687d3284 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:42.180269 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-67ee6d0d-6b23-4c01-bb6b-6fa3687d3284 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042207 Mar 08 14:57:42.181071 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 423/861] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:42 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:57:42.287669 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-c4566500-360b-4c4f-a315-2e6f7f1efe87 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:42.295506 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-c4566500-360b-4c4f-a315-2e6f7f1efe87 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.162965 Mar 08 14:57:42.296062 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 439/862] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:42 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:42.502522 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-bc942d30-f748-4317-80d7-6b7caa96c542 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:42.503103 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-bc942d30-f748-4317-80d7-6b7caa96c542 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:42.508880 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bc942d30-f748-4317-80d7-6b7caa96c542 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:42.509335 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bc942d30-f748-4317-80d7-6b7caa96c542 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:42.510131 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bc942d30-f748-4317-80d7-6b7caa96c542 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:42.510571 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bc942d30-f748-4317-80d7-6b7caa96c542 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:42.568921 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-bc942d30-f748-4317-80d7-6b7caa96c542 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:42.576954 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-bc942d30-f748-4317-80d7-6b7caa96c542 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078349 Mar 08 14:57:42.577510 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 424/863] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:42 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:42.600850 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-53247c70-4e9e-4d12-8e67-e723992e942f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:42.601758 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-53247c70-4e9e-4d12-8e67-e723992e942f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:42.607639 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-53247c70-4e9e-4d12-8e67-e723992e942f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:42.608084 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-53247c70-4e9e-4d12-8e67-e723992e942f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:42.608847 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-53247c70-4e9e-4d12-8e67-e723992e942f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:42.609279 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-53247c70-4e9e-4d12-8e67-e723992e942f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:42.635829 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-53247c70-4e9e-4d12-8e67-e723992e942f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.038801 Mar 08 14:57:42.636363 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 440/864] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:57:42 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:57:43.192403 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-5518d652-3990-4751-85a5-f3f135833289 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:43.193267 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-5518d652-3990-4751-85a5-f3f135833289 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:43.199143 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5518d652-3990-4751-85a5-f3f135833289 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:43.199600 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5518d652-3990-4751-85a5-f3f135833289 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:43.201523 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5518d652-3990-4751-85a5-f3f135833289 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:43.202057 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5518d652-3990-4751-85a5-f3f135833289 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:43.229300 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-5518d652-3990-4751-85a5-f3f135833289 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041026 Mar 08 14:57:43.229840 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 425/865] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:43 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:57:43.313529 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-011b2c0a-cacb-448b-a324-9928f03f74f6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:43.314170 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-011b2c0a-cacb-448b-a324-9928f03f74f6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:43.320392 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-011b2c0a-cacb-448b-a324-9928f03f74f6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:43.320842 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-011b2c0a-cacb-448b-a324-9928f03f74f6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:43.321609 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-011b2c0a-cacb-448b-a324-9928f03f74f6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:43.322095 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-011b2c0a-cacb-448b-a324-9928f03f74f6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:43.465385 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-011b2c0a-cacb-448b-a324-9928f03f74f6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:43.472618 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-011b2c0a-cacb-448b-a324-9928f03f74f6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.163882 Mar 08 14:57:43.473214 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 441/866] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:43 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:43.594219 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-c05240af-5977-44f3-8c1b-75d4a6a6686c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:43.594863 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-c05240af-5977-44f3-8c1b-75d4a6a6686c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:43.600858 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c05240af-5977-44f3-8c1b-75d4a6a6686c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:43.601307 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c05240af-5977-44f3-8c1b-75d4a6a6686c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:43.602106 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c05240af-5977-44f3-8c1b-75d4a6a6686c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:43.602544 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c05240af-5977-44f3-8c1b-75d4a6a6686c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:43.647961 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f1ea7203-c6bf-46a2-8e11-55a22d617425 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:43.648871 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f1ea7203-c6bf-46a2-8e11-55a22d617425 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:43.655285 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f1ea7203-c6bf-46a2-8e11-55a22d617425 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:43.655733 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f1ea7203-c6bf-46a2-8e11-55a22d617425 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:43.656497 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f1ea7203-c6bf-46a2-8e11-55a22d617425 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:43.656934 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f1ea7203-c6bf-46a2-8e11-55a22d617425 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:43.661424 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-c05240af-5977-44f3-8c1b-75d4a6a6686c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:43.669674 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-c05240af-5977-44f3-8c1b-75d4a6a6686c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079354 Mar 08 14:57:43.670380 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 426/867] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:43 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:43.685070 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f1ea7203-c6bf-46a2-8e11-55a22d617425 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040940 Mar 08 14:57:43.685615 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 442/868] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:57:43 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:57:44.241508 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-d66b5cf2-8551-4ca3-b7ba-b11d498c7bea tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:44.242453 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-d66b5cf2-8551-4ca3-b7ba-b11d498c7bea tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:44.248608 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d66b5cf2-8551-4ca3-b7ba-b11d498c7bea tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:44.249071 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d66b5cf2-8551-4ca3-b7ba-b11d498c7bea tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:44.249920 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d66b5cf2-8551-4ca3-b7ba-b11d498c7bea tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:44.250368 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d66b5cf2-8551-4ca3-b7ba-b11d498c7bea tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:44.278819 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-d66b5cf2-8551-4ca3-b7ba-b11d498c7bea tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040894 Mar 08 14:57:44.279415 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 427/869] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:44 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:57:44.490396 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f2cafdc5-f62f-4501-819c-427199265bb8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:44.492052 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f2cafdc5-f62f-4501-819c-427199265bb8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:44.498776 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f2cafdc5-f62f-4501-819c-427199265bb8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:44.499226 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f2cafdc5-f62f-4501-819c-427199265bb8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:44.499993 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f2cafdc5-f62f-4501-819c-427199265bb8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:44.500425 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f2cafdc5-f62f-4501-819c-427199265bb8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:44.634399 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f2cafdc5-f62f-4501-819c-427199265bb8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:44.642223 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f2cafdc5-f62f-4501-819c-427199265bb8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.155714 Mar 08 14:57:44.642786 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 443/870] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:44 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:44.687082 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-df5dd19c-9212-4cb5-b023-a70e9b875e79 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:44.687694 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-df5dd19c-9212-4cb5-b023-a70e9b875e79 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:44.693960 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-df5dd19c-9212-4cb5-b023-a70e9b875e79 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:44.694425 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-df5dd19c-9212-4cb5-b023-a70e9b875e79 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:44.695194 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-df5dd19c-9212-4cb5-b023-a70e9b875e79 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:44.695636 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-df5dd19c-9212-4cb5-b023-a70e9b875e79 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:44.696220 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-bfa1e45a-543b-41e3-8605-14663521ed52 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:44.697141 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-bfa1e45a-543b-41e3-8605-14663521ed52 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:44.704117 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bfa1e45a-543b-41e3-8605-14663521ed52 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:44.704569 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bfa1e45a-543b-41e3-8605-14663521ed52 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:44.705416 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bfa1e45a-543b-41e3-8605-14663521ed52 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:44.705886 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bfa1e45a-543b-41e3-8605-14663521ed52 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:44.734554 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-bfa1e45a-543b-41e3-8605-14663521ed52 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042176 Mar 08 14:57:44.735127 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 444/871] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:57:44 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:57:44.755106 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-df5dd19c-9212-4cb5-b023-a70e9b875e79 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:44.762888 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-df5dd19c-9212-4cb5-b023-a70e9b875e79 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079345 Mar 08 14:57:44.763600 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 428/872] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:44 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:45.290831 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-fa0f0811-d8ab-4af3-a942-db627f8da6ff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:45.291768 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-fa0f0811-d8ab-4af3-a942-db627f8da6ff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:45.297950 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fa0f0811-d8ab-4af3-a942-db627f8da6ff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:45.298403 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fa0f0811-d8ab-4af3-a942-db627f8da6ff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:45.299171 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fa0f0811-d8ab-4af3-a942-db627f8da6ff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:45.299634 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fa0f0811-d8ab-4af3-a942-db627f8da6ff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:45.328084 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-fa0f0811-d8ab-4af3-a942-db627f8da6ff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041449 Mar 08 14:57:45.328625 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 445/873] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:45 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:57:45.464997 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 14:57:45.465182 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: Tue Mar 8 14:57:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 14:57:45.659068 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-4876eff9-98c6-44ab-a624-0d9fccef131f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:45.659701 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-4876eff9-98c6-44ab-a624-0d9fccef131f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:45.665446 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4876eff9-98c6-44ab-a624-0d9fccef131f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:45.665929 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4876eff9-98c6-44ab-a624-0d9fccef131f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:45.666700 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4876eff9-98c6-44ab-a624-0d9fccef131f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:45.667140 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4876eff9-98c6-44ab-a624-0d9fccef131f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:45.746092 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-6b7bf99a-35bf-49f3-ba2c-4f1c8bbc7cca tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:45.747567 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-6b7bf99a-35bf-49f3-ba2c-4f1c8bbc7cca tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:45.754048 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6b7bf99a-35bf-49f3-ba2c-4f1c8bbc7cca tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:45.754507 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6b7bf99a-35bf-49f3-ba2c-4f1c8bbc7cca tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:45.755280 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6b7bf99a-35bf-49f3-ba2c-4f1c8bbc7cca tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:45.755718 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6b7bf99a-35bf-49f3-ba2c-4f1c8bbc7cca tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:45.783854 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-6b7bf99a-35bf-49f3-ba2c-4f1c8bbc7cca tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041711 Mar 08 14:57:45.784410 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 446/874] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:57:45 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:57:45.788750 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-7c9c5123-8f11-4cda-ace8-b942f0bd0d99 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:45.789360 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-7c9c5123-8f11-4cda-ace8-b942f0bd0d99 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:45.795304 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7c9c5123-8f11-4cda-ace8-b942f0bd0d99 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:45.795754 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7c9c5123-8f11-4cda-ace8-b942f0bd0d99 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:45.796529 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7c9c5123-8f11-4cda-ace8-b942f0bd0d99 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:45.796972 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7c9c5123-8f11-4cda-ace8-b942f0bd0d99 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:45.800790 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-4876eff9-98c6-44ab-a624-0d9fccef131f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:45.808499 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-4876eff9-98c6-44ab-a624-0d9fccef131f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.153212 Mar 08 14:57:45.810063 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 429/875] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:45 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:45.855693 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-7c9c5123-8f11-4cda-ace8-b942f0bd0d99 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:45.864200 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-7c9c5123-8f11-4cda-ace8-b942f0bd0d99 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078868 Mar 08 14:57:45.864757 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 447/876] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:45 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:46.339760 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-3122ad7c-5937-4c3f-bd95-771dd6399a3e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:46.341448 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-3122ad7c-5937-4c3f-bd95-771dd6399a3e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:46.347331 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3122ad7c-5937-4c3f-bd95-771dd6399a3e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:46.347778 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3122ad7c-5937-4c3f-bd95-771dd6399a3e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:46.348537 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3122ad7c-5937-4c3f-bd95-771dd6399a3e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:46.348973 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3122ad7c-5937-4c3f-bd95-771dd6399a3e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:46.376121 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-3122ad7c-5937-4c3f-bd95-771dd6399a3e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040328 Mar 08 14:57:46.376651 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 430/877] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:46 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:57:46.795837 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ab24a361-6dbe-46c8-8636-f7dd688a0cbf tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:46.796755 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ab24a361-6dbe-46c8-8636-f7dd688a0cbf tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:46.803032 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ab24a361-6dbe-46c8-8636-f7dd688a0cbf tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:46.803486 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ab24a361-6dbe-46c8-8636-f7dd688a0cbf tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:46.804263 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ab24a361-6dbe-46c8-8636-f7dd688a0cbf tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:46.804700 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ab24a361-6dbe-46c8-8636-f7dd688a0cbf tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:46.826762 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-c1feb170-fb5e-42f4-9f25-32c058624756 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:46.827455 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-c1feb170-fb5e-42f4-9f25-32c058624756 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:46.833508 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c1feb170-fb5e-42f4-9f25-32c058624756 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:46.833663 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ab24a361-6dbe-46c8-8636-f7dd688a0cbf tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042135 Mar 08 14:57:46.833987 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c1feb170-fb5e-42f4-9f25-32c058624756 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:46.834382 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 448/878] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:57:46 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:57:46.834755 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c1feb170-fb5e-42f4-9f25-32c058624756 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:46.835191 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c1feb170-fb5e-42f4-9f25-32c058624756 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:46.881700 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d6db8f00-f0db-4a2e-8dbb-002b1bdb68b6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:46.882338 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d6db8f00-f0db-4a2e-8dbb-002b1bdb68b6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:46.888763 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d6db8f00-f0db-4a2e-8dbb-002b1bdb68b6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:46.889216 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d6db8f00-f0db-4a2e-8dbb-002b1bdb68b6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:46.890021 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d6db8f00-f0db-4a2e-8dbb-002b1bdb68b6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:46.890462 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d6db8f00-f0db-4a2e-8dbb-002b1bdb68b6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:46.953608 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d6db8f00-f0db-4a2e-8dbb-002b1bdb68b6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:46.960873 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d6db8f00-f0db-4a2e-8dbb-002b1bdb68b6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.082971 Mar 08 14:57:46.961436 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 449/879] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:46 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:57:46.979208 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-c1feb170-fb5e-42f4-9f25-32c058624756 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:46.987197 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-c1feb170-fb5e-42f4-9f25-32c058624756 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.165155 Mar 08 14:57:46.987749 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 431/880] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:46 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:57:47.388254 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-490fc323-f034-46ff-8922-c20e16be0298 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:47.389177 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-490fc323-f034-46ff-8922-c20e16be0298 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:47.395021 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-490fc323-f034-46ff-8922-c20e16be0298 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:47.395474 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-490fc323-f034-46ff-8922-c20e16be0298 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:47.396240 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-490fc323-f034-46ff-8922-c20e16be0298 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:47.396680 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-490fc323-f034-46ff-8922-c20e16be0298 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:47.425827 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-490fc323-f034-46ff-8922-c20e16be0298 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042155 Mar 08 14:57:47.426392 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 450/881] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:47 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:57:47.846019 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-57ca4563-9af3-47ce-81aa-be92a4a43e76 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:47.847351 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-57ca4563-9af3-47ce-81aa-be92a4a43e76 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:47.853405 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-57ca4563-9af3-47ce-81aa-be92a4a43e76 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:47.853887 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-57ca4563-9af3-47ce-81aa-be92a4a43e76 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:47.854665 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-57ca4563-9af3-47ce-81aa-be92a4a43e76 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:47.855107 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-57ca4563-9af3-47ce-81aa-be92a4a43e76 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:47.881961 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-57ca4563-9af3-47ce-81aa-be92a4a43e76 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040043 Mar 08 14:57:47.882505 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 432/882] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:57:47 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:57:47.977874 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-584619ce-a3a4-4891-8f55-91ef2ec21d47 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:47.978485 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-584619ce-a3a4-4891-8f55-91ef2ec21d47 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:47.985278 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-584619ce-a3a4-4891-8f55-91ef2ec21d47 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:47.985732 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-584619ce-a3a4-4891-8f55-91ef2ec21d47 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:47.986536 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-584619ce-a3a4-4891-8f55-91ef2ec21d47 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:47.986977 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-584619ce-a3a4-4891-8f55-91ef2ec21d47 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:48.003766 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-6d309f9f-74f4-4e85-9c1b-93d1c3ec0a27 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:48.004377 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-6d309f9f-74f4-4e85-9c1b-93d1c3ec0a27 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:48.010209 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6d309f9f-74f4-4e85-9c1b-93d1c3ec0a27 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:48.010623 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6d309f9f-74f4-4e85-9c1b-93d1c3ec0a27 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:48.011462 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6d309f9f-74f4-4e85-9c1b-93d1c3ec0a27 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:48.011898 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6d309f9f-74f4-4e85-9c1b-93d1c3ec0a27 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:48.048554 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-584619ce-a3a4-4891-8f55-91ef2ec21d47 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:48.056358 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-584619ce-a3a4-4891-8f55-91ef2ec21d47 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.082351 Mar 08 14:57:48.057130 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 451/883] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:47 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:48.148429 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-6d309f9f-74f4-4e85-9c1b-93d1c3ec0a27 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:48.155495 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-6d309f9f-74f4-4e85-9c1b-93d1c3ec0a27 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.155545 Mar 08 14:57:48.156058 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 433/884] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:47 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:57:48.438204 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-fdb0685b-acc0-4959-8bc4-c4ef215ea6cb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:48.439014 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-fdb0685b-acc0-4959-8bc4-c4ef215ea6cb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:48.444762 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fdb0685b-acc0-4959-8bc4-c4ef215ea6cb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:48.445240 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fdb0685b-acc0-4959-8bc4-c4ef215ea6cb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:48.446037 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fdb0685b-acc0-4959-8bc4-c4ef215ea6cb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:48.446479 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fdb0685b-acc0-4959-8bc4-c4ef215ea6cb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:48.473860 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-fdb0685b-acc0-4959-8bc4-c4ef215ea6cb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040515 Mar 08 14:57:48.474418 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 452/885] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:48 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:57:48.893574 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-4138e228-782a-419d-86a5-366ba6735cca tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:48.894524 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-4138e228-782a-419d-86a5-366ba6735cca tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:48.901059 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4138e228-782a-419d-86a5-366ba6735cca tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:48.901515 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4138e228-782a-419d-86a5-366ba6735cca tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:48.902319 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4138e228-782a-419d-86a5-366ba6735cca tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:48.903252 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4138e228-782a-419d-86a5-366ba6735cca tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:48.931318 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-4138e228-782a-419d-86a5-366ba6735cca tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041723 Mar 08 14:57:48.931864 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 434/886] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:57:48 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:57:49.073619 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-cc569f9b-3b2a-430e-97f2-4c3d3b8d6c25 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:49.074274 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-cc569f9b-3b2a-430e-97f2-4c3d3b8d6c25 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:49.081042 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cc569f9b-3b2a-430e-97f2-4c3d3b8d6c25 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:49.081640 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cc569f9b-3b2a-430e-97f2-4c3d3b8d6c25 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:49.082429 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cc569f9b-3b2a-430e-97f2-4c3d3b8d6c25 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:49.082866 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cc569f9b-3b2a-430e-97f2-4c3d3b8d6c25 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:49.142982 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-cc569f9b-3b2a-430e-97f2-4c3d3b8d6c25 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:49.150662 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-cc569f9b-3b2a-430e-97f2-4c3d3b8d6c25 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080816 Mar 08 14:57:49.151162 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 453/887] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:49 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:49.172543 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-41d6e6da-0337-44b4-9c75-e9341d7f386e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:49.173155 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-41d6e6da-0337-44b4-9c75-e9341d7f386e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:49.178977 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-41d6e6da-0337-44b4-9c75-e9341d7f386e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:49.179435 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-41d6e6da-0337-44b4-9c75-e9341d7f386e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:49.180210 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-41d6e6da-0337-44b4-9c75-e9341d7f386e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:49.180903 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-41d6e6da-0337-44b4-9c75-e9341d7f386e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:49.315744 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-41d6e6da-0337-44b4-9c75-e9341d7f386e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:49.323027 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-41d6e6da-0337-44b4-9c75-e9341d7f386e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.155071 Mar 08 14:57:49.323622 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 435/888] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:49 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:49.484614 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-6f5bdead-49db-44e4-9438-f07588ae4874 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:49.485547 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-6f5bdead-49db-44e4-9438-f07588ae4874 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:49.491387 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6f5bdead-49db-44e4-9438-f07588ae4874 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:49.491832 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6f5bdead-49db-44e4-9438-f07588ae4874 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:49.492593 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6f5bdead-49db-44e4-9438-f07588ae4874 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:49.493027 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6f5bdead-49db-44e4-9438-f07588ae4874 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:49.520251 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-6f5bdead-49db-44e4-9438-f07588ae4874 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039578 Mar 08 14:57:49.520783 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 454/889] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:49 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:57:49.943065 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-078b5717-82d1-4cad-9d12-efbb38a71e87 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:49.943972 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-078b5717-82d1-4cad-9d12-efbb38a71e87 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:49.951050 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-078b5717-82d1-4cad-9d12-efbb38a71e87 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:49.951499 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-078b5717-82d1-4cad-9d12-efbb38a71e87 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:49.952266 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-078b5717-82d1-4cad-9d12-efbb38a71e87 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:49.952706 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-078b5717-82d1-4cad-9d12-efbb38a71e87 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:49.979735 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-078b5717-82d1-4cad-9d12-efbb38a71e87 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040582 Mar 08 14:57:49.980277 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 436/890] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:57:49 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:57:50.168212 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-71b013b5-4412-40a6-9a60-56e98632a41e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:50.169999 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-71b013b5-4412-40a6-9a60-56e98632a41e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:50.176177 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-71b013b5-4412-40a6-9a60-56e98632a41e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:50.176632 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-71b013b5-4412-40a6-9a60-56e98632a41e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:50.177400 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-71b013b5-4412-40a6-9a60-56e98632a41e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:50.177885 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-71b013b5-4412-40a6-9a60-56e98632a41e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:50.237589 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-71b013b5-4412-40a6-9a60-56e98632a41e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:50.244817 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-71b013b5-4412-40a6-9a60-56e98632a41e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080514 Mar 08 14:57:50.245373 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 455/891] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:50 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:50.340929 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-ef025d30-9319-4f75-ae3c-b44707b4f21c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:50.341586 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-ef025d30-9319-4f75-ae3c-b44707b4f21c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:50.347382 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ef025d30-9319-4f75-ae3c-b44707b4f21c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:50.347836 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ef025d30-9319-4f75-ae3c-b44707b4f21c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:50.348613 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ef025d30-9319-4f75-ae3c-b44707b4f21c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:50.349055 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ef025d30-9319-4f75-ae3c-b44707b4f21c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:50.484949 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-ef025d30-9319-4f75-ae3c-b44707b4f21c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:50.492301 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-ef025d30-9319-4f75-ae3c-b44707b4f21c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.155658 Mar 08 14:57:50.492803 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 437/892] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:50 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:50.532513 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ff30c506-4ace-4465-9307-deffc5d6f817 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:50.533416 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ff30c506-4ace-4465-9307-deffc5d6f817 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:50.539243 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ff30c506-4ace-4465-9307-deffc5d6f817 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:50.539694 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ff30c506-4ace-4465-9307-deffc5d6f817 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:50.540463 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ff30c506-4ace-4465-9307-deffc5d6f817 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:50.540899 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ff30c506-4ace-4465-9307-deffc5d6f817 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:50.569101 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ff30c506-4ace-4465-9307-deffc5d6f817 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041239 Mar 08 14:57:50.569646 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 456/893] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:50 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:57:50.992000 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-411c1856-4186-4531-9242-2a9193f39b78 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:50.992904 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-411c1856-4186-4531-9242-2a9193f39b78 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:50.999921 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-411c1856-4186-4531-9242-2a9193f39b78 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:51.000365 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-411c1856-4186-4531-9242-2a9193f39b78 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:51.001118 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-411c1856-4186-4531-9242-2a9193f39b78 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:51.001551 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-411c1856-4186-4531-9242-2a9193f39b78 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:51.028319 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-411c1856-4186-4531-9242-2a9193f39b78 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040195 Mar 08 14:57:51.028843 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 438/894] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:57:50 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:57:51.267832 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-562b58fb-e767-436d-874d-c3951cb1b961 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:51.268452 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-562b58fb-e767-436d-874d-c3951cb1b961 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:51.274618 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-562b58fb-e767-436d-874d-c3951cb1b961 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:51.275074 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-562b58fb-e767-436d-874d-c3951cb1b961 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:51.275841 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-562b58fb-e767-436d-874d-c3951cb1b961 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:51.276287 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-562b58fb-e767-436d-874d-c3951cb1b961 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:51.335337 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-562b58fb-e767-436d-874d-c3951cb1b961 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:51.343118 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-562b58fb-e767-436d-874d-c3951cb1b961 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079153 Mar 08 14:57:51.343681 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 457/895] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:51 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:51.509082 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-562c0a3e-c6d0-4e40-84c3-e08b11060d9c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:51.509693 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-562c0a3e-c6d0-4e40-84c3-e08b11060d9c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:51.515861 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-562c0a3e-c6d0-4e40-84c3-e08b11060d9c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:51.516319 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-562c0a3e-c6d0-4e40-84c3-e08b11060d9c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:51.517089 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-562c0a3e-c6d0-4e40-84c3-e08b11060d9c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:51.517529 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-562c0a3e-c6d0-4e40-84c3-e08b11060d9c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:51.580987 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-09f19c8b-5c58-4c27-91db-12e699b833c7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:51.582021 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-09f19c8b-5c58-4c27-91db-12e699b833c7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:51.587819 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-09f19c8b-5c58-4c27-91db-12e699b833c7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:51.588355 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-09f19c8b-5c58-4c27-91db-12e699b833c7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:51.589123 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-09f19c8b-5c58-4c27-91db-12e699b833c7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:51.589553 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-09f19c8b-5c58-4c27-91db-12e699b833c7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:51.618559 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-09f19c8b-5c58-4c27-91db-12e699b833c7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041619 Mar 08 14:57:51.619236 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 458/896] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:51 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:57:51.653743 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-562c0a3e-c6d0-4e40-84c3-e08b11060d9c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:51.661048 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-562c0a3e-c6d0-4e40-84c3-e08b11060d9c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.155809 Mar 08 14:57:51.661622 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 439/897] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:51 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:52.040133 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-947c15e8-1632-43f5-99c8-895d0edeff48 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:52.041044 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-947c15e8-1632-43f5-99c8-895d0edeff48 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:52.047624 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-947c15e8-1632-43f5-99c8-895d0edeff48 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:52.048075 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-947c15e8-1632-43f5-99c8-895d0edeff48 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:52.048840 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-947c15e8-1632-43f5-99c8-895d0edeff48 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:52.049282 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-947c15e8-1632-43f5-99c8-895d0edeff48 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:52.076124 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-947c15e8-1632-43f5-99c8-895d0edeff48 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040026 Mar 08 14:57:52.076661 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 459/898] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:57:52 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:57:52.359944 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-90068aec-fe52-47d5-a5f8-4134419fe68f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:52.360637 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-90068aec-fe52-47d5-a5f8-4134419fe68f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:52.366895 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-90068aec-fe52-47d5-a5f8-4134419fe68f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:52.367362 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-90068aec-fe52-47d5-a5f8-4134419fe68f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:52.368137 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-90068aec-fe52-47d5-a5f8-4134419fe68f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:52.368569 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-90068aec-fe52-47d5-a5f8-4134419fe68f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:52.427316 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-90068aec-fe52-47d5-a5f8-4134419fe68f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:52.435398 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-90068aec-fe52-47d5-a5f8-4134419fe68f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079316 Mar 08 14:57:52.435961 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 440/899] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:52 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:52.630469 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-eb795fd1-53d4-44c5-b6de-17fbdcc91fc6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:52.631393 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-eb795fd1-53d4-44c5-b6de-17fbdcc91fc6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:52.638261 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-eb795fd1-53d4-44c5-b6de-17fbdcc91fc6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:52.638715 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-eb795fd1-53d4-44c5-b6de-17fbdcc91fc6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:52.639486 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-eb795fd1-53d4-44c5-b6de-17fbdcc91fc6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:52.639928 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-eb795fd1-53d4-44c5-b6de-17fbdcc91fc6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:52.667756 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-eb795fd1-53d4-44c5-b6de-17fbdcc91fc6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041199 Mar 08 14:57:52.668299 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 460/900] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:52 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:57:52.678437 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-114502a7-9965-4003-add0-614b3c50bea4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:52.679045 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-114502a7-9965-4003-add0-614b3c50bea4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:52.685578 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-114502a7-9965-4003-add0-614b3c50bea4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:52.686052 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-114502a7-9965-4003-add0-614b3c50bea4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:52.686811 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-114502a7-9965-4003-add0-614b3c50bea4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:52.687246 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-114502a7-9965-4003-add0-614b3c50bea4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:52.818628 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-114502a7-9965-4003-add0-614b3c50bea4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:52.827394 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-114502a7-9965-4003-add0-614b3c50bea4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.152802 Mar 08 14:57:52.827953 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 441/901] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:52 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:53.087925 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-8b86f5f6-78a8-41c7-837d-70523cffa125 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:53.088865 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-8b86f5f6-78a8-41c7-837d-70523cffa125 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:53.095280 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8b86f5f6-78a8-41c7-837d-70523cffa125 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:53.095726 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8b86f5f6-78a8-41c7-837d-70523cffa125 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:53.096515 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8b86f5f6-78a8-41c7-837d-70523cffa125 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:53.096983 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8b86f5f6-78a8-41c7-837d-70523cffa125 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:53.124825 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-8b86f5f6-78a8-41c7-837d-70523cffa125 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040861 Mar 08 14:57:53.125359 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 461/902] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:57:53 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:57:53.452515 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-96667b84-9eaf-454b-9541-3de4e39606de tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:53.453171 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-96667b84-9eaf-454b-9541-3de4e39606de tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:53.459381 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-96667b84-9eaf-454b-9541-3de4e39606de tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:53.459831 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-96667b84-9eaf-454b-9541-3de4e39606de tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:53.460592 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-96667b84-9eaf-454b-9541-3de4e39606de tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:53.461024 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-96667b84-9eaf-454b-9541-3de4e39606de tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:53.520612 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-96667b84-9eaf-454b-9541-3de4e39606de tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:53.528181 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-96667b84-9eaf-454b-9541-3de4e39606de tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079219 Mar 08 14:57:53.528739 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 442/903] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:53 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:53.679168 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-19fc1db2-6741-4186-9593-36d79f0f8f7f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:53.680066 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-19fc1db2-6741-4186-9593-36d79f0f8f7f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:53.686732 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-19fc1db2-6741-4186-9593-36d79f0f8f7f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:53.687182 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-19fc1db2-6741-4186-9593-36d79f0f8f7f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:53.687957 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-19fc1db2-6741-4186-9593-36d79f0f8f7f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:53.688367 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-19fc1db2-6741-4186-9593-36d79f0f8f7f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:53.716595 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-19fc1db2-6741-4186-9593-36d79f0f8f7f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041260 Mar 08 14:57:53.717063 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 462/904] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:53 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:57:53.844061 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-c29f65d5-8885-41f8-8276-963914ce2ad9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:53.844668 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-c29f65d5-8885-41f8-8276-963914ce2ad9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:53.851510 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c29f65d5-8885-41f8-8276-963914ce2ad9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:53.851965 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c29f65d5-8885-41f8-8276-963914ce2ad9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:53.852739 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c29f65d5-8885-41f8-8276-963914ce2ad9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:53.853179 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c29f65d5-8885-41f8-8276-963914ce2ad9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:53.991669 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-c29f65d5-8885-41f8-8276-963914ce2ad9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:53.999008 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-c29f65d5-8885-41f8-8276-963914ce2ad9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.158782 Mar 08 14:57:53.999572 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 443/905] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:53 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:54.136204 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ed0b2d14-291b-477a-9c3a-e74bb5deb221 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:54.137763 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ed0b2d14-291b-477a-9c3a-e74bb5deb221 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:54.144417 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ed0b2d14-291b-477a-9c3a-e74bb5deb221 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:54.144864 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ed0b2d14-291b-477a-9c3a-e74bb5deb221 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:54.146077 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ed0b2d14-291b-477a-9c3a-e74bb5deb221 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:54.146077 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ed0b2d14-291b-477a-9c3a-e74bb5deb221 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:54.174455 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ed0b2d14-291b-477a-9c3a-e74bb5deb221 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042153 Mar 08 14:57:54.175002 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 463/906] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:57:54 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:57:54.544541 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-06d56301-d1ac-4296-8b55-74197892c866 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:54.545145 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-06d56301-d1ac-4296-8b55-74197892c866 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:54.551380 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-06d56301-d1ac-4296-8b55-74197892c866 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:54.551829 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-06d56301-d1ac-4296-8b55-74197892c866 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:54.552590 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-06d56301-d1ac-4296-8b55-74197892c866 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:54.553026 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-06d56301-d1ac-4296-8b55-74197892c866 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:54.614241 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-06d56301-d1ac-4296-8b55-74197892c866 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:54.621579 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-06d56301-d1ac-4296-8b55-74197892c866 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080993 Mar 08 14:57:54.622315 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 444/907] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:54 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:54.728186 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-03323526-5bf7-46ee-9430-dbe938b536ee tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:54.729087 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-03323526-5bf7-46ee-9430-dbe938b536ee tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:54.735281 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-03323526-5bf7-46ee-9430-dbe938b536ee tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:54.735753 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-03323526-5bf7-46ee-9430-dbe938b536ee tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:54.736511 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-03323526-5bf7-46ee-9430-dbe938b536ee tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:54.736942 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-03323526-5bf7-46ee-9430-dbe938b536ee tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:54.764341 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-03323526-5bf7-46ee-9430-dbe938b536ee tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040117 Mar 08 14:57:54.764874 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 464/908] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:54 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:57:55.016409 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-8298e6e8-bc78-4240-8df9-dc6ea31197b9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:55.017020 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-8298e6e8-bc78-4240-8df9-dc6ea31197b9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:55.022938 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8298e6e8-bc78-4240-8df9-dc6ea31197b9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:55.023395 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8298e6e8-bc78-4240-8df9-dc6ea31197b9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:55.024164 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8298e6e8-bc78-4240-8df9-dc6ea31197b9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:55.024602 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8298e6e8-bc78-4240-8df9-dc6ea31197b9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:55.158849 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-8298e6e8-bc78-4240-8df9-dc6ea31197b9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:55.166102 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-8298e6e8-bc78-4240-8df9-dc6ea31197b9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.154135 Mar 08 14:57:55.166661 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 445/909] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:55 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:55.187076 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-58c1f12d-5d7f-499e-9689-db07424ea9da tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:55.188027 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-58c1f12d-5d7f-499e-9689-db07424ea9da tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:55.194167 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-58c1f12d-5d7f-499e-9689-db07424ea9da tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:55.194566 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-58c1f12d-5d7f-499e-9689-db07424ea9da tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:55.195342 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-58c1f12d-5d7f-499e-9689-db07424ea9da tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:55.195814 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-58c1f12d-5d7f-499e-9689-db07424ea9da tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:55.223180 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-58c1f12d-5d7f-499e-9689-db07424ea9da tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040872 Mar 08 14:57:55.223716 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 465/910] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:57:55 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:57:55.638596 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-8a2128d1-3544-4b78-9554-7014276caa65 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:55.639201 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-8a2128d1-3544-4b78-9554-7014276caa65 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:55.645383 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8a2128d1-3544-4b78-9554-7014276caa65 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:55.645828 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8a2128d1-3544-4b78-9554-7014276caa65 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:55.646608 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8a2128d1-3544-4b78-9554-7014276caa65 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:55.647043 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8a2128d1-3544-4b78-9554-7014276caa65 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:55.706122 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-8a2128d1-3544-4b78-9554-7014276caa65 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:55.713300 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-8a2128d1-3544-4b78-9554-7014276caa65 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078823 Mar 08 14:57:55.713859 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 446/911] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:55 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:55.775551 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-fc1c3338-d93e-40eb-aa7e-856e5a3b1782 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:55.776498 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-fc1c3338-d93e-40eb-aa7e-856e5a3b1782 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:55.783448 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fc1c3338-d93e-40eb-aa7e-856e5a3b1782 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:55.783907 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fc1c3338-d93e-40eb-aa7e-856e5a3b1782 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:55.784679 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fc1c3338-d93e-40eb-aa7e-856e5a3b1782 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:55.785119 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fc1c3338-d93e-40eb-aa7e-856e5a3b1782 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:55.813718 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-fc1c3338-d93e-40eb-aa7e-856e5a3b1782 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042178 Mar 08 14:57:55.814309 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 466/912] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:55 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:57:56.183347 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-9e388141-cd7f-45dc-b13f-d2b9ab87df26 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:56.184561 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-9e388141-cd7f-45dc-b13f-d2b9ab87df26 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:56.190753 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9e388141-cd7f-45dc-b13f-d2b9ab87df26 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:56.191211 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9e388141-cd7f-45dc-b13f-d2b9ab87df26 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:56.191982 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9e388141-cd7f-45dc-b13f-d2b9ab87df26 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:56.192419 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9e388141-cd7f-45dc-b13f-d2b9ab87df26 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:56.235740 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d31962f7-3cce-448d-b4e2-bcc0d60e2c81 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:56.236686 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d31962f7-3cce-448d-b4e2-bcc0d60e2c81 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:56.242731 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d31962f7-3cce-448d-b4e2-bcc0d60e2c81 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:56.243179 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d31962f7-3cce-448d-b4e2-bcc0d60e2c81 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:56.243940 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d31962f7-3cce-448d-b4e2-bcc0d60e2c81 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:56.244371 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d31962f7-3cce-448d-b4e2-bcc0d60e2c81 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:56.279474 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d31962f7-3cce-448d-b4e2-bcc0d60e2c81 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047620 Mar 08 14:57:56.280040 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 467/913] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:57:56 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:57:56.335447 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-9e388141-cd7f-45dc-b13f-d2b9ab87df26 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:56.342719 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-9e388141-cd7f-45dc-b13f-d2b9ab87df26 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.163597 Mar 08 14:57:56.343278 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 447/914] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:56 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:56.731218 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5321987c-bb59-4063-b106-759a048ac6e0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:56.731784 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5321987c-bb59-4063-b106-759a048ac6e0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:56.737574 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5321987c-bb59-4063-b106-759a048ac6e0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:56.738062 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5321987c-bb59-4063-b106-759a048ac6e0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:56.738830 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5321987c-bb59-4063-b106-759a048ac6e0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:56.739268 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5321987c-bb59-4063-b106-759a048ac6e0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:56.796352 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-5321987c-bb59-4063-b106-759a048ac6e0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:56.803498 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5321987c-bb59-4063-b106-759a048ac6e0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.076695 Mar 08 14:57:56.804049 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 468/915] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:56 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:56.824670 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-5c455dd2-edf2-4bd9-872b-ee16307e5416 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:56.825579 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-5c455dd2-edf2-4bd9-872b-ee16307e5416 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:56.831750 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5c455dd2-edf2-4bd9-872b-ee16307e5416 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:56.832206 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5c455dd2-edf2-4bd9-872b-ee16307e5416 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:56.832969 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5c455dd2-edf2-4bd9-872b-ee16307e5416 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:56.833406 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5c455dd2-edf2-4bd9-872b-ee16307e5416 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:56.861360 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-5c455dd2-edf2-4bd9-872b-ee16307e5416 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040727 Mar 08 14:57:56.861921 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 448/916] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:56 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:57:57.291284 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-99f639cc-4233-4eb4-b236-810a5a77ab42 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:57.292229 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-99f639cc-4233-4eb4-b236-810a5a77ab42 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:57.298697 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-99f639cc-4233-4eb4-b236-810a5a77ab42 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:57.299153 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-99f639cc-4233-4eb4-b236-810a5a77ab42 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:57.299923 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-99f639cc-4233-4eb4-b236-810a5a77ab42 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:57.300369 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-99f639cc-4233-4eb4-b236-810a5a77ab42 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:57.328016 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-99f639cc-4233-4eb4-b236-810a5a77ab42 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040950 Mar 08 14:57:57.328813 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 469/917] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:57:57 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:57:57.359877 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-f3ca69a4-447e-4480-a0e8-a414927bd702 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:57.360503 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-f3ca69a4-447e-4480-a0e8-a414927bd702 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:57.366361 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f3ca69a4-447e-4480-a0e8-a414927bd702 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:57.366818 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f3ca69a4-447e-4480-a0e8-a414927bd702 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:57.367597 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f3ca69a4-447e-4480-a0e8-a414927bd702 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:57.368043 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f3ca69a4-447e-4480-a0e8-a414927bd702 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:57.505552 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-f3ca69a4-447e-4480-a0e8-a414927bd702 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:57.513566 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-f3ca69a4-447e-4480-a0e8-a414927bd702 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.158306 Mar 08 14:57:57.514168 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 449/918] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:57 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:57.820382 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-9040d8ad-225f-45fc-873f-9f282535b14d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:57.821001 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-9040d8ad-225f-45fc-873f-9f282535b14d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:57.827977 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9040d8ad-225f-45fc-873f-9f282535b14d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:57.828437 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9040d8ad-225f-45fc-873f-9f282535b14d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:57.829211 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9040d8ad-225f-45fc-873f-9f282535b14d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:57.829657 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9040d8ad-225f-45fc-873f-9f282535b14d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:57.873322 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b8f1c012-d8d8-4248-9d56-955b2c5c5857 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:57.874291 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-b8f1c012-d8d8-4248-9d56-955b2c5c5857 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:57.880149 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b8f1c012-d8d8-4248-9d56-955b2c5c5857 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:57.880601 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b8f1c012-d8d8-4248-9d56-955b2c5c5857 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:57.881368 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b8f1c012-d8d8-4248-9d56-955b2c5c5857 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:57.881882 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b8f1c012-d8d8-4248-9d56-955b2c5c5857 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:57.891809 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-9040d8ad-225f-45fc-873f-9f282535b14d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:57.899383 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-9040d8ad-225f-45fc-873f-9f282535b14d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.082774 Mar 08 14:57:57.899972 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 470/919] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:57 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:57.910775 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-b8f1c012-d8d8-4248-9d56-955b2c5c5857 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041830 Mar 08 14:57:57.911327 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 450/920] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:57 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:57:58.340039 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f54ad540-7251-4cc7-985b-599de7b25b95 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:58.340981 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f54ad540-7251-4cc7-985b-599de7b25b95 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:58.346856 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f54ad540-7251-4cc7-985b-599de7b25b95 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:58.347306 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f54ad540-7251-4cc7-985b-599de7b25b95 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:58.348068 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f54ad540-7251-4cc7-985b-599de7b25b95 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:58.348507 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f54ad540-7251-4cc7-985b-599de7b25b95 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:58.376860 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f54ad540-7251-4cc7-985b-599de7b25b95 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040802 Mar 08 14:57:58.377407 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 471/921] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:57:58 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:57:58.530716 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-ae8e2f12-7ca5-457a-a6e6-037f5cc1fd51 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:58.531307 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-ae8e2f12-7ca5-457a-a6e6-037f5cc1fd51 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:58.537078 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ae8e2f12-7ca5-457a-a6e6-037f5cc1fd51 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:58.537530 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ae8e2f12-7ca5-457a-a6e6-037f5cc1fd51 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:58.538323 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ae8e2f12-7ca5-457a-a6e6-037f5cc1fd51 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:58.538760 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ae8e2f12-7ca5-457a-a6e6-037f5cc1fd51 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:58.677502 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-ae8e2f12-7ca5-457a-a6e6-037f5cc1fd51 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:58.685220 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-ae8e2f12-7ca5-457a-a6e6-037f5cc1fd51 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.158522 Mar 08 14:57:58.685784 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 451/922] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:58 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:58.916209 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-70a2c659-1c68-453f-af65-d7db05fd64bd tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:58.916750 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-70a2c659-1c68-453f-af65-d7db05fd64bd tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:58.922535 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-f387ba3a-0f0d-4922-8909-da32d939a9a2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:58.923446 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-f387ba3a-0f0d-4922-8909-da32d939a9a2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:58.923938 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-70a2c659-1c68-453f-af65-d7db05fd64bd tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:58.924388 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-70a2c659-1c68-453f-af65-d7db05fd64bd tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:58.925156 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-70a2c659-1c68-453f-af65-d7db05fd64bd tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:58.925594 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-70a2c659-1c68-453f-af65-d7db05fd64bd tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:58.929554 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f387ba3a-0f0d-4922-8909-da32d939a9a2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:58.930296 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f387ba3a-0f0d-4922-8909-da32d939a9a2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:58.931115 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f387ba3a-0f0d-4922-8909-da32d939a9a2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:58.931553 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f387ba3a-0f0d-4922-8909-da32d939a9a2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:58.964589 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-f387ba3a-0f0d-4922-8909-da32d939a9a2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047278 Mar 08 14:57:58.965152 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 452/923] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:58 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:57:58.986499 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-70a2c659-1c68-453f-af65-d7db05fd64bd tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:58.993687 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-70a2c659-1c68-453f-af65-d7db05fd64bd tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081407 Mar 08 14:57:58.994278 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 472/924] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:58 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:59.389186 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-68c916c0-b05e-4b3a-9498-e15b383ea97c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:59.390112 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-68c916c0-b05e-4b3a-9498-e15b383ea97c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:59.395904 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-68c916c0-b05e-4b3a-9498-e15b383ea97c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:59.396381 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-68c916c0-b05e-4b3a-9498-e15b383ea97c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:59.397143 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-68c916c0-b05e-4b3a-9498-e15b383ea97c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:59.397582 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-68c916c0-b05e-4b3a-9498-e15b383ea97c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:59.425179 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-68c916c0-b05e-4b3a-9498-e15b383ea97c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040819 Mar 08 14:57:59.425718 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 453/925] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:57:59 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:57:59.702189 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-caee9c0f-637e-4451-90ea-844740ad449b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:59.702725 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-caee9c0f-637e-4451-90ea-844740ad449b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:59.708711 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-caee9c0f-637e-4451-90ea-844740ad449b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:59.709191 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-caee9c0f-637e-4451-90ea-844740ad449b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:59.710033 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-caee9c0f-637e-4451-90ea-844740ad449b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:59.710468 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-caee9c0f-637e-4451-90ea-844740ad449b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:59.843993 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-caee9c0f-637e-4451-90ea-844740ad449b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:57:59.851141 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-caee9c0f-637e-4451-90ea-844740ad449b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.153129 Mar 08 14:57:59.851704 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 473/926] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:57:59 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:57:59.976096 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-0d956eee-39c1-4ec2-a31c-2031d6f2e6e7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:57:59.977003 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-0d956eee-39c1-4ec2-a31c-2031d6f2e6e7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:57:59.983934 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0d956eee-39c1-4ec2-a31c-2031d6f2e6e7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:59.984380 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0d956eee-39c1-4ec2-a31c-2031d6f2e6e7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:57:59.985143 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0d956eee-39c1-4ec2-a31c-2031d6f2e6e7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:57:59.985577 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0d956eee-39c1-4ec2-a31c-2031d6f2e6e7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:00.011082 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-9572eeae-fc7b-4335-9a3d-f77728360495 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:00.011784 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-9572eeae-fc7b-4335-9a3d-f77728360495 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:00.013551 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-0d956eee-39c1-4ec2-a31c-2031d6f2e6e7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041393 Mar 08 14:58:00.014130 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 454/927] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:57:59 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:58:00.018180 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9572eeae-fc7b-4335-9a3d-f77728360495 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:00.018644 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9572eeae-fc7b-4335-9a3d-f77728360495 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:00.019524 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9572eeae-fc7b-4335-9a3d-f77728360495 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:00.019967 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9572eeae-fc7b-4335-9a3d-f77728360495 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:00.079187 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-9572eeae-fc7b-4335-9a3d-f77728360495 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:00.087791 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-9572eeae-fc7b-4335-9a3d-f77728360495 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080385 Mar 08 14:58:00.094013 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 474/928] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:00 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:58:00.437670 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-06929d56-5191-45fb-85e8-40390d72c2b5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:00.438544 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-06929d56-5191-45fb-85e8-40390d72c2b5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:00.444413 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-06929d56-5191-45fb-85e8-40390d72c2b5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:00.444871 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-06929d56-5191-45fb-85e8-40390d72c2b5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:00.445634 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-06929d56-5191-45fb-85e8-40390d72c2b5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:00.446101 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-06929d56-5191-45fb-85e8-40390d72c2b5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:00.472823 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-06929d56-5191-45fb-85e8-40390d72c2b5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039959 Mar 08 14:58:00.473362 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 455/929] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:00 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:58:00.868599 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-397c3ed2-be81-46ee-9a2b-e3de4834a7a2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:00.869207 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-397c3ed2-be81-46ee-9a2b-e3de4834a7a2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:00.875056 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-397c3ed2-be81-46ee-9a2b-e3de4834a7a2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:00.875505 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-397c3ed2-be81-46ee-9a2b-e3de4834a7a2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:00.876265 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-397c3ed2-be81-46ee-9a2b-e3de4834a7a2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:00.876694 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-397c3ed2-be81-46ee-9a2b-e3de4834a7a2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:01.013533 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-397c3ed2-be81-46ee-9a2b-e3de4834a7a2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:01.021359 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-397c3ed2-be81-46ee-9a2b-e3de4834a7a2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.156578 Mar 08 14:58:01.021940 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 475/930] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:00 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:01.024573 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-61243fd2-a292-4f99-a66b-6bb237208a8f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:01.025489 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-61243fd2-a292-4f99-a66b-6bb237208a8f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:01.032468 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-61243fd2-a292-4f99-a66b-6bb237208a8f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:01.032932 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-61243fd2-a292-4f99-a66b-6bb237208a8f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:01.033709 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-61243fd2-a292-4f99-a66b-6bb237208a8f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:01.034181 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-61243fd2-a292-4f99-a66b-6bb237208a8f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:01.062288 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-61243fd2-a292-4f99-a66b-6bb237208a8f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041641 Mar 08 14:58:01.062857 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 456/931] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:01 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:58:01.104304 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ba631d19-4ebd-47c5-b532-2fd5f0ff9468 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:01.104905 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ba631d19-4ebd-47c5-b532-2fd5f0ff9468 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:01.111396 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ba631d19-4ebd-47c5-b532-2fd5f0ff9468 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:01.111845 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ba631d19-4ebd-47c5-b532-2fd5f0ff9468 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:01.112609 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ba631d19-4ebd-47c5-b532-2fd5f0ff9468 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:01.113039 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ba631d19-4ebd-47c5-b532-2fd5f0ff9468 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:01.170982 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ba631d19-4ebd-47c5-b532-2fd5f0ff9468 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:01.178094 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ba631d19-4ebd-47c5-b532-2fd5f0ff9468 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.077560 Mar 08 14:58:01.178640 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 476/932] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:01 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:01.484431 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-f0999a29-e79c-45ee-b15a-b9ec9a7a9b7a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:01.485342 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-f0999a29-e79c-45ee-b15a-b9ec9a7a9b7a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:01.491311 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f0999a29-e79c-45ee-b15a-b9ec9a7a9b7a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:01.491766 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f0999a29-e79c-45ee-b15a-b9ec9a7a9b7a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:01.492530 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f0999a29-e79c-45ee-b15a-b9ec9a7a9b7a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:01.492973 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f0999a29-e79c-45ee-b15a-b9ec9a7a9b7a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:01.520238 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-f0999a29-e79c-45ee-b15a-b9ec9a7a9b7a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039913 Mar 08 14:58:01.520774 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 457/933] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:01 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:58:02.039317 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-7b62cbfa-b3cf-4618-906b-5a781a58abc5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:02.039951 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-7b62cbfa-b3cf-4618-906b-5a781a58abc5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:02.046835 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7b62cbfa-b3cf-4618-906b-5a781a58abc5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:02.047284 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7b62cbfa-b3cf-4618-906b-5a781a58abc5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:02.048043 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7b62cbfa-b3cf-4618-906b-5a781a58abc5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:02.048473 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7b62cbfa-b3cf-4618-906b-5a781a58abc5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:02.073947 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-a92400ad-60b2-4b5a-9207-a32688a131a7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:02.074813 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-a92400ad-60b2-4b5a-9207-a32688a131a7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:02.081834 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a92400ad-60b2-4b5a-9207-a32688a131a7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:02.082515 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a92400ad-60b2-4b5a-9207-a32688a131a7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:02.083484 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a92400ad-60b2-4b5a-9207-a32688a131a7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:02.083929 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a92400ad-60b2-4b5a-9207-a32688a131a7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:02.112531 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-a92400ad-60b2-4b5a-9207-a32688a131a7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042588 Mar 08 14:58:02.113360 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 458/934] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:02 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:58:02.184196 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-7b62cbfa-b3cf-4618-906b-5a781a58abc5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:02.192328 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-7b62cbfa-b3cf-4618-906b-5a781a58abc5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.156796 Mar 08 14:58:02.192887 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 477/935] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:02 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:02.195209 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-39f34597-e12b-4e6c-9876-725de9311d3d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:02.195818 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-39f34597-e12b-4e6c-9876-725de9311d3d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:02.202308 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-39f34597-e12b-4e6c-9876-725de9311d3d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:02.202760 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-39f34597-e12b-4e6c-9876-725de9311d3d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:02.203523 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-39f34597-e12b-4e6c-9876-725de9311d3d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:02.203958 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-39f34597-e12b-4e6c-9876-725de9311d3d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:02.263272 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-39f34597-e12b-4e6c-9876-725de9311d3d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:02.270624 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-39f34597-e12b-4e6c-9876-725de9311d3d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079228 Mar 08 14:58:02.271188 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 459/936] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:02 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:58:02.532102 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-2b2f4f12-e534-4ac8-8f1e-914e6b2001b3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:02.533046 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-2b2f4f12-e534-4ac8-8f1e-914e6b2001b3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:02.538882 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2b2f4f12-e534-4ac8-8f1e-914e6b2001b3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:02.539332 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2b2f4f12-e534-4ac8-8f1e-914e6b2001b3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:02.540104 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2b2f4f12-e534-4ac8-8f1e-914e6b2001b3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:02.540537 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2b2f4f12-e534-4ac8-8f1e-914e6b2001b3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:02.568571 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-2b2f4f12-e534-4ac8-8f1e-914e6b2001b3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040848 Mar 08 14:58:02.569128 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 478/937] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:02 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:58:03.124805 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-ba354dee-3f0b-404e-ac89-da343e87dd79 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:03.125707 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-ba354dee-3f0b-404e-ac89-da343e87dd79 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:03.131954 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ba354dee-3f0b-404e-ac89-da343e87dd79 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:03.132404 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ba354dee-3f0b-404e-ac89-da343e87dd79 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:03.133163 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ba354dee-3f0b-404e-ac89-da343e87dd79 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:03.133597 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ba354dee-3f0b-404e-ac89-da343e87dd79 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:03.161542 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-ba354dee-3f0b-404e-ac89-da343e87dd79 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041355 Mar 08 14:58:03.162114 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 460/938] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:03 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:58:03.209591 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-4bee5f48-cd51-4891-bf90-945298a8abc8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:03.210232 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-4bee5f48-cd51-4891-bf90-945298a8abc8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:03.216744 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4bee5f48-cd51-4891-bf90-945298a8abc8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:03.217197 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4bee5f48-cd51-4891-bf90-945298a8abc8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:03.218013 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4bee5f48-cd51-4891-bf90-945298a8abc8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:03.218460 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4bee5f48-cd51-4891-bf90-945298a8abc8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:03.287627 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b96a2c09-335f-476d-b0d8-42a33612e6a9 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:03.288267 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-b96a2c09-335f-476d-b0d8-42a33612e6a9 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:03.294009 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b96a2c09-335f-476d-b0d8-42a33612e6a9 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:03.294465 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b96a2c09-335f-476d-b0d8-42a33612e6a9 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:03.295274 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b96a2c09-335f-476d-b0d8-42a33612e6a9 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:03.295718 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b96a2c09-335f-476d-b0d8-42a33612e6a9 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:03.359681 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-b96a2c09-335f-476d-b0d8-42a33612e6a9 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:03.367544 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-b96a2c09-335f-476d-b0d8-42a33612e6a9 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.083735 Mar 08 14:58:03.368124 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 461/939] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:03 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:58:03.373199 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-4bee5f48-cd51-4891-bf90-945298a8abc8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:03.380573 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-4bee5f48-cd51-4891-bf90-945298a8abc8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.174860 Mar 08 14:58:03.381240 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 479/940] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:03 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:03.580472 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-400e7662-b025-4e43-87a0-89194b425514 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:03.581407 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-400e7662-b025-4e43-87a0-89194b425514 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:03.587420 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-400e7662-b025-4e43-87a0-89194b425514 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:03.587879 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-400e7662-b025-4e43-87a0-89194b425514 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:03.588659 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-400e7662-b025-4e43-87a0-89194b425514 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:03.589099 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-400e7662-b025-4e43-87a0-89194b425514 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:03.617910 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-400e7662-b025-4e43-87a0-89194b425514 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041584 Mar 08 14:58:03.618481 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 462/941] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:03 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:58:04.173953 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-e2753f95-212e-4422-b749-29ca600a6250 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:04.174856 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-e2753f95-212e-4422-b749-29ca600a6250 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:04.180954 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e2753f95-212e-4422-b749-29ca600a6250 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:04.181399 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e2753f95-212e-4422-b749-29ca600a6250 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:04.182202 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e2753f95-212e-4422-b749-29ca600a6250 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:04.182637 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e2753f95-212e-4422-b749-29ca600a6250 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:04.211485 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-e2753f95-212e-4422-b749-29ca600a6250 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042906 Mar 08 14:58:04.212122 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 480/942] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:04 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:58:04.386300 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-e38e5b9e-a70b-4bcc-b191-12e228237fa2 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:04.386854 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-e38e5b9e-a70b-4bcc-b191-12e228237fa2 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:04.393700 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e38e5b9e-a70b-4bcc-b191-12e228237fa2 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:04.394190 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e38e5b9e-a70b-4bcc-b191-12e228237fa2 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:04.394972 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e38e5b9e-a70b-4bcc-b191-12e228237fa2 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:04.395415 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e38e5b9e-a70b-4bcc-b191-12e228237fa2 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:04.398207 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-89c9ee13-56dd-4780-9e3b-d0b8f0dcbba0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:04.398810 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-89c9ee13-56dd-4780-9e3b-d0b8f0dcbba0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:04.406292 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-89c9ee13-56dd-4780-9e3b-d0b8f0dcbba0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:04.406742 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-89c9ee13-56dd-4780-9e3b-d0b8f0dcbba0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:04.407510 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-89c9ee13-56dd-4780-9e3b-d0b8f0dcbba0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:04.407971 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-89c9ee13-56dd-4780-9e3b-d0b8f0dcbba0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:04.461753 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-e38e5b9e-a70b-4bcc-b191-12e228237fa2 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:04.470557 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-e38e5b9e-a70b-4bcc-b191-12e228237fa2 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.088185 Mar 08 14:58:04.471331 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 463/943] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:04 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:04.542856 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-89c9ee13-56dd-4780-9e3b-d0b8f0dcbba0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:04.550244 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-89c9ee13-56dd-4780-9e3b-d0b8f0dcbba0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.156177 Mar 08 14:58:04.550800 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 481/944] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:04 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:58:04.629269 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-3efa4a16-1fb0-42c4-a6b1-0cead4e9543b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:04.630209 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-3efa4a16-1fb0-42c4-a6b1-0cead4e9543b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:04.635955 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3efa4a16-1fb0-42c4-a6b1-0cead4e9543b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:04.636455 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3efa4a16-1fb0-42c4-a6b1-0cead4e9543b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:04.637164 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3efa4a16-1fb0-42c4-a6b1-0cead4e9543b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:04.638306 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3efa4a16-1fb0-42c4-a6b1-0cead4e9543b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:04.665535 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-3efa4a16-1fb0-42c4-a6b1-0cead4e9543b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040185 Mar 08 14:58:04.666109 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 464/945] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:04 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:58:05.223347 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-e2afbfa8-8b58-4914-a599-792a45732c3a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:05.224171 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-e2afbfa8-8b58-4914-a599-792a45732c3a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:05.230014 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e2afbfa8-8b58-4914-a599-792a45732c3a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:05.230460 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e2afbfa8-8b58-4914-a599-792a45732c3a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:05.231219 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e2afbfa8-8b58-4914-a599-792a45732c3a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:05.231647 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e2afbfa8-8b58-4914-a599-792a45732c3a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:05.260854 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-e2afbfa8-8b58-4914-a599-792a45732c3a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041584 Mar 08 14:58:05.261403 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 482/946] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:05 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:58:05.488076 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-070e98c3-ece2-477b-be61-21a0843517ce tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:05.488689 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-070e98c3-ece2-477b-be61-21a0843517ce tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:05.494997 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-070e98c3-ece2-477b-be61-21a0843517ce tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:05.495444 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-070e98c3-ece2-477b-be61-21a0843517ce tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:05.496202 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-070e98c3-ece2-477b-be61-21a0843517ce tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:05.496642 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-070e98c3-ece2-477b-be61-21a0843517ce tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:05.555520 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-070e98c3-ece2-477b-be61-21a0843517ce tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:05.562983 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-070e98c3-ece2-477b-be61-21a0843517ce tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079296 Mar 08 14:58:05.563692 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 465/947] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:05 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:05.567769 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5fbf1366-809a-4887-8379-1a7a72c8990d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:05.568396 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5fbf1366-809a-4887-8379-1a7a72c8990d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:05.574535 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5fbf1366-809a-4887-8379-1a7a72c8990d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:05.574991 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5fbf1366-809a-4887-8379-1a7a72c8990d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:05.575761 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5fbf1366-809a-4887-8379-1a7a72c8990d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:05.576203 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5fbf1366-809a-4887-8379-1a7a72c8990d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:05.677043 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-ede1221f-b664-4c83-920b-3b3aa548d125 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:05.677982 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-ede1221f-b664-4c83-920b-3b3aa548d125 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:05.684054 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ede1221f-b664-4c83-920b-3b3aa548d125 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:05.684510 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ede1221f-b664-4c83-920b-3b3aa548d125 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:05.685286 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ede1221f-b664-4c83-920b-3b3aa548d125 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:05.685829 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ede1221f-b664-4c83-920b-3b3aa548d125 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:05.712929 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-5fbf1366-809a-4887-8379-1a7a72c8990d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:05.714711 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-ede1221f-b664-4c83-920b-3b3aa548d125 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041535 Mar 08 14:58:05.715271 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 466/948] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:05 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:58:05.721138 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5fbf1366-809a-4887-8379-1a7a72c8990d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.157135 Mar 08 14:58:05.721692 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 483/949] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:05 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:58:06.273072 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-87a45996-759c-4042-9b95-9de7e684cdbf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:06.274002 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-87a45996-759c-4042-9b95-9de7e684cdbf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:06.280158 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-87a45996-759c-4042-9b95-9de7e684cdbf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:06.280621 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-87a45996-759c-4042-9b95-9de7e684cdbf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:06.281436 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-87a45996-759c-4042-9b95-9de7e684cdbf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:06.281996 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-87a45996-759c-4042-9b95-9de7e684cdbf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:06.316055 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-87a45996-759c-4042-9b95-9de7e684cdbf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046939 Mar 08 14:58:06.316606 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 467/950] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:06 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:58:06.580108 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-a3f735b7-7962-491a-99e0-a1b50f6fa360 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:06.580646 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-a3f735b7-7962-491a-99e0-a1b50f6fa360 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:06.586500 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a3f735b7-7962-491a-99e0-a1b50f6fa360 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:06.586950 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a3f735b7-7962-491a-99e0-a1b50f6fa360 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:06.587716 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a3f735b7-7962-491a-99e0-a1b50f6fa360 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:06.588148 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a3f735b7-7962-491a-99e0-a1b50f6fa360 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:06.646227 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-a3f735b7-7962-491a-99e0-a1b50f6fa360 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:06.653300 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-a3f735b7-7962-491a-99e0-a1b50f6fa360 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.077518 Mar 08 14:58:06.653847 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 484/951] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:06 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:06.726777 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-0d266237-1004-4dd4-a90f-aec62725c1f0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:06.727715 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-0d266237-1004-4dd4-a90f-aec62725c1f0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:06.734597 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0d266237-1004-4dd4-a90f-aec62725c1f0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:06.735106 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0d266237-1004-4dd4-a90f-aec62725c1f0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:06.735877 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0d266237-1004-4dd4-a90f-aec62725c1f0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:06.736317 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0d266237-1004-4dd4-a90f-aec62725c1f0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:06.738610 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-bd127561-aba3-45b2-a75f-4eb50beea6e7 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:06.739217 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-bd127561-aba3-45b2-a75f-4eb50beea6e7 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:06.744874 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bd127561-aba3-45b2-a75f-4eb50beea6e7 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:06.745321 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bd127561-aba3-45b2-a75f-4eb50beea6e7 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:06.746121 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bd127561-aba3-45b2-a75f-4eb50beea6e7 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:06.746557 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bd127561-aba3-45b2-a75f-4eb50beea6e7 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:06.765523 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-0d266237-1004-4dd4-a90f-aec62725c1f0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042616 Mar 08 14:58:06.766105 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 468/952] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:06 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:58:06.877531 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-bd127561-aba3-45b2-a75f-4eb50beea6e7 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:06.884743 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-bd127561-aba3-45b2-a75f-4eb50beea6e7 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.150268 Mar 08 14:58:06.885297 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 485/953] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:06 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:58:07.328344 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-562baade-2466-4340-8a90-74127f376c20 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:07.329245 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-562baade-2466-4340-8a90-74127f376c20 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:07.335194 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-562baade-2466-4340-8a90-74127f376c20 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:07.335652 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-562baade-2466-4340-8a90-74127f376c20 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:07.336455 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-562baade-2466-4340-8a90-74127f376c20 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:07.337051 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-562baade-2466-4340-8a90-74127f376c20 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:07.365253 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-562baade-2466-4340-8a90-74127f376c20 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041515 Mar 08 14:58:07.365801 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 469/954] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:07 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:58:07.670832 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-881b3d84-4afa-4d82-a865-312fd3914b9b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:07.671493 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-881b3d84-4afa-4d82-a865-312fd3914b9b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:07.677814 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-881b3d84-4afa-4d82-a865-312fd3914b9b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:07.678301 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-881b3d84-4afa-4d82-a865-312fd3914b9b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:07.679075 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-881b3d84-4afa-4d82-a865-312fd3914b9b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:07.679514 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-881b3d84-4afa-4d82-a865-312fd3914b9b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:07.742103 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-881b3d84-4afa-4d82-a865-312fd3914b9b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:07.750314 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-881b3d84-4afa-4d82-a865-312fd3914b9b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.083773 Mar 08 14:58:07.750880 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 486/955] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:07 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:07.776430 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-abbf8ee7-227d-461e-ab32-624d0d767265 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:07.777366 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-abbf8ee7-227d-461e-ab32-624d0d767265 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:07.783762 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-abbf8ee7-227d-461e-ab32-624d0d767265 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:07.784212 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-abbf8ee7-227d-461e-ab32-624d0d767265 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:07.784972 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-abbf8ee7-227d-461e-ab32-624d0d767265 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:07.785406 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-abbf8ee7-227d-461e-ab32-624d0d767265 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:07.812514 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-abbf8ee7-227d-461e-ab32-624d0d767265 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039994 Mar 08 14:58:07.813050 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 470/956] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:07 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:58:07.900651 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-67ef3e01-d10b-4847-b8d8-87ce50c96f1c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:07.901264 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-67ef3e01-d10b-4847-b8d8-87ce50c96f1c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:07.907402 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-67ef3e01-d10b-4847-b8d8-87ce50c96f1c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:07.907849 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-67ef3e01-d10b-4847-b8d8-87ce50c96f1c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:07.908613 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-67ef3e01-d10b-4847-b8d8-87ce50c96f1c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:07.909049 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-67ef3e01-d10b-4847-b8d8-87ce50c96f1c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:08.043573 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-67ef3e01-d10b-4847-b8d8-87ce50c96f1c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:08.051334 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-67ef3e01-d10b-4847-b8d8-87ce50c96f1c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.154475 Mar 08 14:58:08.051896 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 487/957] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:07 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:08.377778 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-0c665f63-0dad-4408-90e5-417d03a22c68 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:08.378628 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-0c665f63-0dad-4408-90e5-417d03a22c68 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:08.384410 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0c665f63-0dad-4408-90e5-417d03a22c68 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:08.384853 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0c665f63-0dad-4408-90e5-417d03a22c68 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:08.385609 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0c665f63-0dad-4408-90e5-417d03a22c68 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:08.386079 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0c665f63-0dad-4408-90e5-417d03a22c68 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:08.413681 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-0c665f63-0dad-4408-90e5-417d03a22c68 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040956 Mar 08 14:58:08.414254 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 471/958] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:08 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:58:08.766903 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-73203d2c-9ddc-48e2-a13c-f289b37f1142 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:08.767508 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-73203d2c-9ddc-48e2-a13c-f289b37f1142 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:08.773597 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-73203d2c-9ddc-48e2-a13c-f289b37f1142 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:08.774087 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-73203d2c-9ddc-48e2-a13c-f289b37f1142 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:08.774850 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-73203d2c-9ddc-48e2-a13c-f289b37f1142 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:08.775382 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-73203d2c-9ddc-48e2-a13c-f289b37f1142 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:08.824289 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-d1ba6551-a6d4-4dac-ae17-782ed3caddf0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:08.825331 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-d1ba6551-a6d4-4dac-ae17-782ed3caddf0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:08.832172 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d1ba6551-a6d4-4dac-ae17-782ed3caddf0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:08.832631 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d1ba6551-a6d4-4dac-ae17-782ed3caddf0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:08.833429 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d1ba6551-a6d4-4dac-ae17-782ed3caddf0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:08.834419 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d1ba6551-a6d4-4dac-ae17-782ed3caddf0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:08.868412 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-d1ba6551-a6d4-4dac-ae17-782ed3caddf0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048019 Mar 08 14:58:08.869022 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 472/959] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:08 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:58:08.986388 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-73203d2c-9ddc-48e2-a13c-f289b37f1142 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:08.994167 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-73203d2c-9ddc-48e2-a13c-f289b37f1142 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.231249 Mar 08 14:58:08.994732 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 488/960] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:08 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:09.068651 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-45ed1ce1-156e-42f5-a0c8-95ab431defa2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:09.069179 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-45ed1ce1-156e-42f5-a0c8-95ab431defa2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:09.075433 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-45ed1ce1-156e-42f5-a0c8-95ab431defa2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:09.075894 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-45ed1ce1-156e-42f5-a0c8-95ab431defa2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:09.076684 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-45ed1ce1-156e-42f5-a0c8-95ab431defa2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:09.077118 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-45ed1ce1-156e-42f5-a0c8-95ab431defa2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:09.310997 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-45ed1ce1-156e-42f5-a0c8-95ab431defa2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:09.318210 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-45ed1ce1-156e-42f5-a0c8-95ab431defa2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.253523 Mar 08 14:58:09.318837 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 473/961] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:09 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:09.425345 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5f235bb9-c1dd-40fd-97bd-4b72f15fd0bb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:09.426283 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5f235bb9-c1dd-40fd-97bd-4b72f15fd0bb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:09.432546 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5f235bb9-c1dd-40fd-97bd-4b72f15fd0bb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:09.432996 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5f235bb9-c1dd-40fd-97bd-4b72f15fd0bb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:09.433765 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5f235bb9-c1dd-40fd-97bd-4b72f15fd0bb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:09.434805 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5f235bb9-c1dd-40fd-97bd-4b72f15fd0bb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:09.462839 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5f235bb9-c1dd-40fd-97bd-4b72f15fd0bb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041449 Mar 08 14:58:09.463623 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 489/962] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:09 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:58:09.880073 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-d760fac3-3b83-4755-ae70-407ed0d0b26b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:09.880980 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-d760fac3-3b83-4755-ae70-407ed0d0b26b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:09.887175 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d760fac3-3b83-4755-ae70-407ed0d0b26b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:09.887630 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d760fac3-3b83-4755-ae70-407ed0d0b26b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:09.888394 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d760fac3-3b83-4755-ae70-407ed0d0b26b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:09.889428 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d760fac3-3b83-4755-ae70-407ed0d0b26b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:09.916094 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-d760fac3-3b83-4755-ae70-407ed0d0b26b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039973 Mar 08 14:58:09.916624 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 474/963] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:09 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:58:10.011568 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ca730fd4-f006-41b7-b793-e6eedc9aad73 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:10.012185 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ca730fd4-f006-41b7-b793-e6eedc9aad73 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:10.019155 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ca730fd4-f006-41b7-b793-e6eedc9aad73 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:10.019617 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ca730fd4-f006-41b7-b793-e6eedc9aad73 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:10.020393 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ca730fd4-f006-41b7-b793-e6eedc9aad73 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:10.020837 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ca730fd4-f006-41b7-b793-e6eedc9aad73 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:10.080168 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ca730fd4-f006-41b7-b793-e6eedc9aad73 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:10.088365 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ca730fd4-f006-41b7-b793-e6eedc9aad73 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080496 Mar 08 14:58:10.088975 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 490/964] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:10 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:10.334698 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-3e46d829-e380-4f20-9578-d89dd3f96bf9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:10.335286 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-3e46d829-e380-4f20-9578-d89dd3f96bf9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:10.341205 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3e46d829-e380-4f20-9578-d89dd3f96bf9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:10.342080 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3e46d829-e380-4f20-9578-d89dd3f96bf9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:10.343028 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3e46d829-e380-4f20-9578-d89dd3f96bf9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:10.343464 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3e46d829-e380-4f20-9578-d89dd3f96bf9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:10.474129 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-02521d9d-10b4-49c5-a946-b53e43791631 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:10.475036 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-02521d9d-10b4-49c5-a946-b53e43791631 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:10.479622 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-3e46d829-e380-4f20-9578-d89dd3f96bf9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:10.480762 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-02521d9d-10b4-49c5-a946-b53e43791631 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:10.481211 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-02521d9d-10b4-49c5-a946-b53e43791631 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:10.482015 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-02521d9d-10b4-49c5-a946-b53e43791631 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:10.483121 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-02521d9d-10b4-49c5-a946-b53e43791631 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:10.487992 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-3e46d829-e380-4f20-9578-d89dd3f96bf9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.157114 Mar 08 14:58:10.488662 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 475/965] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:10 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:10.511000 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-02521d9d-10b4-49c5-a946-b53e43791631 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040919 Mar 08 14:58:10.511525 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 491/966] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:10 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:58:10.926792 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-2b1262da-2a0d-48c3-af55-5ba7766561dc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:10.927699 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-2b1262da-2a0d-48c3-af55-5ba7766561dc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:10.934172 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2b1262da-2a0d-48c3-af55-5ba7766561dc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:10.934630 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2b1262da-2a0d-48c3-af55-5ba7766561dc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:10.935399 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2b1262da-2a0d-48c3-af55-5ba7766561dc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:10.935927 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2b1262da-2a0d-48c3-af55-5ba7766561dc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:10.964005 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-2b1262da-2a0d-48c3-af55-5ba7766561dc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041116 Mar 08 14:58:10.964553 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 476/967] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:10 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:58:11.105291 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-909175c9-23ae-4816-b1c6-5def6f0c1e39 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:11.105941 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-909175c9-23ae-4816-b1c6-5def6f0c1e39 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:11.112363 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-909175c9-23ae-4816-b1c6-5def6f0c1e39 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:11.112817 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-909175c9-23ae-4816-b1c6-5def6f0c1e39 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:11.113587 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-909175c9-23ae-4816-b1c6-5def6f0c1e39 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:11.114061 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-909175c9-23ae-4816-b1c6-5def6f0c1e39 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:11.176038 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-909175c9-23ae-4816-b1c6-5def6f0c1e39 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:11.183581 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-909175c9-23ae-4816-b1c6-5def6f0c1e39 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.082113 Mar 08 14:58:11.184070 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 492/968] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:11 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:11.504798 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-f38a165e-853c-4f5f-9e6c-bb77648402db tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:11.505402 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-f38a165e-853c-4f5f-9e6c-bb77648402db tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:11.511186 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f38a165e-853c-4f5f-9e6c-bb77648402db tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:11.511638 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f38a165e-853c-4f5f-9e6c-bb77648402db tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:11.512393 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f38a165e-853c-4f5f-9e6c-bb77648402db tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:11.512831 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f38a165e-853c-4f5f-9e6c-bb77648402db tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:11.521662 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-73dcabb9-b4db-49e4-b634-ea7a5305a71d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:11.522606 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-73dcabb9-b4db-49e4-b634-ea7a5305a71d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:11.528300 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-73dcabb9-b4db-49e4-b634-ea7a5305a71d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:11.528748 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-73dcabb9-b4db-49e4-b634-ea7a5305a71d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:11.529617 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-73dcabb9-b4db-49e4-b634-ea7a5305a71d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:11.530082 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-73dcabb9-b4db-49e4-b634-ea7a5305a71d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:11.558472 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-73dcabb9-b4db-49e4-b634-ea7a5305a71d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040747 Mar 08 14:58:11.559027 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 493/969] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:11 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:58:11.645501 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-f38a165e-853c-4f5f-9e6c-bb77648402db tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:11.652759 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-f38a165e-853c-4f5f-9e6c-bb77648402db tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.151813 Mar 08 14:58:11.653323 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 477/970] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:11 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:11.976205 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-e3d167ae-0636-4659-8fb1-0faede3f6d85 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:11.977117 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-e3d167ae-0636-4659-8fb1-0faede3f6d85 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:11.983579 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e3d167ae-0636-4659-8fb1-0faede3f6d85 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:11.984026 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e3d167ae-0636-4659-8fb1-0faede3f6d85 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:11.984794 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e3d167ae-0636-4659-8fb1-0faede3f6d85 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:11.985231 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e3d167ae-0636-4659-8fb1-0faede3f6d85 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:12.012946 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-e3d167ae-0636-4659-8fb1-0faede3f6d85 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040729 Mar 08 14:58:12.013501 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 494/971] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:11 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:58:12.200855 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-87d9e726-0f91-48a0-a38b-35c02f86845f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:12.201465 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-87d9e726-0f91-48a0-a38b-35c02f86845f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:12.208267 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-87d9e726-0f91-48a0-a38b-35c02f86845f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:12.208721 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-87d9e726-0f91-48a0-a38b-35c02f86845f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:12.209496 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-87d9e726-0f91-48a0-a38b-35c02f86845f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:12.209963 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-87d9e726-0f91-48a0-a38b-35c02f86845f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:12.272825 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-87d9e726-0f91-48a0-a38b-35c02f86845f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:12.281126 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-87d9e726-0f91-48a0-a38b-35c02f86845f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.083211 Mar 08 14:58:12.281692 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 478/972] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:12 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:12.570400 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-a8cdd6c5-a8c4-4c84-9156-46e7d15d57fd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:12.571312 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-a8cdd6c5-a8c4-4c84-9156-46e7d15d57fd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:12.578224 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a8cdd6c5-a8c4-4c84-9156-46e7d15d57fd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:12.578671 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a8cdd6c5-a8c4-4c84-9156-46e7d15d57fd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:12.579435 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a8cdd6c5-a8c4-4c84-9156-46e7d15d57fd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:12.579865 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a8cdd6c5-a8c4-4c84-9156-46e7d15d57fd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:12.607426 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-a8cdd6c5-a8c4-4c84-9156-46e7d15d57fd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040958 Mar 08 14:58:12.608009 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 495/973] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:12 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:58:12.669966 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-deb140fc-e874-4f7f-80a8-43ed936995f1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:12.670672 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-deb140fc-e874-4f7f-80a8-43ed936995f1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:12.676573 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-deb140fc-e874-4f7f-80a8-43ed936995f1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:12.677029 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-deb140fc-e874-4f7f-80a8-43ed936995f1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:12.677803 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-deb140fc-e874-4f7f-80a8-43ed936995f1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:12.678269 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-deb140fc-e874-4f7f-80a8-43ed936995f1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:12.812300 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-deb140fc-e874-4f7f-80a8-43ed936995f1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:12.819527 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-deb140fc-e874-4f7f-80a8-43ed936995f1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.153478 Mar 08 14:58:12.820084 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 479/974] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:12 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:13.024715 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5a037430-6186-4a5b-9787-ffebea5f5cc3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:13.025617 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5a037430-6186-4a5b-9787-ffebea5f5cc3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:13.031656 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5a037430-6186-4a5b-9787-ffebea5f5cc3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:13.032102 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5a037430-6186-4a5b-9787-ffebea5f5cc3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:13.032862 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5a037430-6186-4a5b-9787-ffebea5f5cc3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:13.033302 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5a037430-6186-4a5b-9787-ffebea5f5cc3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:13.059970 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5a037430-6186-4a5b-9787-ffebea5f5cc3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039304 Mar 08 14:58:13.060502 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 496/975] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:13 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:58:13.298559 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-8c8d762d-2117-4d2a-9568-f28cedd34732 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:13.299175 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-8c8d762d-2117-4d2a-9568-f28cedd34732 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:13.305787 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8c8d762d-2117-4d2a-9568-f28cedd34732 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:13.306278 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8c8d762d-2117-4d2a-9568-f28cedd34732 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:13.307053 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8c8d762d-2117-4d2a-9568-f28cedd34732 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:13.307499 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8c8d762d-2117-4d2a-9568-f28cedd34732 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:13.366443 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-8c8d762d-2117-4d2a-9568-f28cedd34732 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:13.374654 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-8c8d762d-2117-4d2a-9568-f28cedd34732 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079609 Mar 08 14:58:13.375223 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 480/976] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:13 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:13.619246 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-1b24d831-b032-4031-bcc6-4677a97b8691 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:13.620104 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-1b24d831-b032-4031-bcc6-4677a97b8691 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:13.626558 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1b24d831-b032-4031-bcc6-4677a97b8691 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:13.627012 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1b24d831-b032-4031-bcc6-4677a97b8691 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:13.627780 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1b24d831-b032-4031-bcc6-4677a97b8691 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:13.628215 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1b24d831-b032-4031-bcc6-4677a97b8691 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:13.656990 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-1b24d831-b032-4031-bcc6-4677a97b8691 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041786 Mar 08 14:58:13.657528 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 497/977] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:13 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:58:13.837249 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-281d59a9-ecc3-4538-8b59-967cd98bf667 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:13.837883 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-281d59a9-ecc3-4538-8b59-967cd98bf667 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:13.844288 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-281d59a9-ecc3-4538-8b59-967cd98bf667 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:13.844740 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-281d59a9-ecc3-4538-8b59-967cd98bf667 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:13.845511 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-281d59a9-ecc3-4538-8b59-967cd98bf667 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:13.845988 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-281d59a9-ecc3-4538-8b59-967cd98bf667 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:13.980759 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-281d59a9-ecc3-4538-8b59-967cd98bf667 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:13.988155 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-281d59a9-ecc3-4538-8b59-967cd98bf667 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.155003 Mar 08 14:58:13.988708 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 481/978] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:13 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:14.072193 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ac6329a8-e730-49e7-ac61-5edcfc6f9bcc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:14.073125 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ac6329a8-e730-49e7-ac61-5edcfc6f9bcc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:14.079722 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ac6329a8-e730-49e7-ac61-5edcfc6f9bcc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:14.080171 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ac6329a8-e730-49e7-ac61-5edcfc6f9bcc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:14.080945 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ac6329a8-e730-49e7-ac61-5edcfc6f9bcc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:14.081451 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ac6329a8-e730-49e7-ac61-5edcfc6f9bcc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:14.109632 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ac6329a8-e730-49e7-ac61-5edcfc6f9bcc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041409 Mar 08 14:58:14.110194 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 498/979] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:14 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:58:14.392191 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-27a139ed-73d3-475f-86ab-9e4bd74441a3 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:14.392835 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-27a139ed-73d3-475f-86ab-9e4bd74441a3 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:14.398693 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-27a139ed-73d3-475f-86ab-9e4bd74441a3 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:14.399151 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-27a139ed-73d3-475f-86ab-9e4bd74441a3 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:14.399916 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-27a139ed-73d3-475f-86ab-9e4bd74441a3 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:14.400359 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-27a139ed-73d3-475f-86ab-9e4bd74441a3 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:14.459485 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-27a139ed-73d3-475f-86ab-9e4bd74441a3 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:14.466623 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-27a139ed-73d3-475f-86ab-9e4bd74441a3 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078859 Mar 08 14:58:14.467183 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 482/980] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:14 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:14.668011 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3ce75d47-177c-439e-8612-3dd6f97f89e7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:14.668851 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-3ce75d47-177c-439e-8612-3dd6f97f89e7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:14.675734 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3ce75d47-177c-439e-8612-3dd6f97f89e7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:14.676193 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3ce75d47-177c-439e-8612-3dd6f97f89e7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:14.676966 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3ce75d47-177c-439e-8612-3dd6f97f89e7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:14.677409 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3ce75d47-177c-439e-8612-3dd6f97f89e7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:14.705705 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-3ce75d47-177c-439e-8612-3dd6f97f89e7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041694 Mar 08 14:58:14.706274 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 499/981] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:14 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:58:15.005751 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-a9d8e990-cdb4-4492-93e8-206979f5f0d3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:15.006391 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-a9d8e990-cdb4-4492-93e8-206979f5f0d3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:15.012568 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a9d8e990-cdb4-4492-93e8-206979f5f0d3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:15.013017 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a9d8e990-cdb4-4492-93e8-206979f5f0d3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:15.013779 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a9d8e990-cdb4-4492-93e8-206979f5f0d3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:15.014477 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a9d8e990-cdb4-4492-93e8-206979f5f0d3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:15.121413 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ddfb87d4-fe69-4d45-88bc-bd0e127101fb tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:15.122377 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ddfb87d4-fe69-4d45-88bc-bd0e127101fb tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:15.128372 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ddfb87d4-fe69-4d45-88bc-bd0e127101fb tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:15.128833 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ddfb87d4-fe69-4d45-88bc-bd0e127101fb tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:15.129614 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ddfb87d4-fe69-4d45-88bc-bd0e127101fb tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:15.130094 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ddfb87d4-fe69-4d45-88bc-bd0e127101fb tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:15.149229 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-a9d8e990-cdb4-4492-93e8-206979f5f0d3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:15.157053 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-a9d8e990-cdb4-4492-93e8-206979f5f0d3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.155133 Mar 08 14:58:15.157611 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 483/982] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:15 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:15.158207 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ddfb87d4-fe69-4d45-88bc-bd0e127101fb tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041492 Mar 08 14:58:15.158758 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 500/983] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:15 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:58:15.482975 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-f383d1a8-5058-4f04-b633-ae03c0f8de9d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:15.484036 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-f383d1a8-5058-4f04-b633-ae03c0f8de9d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:15.489726 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f383d1a8-5058-4f04-b633-ae03c0f8de9d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:15.490218 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f383d1a8-5058-4f04-b633-ae03c0f8de9d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:15.490981 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f383d1a8-5058-4f04-b633-ae03c0f8de9d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:15.491415 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f383d1a8-5058-4f04-b633-ae03c0f8de9d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:15.551258 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-f383d1a8-5058-4f04-b633-ae03c0f8de9d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:15.559128 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-f383d1a8-5058-4f04-b633-ae03c0f8de9d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080118 Mar 08 14:58:15.559686 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 484/984] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:15 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:15.716427 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-cd624308-b0cf-435c-af61-6218a205dc97 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:15.717994 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-cd624308-b0cf-435c-af61-6218a205dc97 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:15.724250 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cd624308-b0cf-435c-af61-6218a205dc97 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:15.724703 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cd624308-b0cf-435c-af61-6218a205dc97 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:15.725467 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cd624308-b0cf-435c-af61-6218a205dc97 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:15.725929 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cd624308-b0cf-435c-af61-6218a205dc97 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:15.753587 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-cd624308-b0cf-435c-af61-6218a205dc97 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041044 Mar 08 14:58:15.754084 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 501/985] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:15 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:58:16.169790 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-570d84e7-c042-4fe0-aff0-86bce432468d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:16.171360 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-570d84e7-c042-4fe0-aff0-86bce432468d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:16.173456 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-7451bca3-526b-4df6-bcea-5288804af4ac tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:16.174574 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-7451bca3-526b-4df6-bcea-5288804af4ac tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:16.177565 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-570d84e7-c042-4fe0-aff0-86bce432468d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:16.178050 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-570d84e7-c042-4fe0-aff0-86bce432468d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:16.178818 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-570d84e7-c042-4fe0-aff0-86bce432468d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:16.179254 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-570d84e7-c042-4fe0-aff0-86bce432468d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:16.179959 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7451bca3-526b-4df6-bcea-5288804af4ac tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:16.180403 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7451bca3-526b-4df6-bcea-5288804af4ac tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:16.181169 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7451bca3-526b-4df6-bcea-5288804af4ac tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:16.181611 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7451bca3-526b-4df6-bcea-5288804af4ac tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:16.208445 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-570d84e7-c042-4fe0-aff0-86bce432468d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042738 Mar 08 14:58:16.209002 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 485/986] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:16 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:58:16.313416 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-7451bca3-526b-4df6-bcea-5288804af4ac tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:16.322492 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-7451bca3-526b-4df6-bcea-5288804af4ac tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.153375 Mar 08 14:58:16.323044 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 502/987] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:16 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:58:16.576109 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-f04c6498-79f7-419a-84a6-a4fafe769acb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:16.576922 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-f04c6498-79f7-419a-84a6-a4fafe769acb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:16.582757 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f04c6498-79f7-419a-84a6-a4fafe769acb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:16.583210 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f04c6498-79f7-419a-84a6-a4fafe769acb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:16.583966 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f04c6498-79f7-419a-84a6-a4fafe769acb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:16.584402 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f04c6498-79f7-419a-84a6-a4fafe769acb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:16.646069 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-f04c6498-79f7-419a-84a6-a4fafe769acb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:16.653253 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-f04c6498-79f7-419a-84a6-a4fafe769acb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080954 Mar 08 14:58:16.653806 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 486/988] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:16 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:16.764963 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3d5947e4-f7d6-49a5-bcf7-556eb274abed tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:16.765886 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-3d5947e4-f7d6-49a5-bcf7-556eb274abed tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:16.772018 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3d5947e4-f7d6-49a5-bcf7-556eb274abed tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:16.772462 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3d5947e4-f7d6-49a5-bcf7-556eb274abed tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:16.773223 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3d5947e4-f7d6-49a5-bcf7-556eb274abed tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:16.773656 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3d5947e4-f7d6-49a5-bcf7-556eb274abed tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:16.802462 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-3d5947e4-f7d6-49a5-bcf7-556eb274abed tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041505 Mar 08 14:58:16.803005 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 503/989] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:16 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:58:17.220680 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-f70b53dd-b9b1-43cb-8547-df3c9d97f12c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:17.221504 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-f70b53dd-b9b1-43cb-8547-df3c9d97f12c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:17.227719 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f70b53dd-b9b1-43cb-8547-df3c9d97f12c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:17.228171 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f70b53dd-b9b1-43cb-8547-df3c9d97f12c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:17.228932 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f70b53dd-b9b1-43cb-8547-df3c9d97f12c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:17.229373 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f70b53dd-b9b1-43cb-8547-df3c9d97f12c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:17.257480 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-f70b53dd-b9b1-43cb-8547-df3c9d97f12c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041482 Mar 08 14:58:17.258050 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 487/990] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:17 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:58:17.339866 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-1e05bc56-b92b-429a-bb17-e06ec507872d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:17.340506 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-1e05bc56-b92b-429a-bb17-e06ec507872d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:17.347100 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1e05bc56-b92b-429a-bb17-e06ec507872d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:17.347555 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1e05bc56-b92b-429a-bb17-e06ec507872d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:17.348328 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1e05bc56-b92b-429a-bb17-e06ec507872d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:17.348769 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1e05bc56-b92b-429a-bb17-e06ec507872d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:17.482140 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-1e05bc56-b92b-429a-bb17-e06ec507872d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:17.489509 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-1e05bc56-b92b-429a-bb17-e06ec507872d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.153466 Mar 08 14:58:17.490090 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 504/991] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:17 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:17.671189 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-c1116f37-2a07-4392-acf0-3bddb5284191 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:17.671795 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-c1116f37-2a07-4392-acf0-3bddb5284191 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:17.677666 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c1116f37-2a07-4392-acf0-3bddb5284191 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:17.678152 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c1116f37-2a07-4392-acf0-3bddb5284191 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:17.678918 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c1116f37-2a07-4392-acf0-3bddb5284191 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:17.679353 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c1116f37-2a07-4392-acf0-3bddb5284191 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:17.738196 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-c1116f37-2a07-4392-acf0-3bddb5284191 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:17.745249 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-c1116f37-2a07-4392-acf0-3bddb5284191 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078167 Mar 08 14:58:17.745794 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 488/992] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:17 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:17.814138 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d7997344-1bee-4531-8081-cd18fffff282 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:17.815056 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d7997344-1bee-4531-8081-cd18fffff282 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:17.821250 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d7997344-1bee-4531-8081-cd18fffff282 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:17.821707 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d7997344-1bee-4531-8081-cd18fffff282 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:17.822523 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d7997344-1bee-4531-8081-cd18fffff282 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:17.822968 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d7997344-1bee-4531-8081-cd18fffff282 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:17.852458 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d7997344-1bee-4531-8081-cd18fffff282 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042838 Mar 08 14:58:17.853213 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 505/993] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:17 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:58:18.268827 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-0023f362-66f5-4af1-8ca0-88c7d79a296c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:18.269786 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-0023f362-66f5-4af1-8ca0-88c7d79a296c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:18.276041 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0023f362-66f5-4af1-8ca0-88c7d79a296c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:18.276498 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0023f362-66f5-4af1-8ca0-88c7d79a296c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:18.277270 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0023f362-66f5-4af1-8ca0-88c7d79a296c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:18.277715 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0023f362-66f5-4af1-8ca0-88c7d79a296c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:18.306106 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-0023f362-66f5-4af1-8ca0-88c7d79a296c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041335 Mar 08 14:58:18.306661 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 489/994] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:18 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:58:18.506302 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-a3a22c0f-3352-4eed-9e26-42330bbd8d7c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:18.506914 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-a3a22c0f-3352-4eed-9e26-42330bbd8d7c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:18.512811 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a3a22c0f-3352-4eed-9e26-42330bbd8d7c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:18.513377 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a3a22c0f-3352-4eed-9e26-42330bbd8d7c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:18.515279 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a3a22c0f-3352-4eed-9e26-42330bbd8d7c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:18.515726 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a3a22c0f-3352-4eed-9e26-42330bbd8d7c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:18.650477 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-a3a22c0f-3352-4eed-9e26-42330bbd8d7c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:18.657946 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-a3a22c0f-3352-4eed-9e26-42330bbd8d7c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.155519 Mar 08 14:58:18.658510 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 506/995] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:18 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:18.763791 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-e206ea75-c7ea-4bc5-a695-f19967e45a48 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:18.765214 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-e206ea75-c7ea-4bc5-a695-f19967e45a48 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:18.770916 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e206ea75-c7ea-4bc5-a695-f19967e45a48 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:18.771366 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e206ea75-c7ea-4bc5-a695-f19967e45a48 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:18.772125 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e206ea75-c7ea-4bc5-a695-f19967e45a48 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:18.772559 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e206ea75-c7ea-4bc5-a695-f19967e45a48 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:18.831551 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-e206ea75-c7ea-4bc5-a695-f19967e45a48 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:18.838738 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-e206ea75-c7ea-4bc5-a695-f19967e45a48 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080456 Mar 08 14:58:18.839509 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 490/996] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:18 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:18.864857 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-318945b9-90a5-4e4e-972d-f02ae3cdc5de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:18.865710 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-318945b9-90a5-4e4e-972d-f02ae3cdc5de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:18.871974 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-318945b9-90a5-4e4e-972d-f02ae3cdc5de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:18.872435 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-318945b9-90a5-4e4e-972d-f02ae3cdc5de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:18.873206 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-318945b9-90a5-4e4e-972d-f02ae3cdc5de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:18.874466 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-318945b9-90a5-4e4e-972d-f02ae3cdc5de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:18.909745 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-318945b9-90a5-4e4e-972d-f02ae3cdc5de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048878 Mar 08 14:58:18.910345 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 507/997] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:18 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:58:19.316805 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-c557e1b0-96ac-463f-9a1e-3d1777772361 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:19.317719 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-c557e1b0-96ac-463f-9a1e-3d1777772361 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:19.324002 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c557e1b0-96ac-463f-9a1e-3d1777772361 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:19.324459 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c557e1b0-96ac-463f-9a1e-3d1777772361 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:19.325223 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c557e1b0-96ac-463f-9a1e-3d1777772361 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:19.325666 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c557e1b0-96ac-463f-9a1e-3d1777772361 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:19.353490 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-c557e1b0-96ac-463f-9a1e-3d1777772361 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040615 Mar 08 14:58:19.354066 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 491/998] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:19 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:58:19.674447 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-905573a2-50be-48b2-97d2-4380eacef47c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:19.674980 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-905573a2-50be-48b2-97d2-4380eacef47c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:19.681003 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-905573a2-50be-48b2-97d2-4380eacef47c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:19.681447 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-905573a2-50be-48b2-97d2-4380eacef47c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:19.682242 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-905573a2-50be-48b2-97d2-4380eacef47c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:19.682677 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-905573a2-50be-48b2-97d2-4380eacef47c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:19.813500 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-905573a2-50be-48b2-97d2-4380eacef47c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:19.820687 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-905573a2-50be-48b2-97d2-4380eacef47c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.150269 Mar 08 14:58:19.821241 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 508/999] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:19 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:19.855465 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-8cd2079d-efdf-4d86-a704-201aabcb2375 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:19.856075 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-8cd2079d-efdf-4d86-a704-201aabcb2375 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:19.861802 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8cd2079d-efdf-4d86-a704-201aabcb2375 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:19.862307 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8cd2079d-efdf-4d86-a704-201aabcb2375 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:19.863062 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8cd2079d-efdf-4d86-a704-201aabcb2375 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:19.863503 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8cd2079d-efdf-4d86-a704-201aabcb2375 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:19.921219 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-0b8941e4-0d6b-4461-a568-c33b8f81a1ac tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:19.921661 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-8cd2079d-efdf-4d86-a704-201aabcb2375 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:19.922166 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-0b8941e4-0d6b-4461-a568-c33b8f81a1ac tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:19.928437 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0b8941e4-0d6b-4461-a568-c33b8f81a1ac tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:19.928826 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0b8941e4-0d6b-4461-a568-c33b8f81a1ac tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:19.928943 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-8cd2079d-efdf-4d86-a704-201aabcb2375 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.077311 Mar 08 14:58:19.929478 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 492/1000] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:19 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:19.929872 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0b8941e4-0d6b-4461-a568-c33b8f81a1ac tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:19.930313 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0b8941e4-0d6b-4461-a568-c33b8f81a1ac tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:19.960329 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-0b8941e4-0d6b-4461-a568-c33b8f81a1ac tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043483 Mar 08 14:58:19.960876 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 509/1001] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:19 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:58:20.365083 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-c7c2b803-162a-49dc-8013-5ac4d0f6997f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:20.366043 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-c7c2b803-162a-49dc-8013-5ac4d0f6997f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:20.372297 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c7c2b803-162a-49dc-8013-5ac4d0f6997f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:20.372751 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c7c2b803-162a-49dc-8013-5ac4d0f6997f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:20.373669 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c7c2b803-162a-49dc-8013-5ac4d0f6997f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:20.374142 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c7c2b803-162a-49dc-8013-5ac4d0f6997f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:20.402274 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-c7c2b803-162a-49dc-8013-5ac4d0f6997f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041224 Mar 08 14:58:20.403028 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 493/1002] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:20 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:58:20.838641 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5c56e947-8cd2-4604-a025-afff07e84cd1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:20.839257 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5c56e947-8cd2-4604-a025-afff07e84cd1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:20.845331 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5c56e947-8cd2-4604-a025-afff07e84cd1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:20.845793 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5c56e947-8cd2-4604-a025-afff07e84cd1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:20.846593 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5c56e947-8cd2-4604-a025-afff07e84cd1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:20.847040 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5c56e947-8cd2-4604-a025-afff07e84cd1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:20.946436 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-709134aa-1808-494f-a509-323aa5e9d134 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:20.947052 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-709134aa-1808-494f-a509-323aa5e9d134 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:20.953869 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-709134aa-1808-494f-a509-323aa5e9d134 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:20.954328 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-709134aa-1808-494f-a509-323aa5e9d134 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:20.955136 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-709134aa-1808-494f-a509-323aa5e9d134 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:20.955573 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-709134aa-1808-494f-a509-323aa5e9d134 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:20.981575 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-5c56e947-8cd2-4604-a025-afff07e84cd1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:20.990321 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5c56e947-8cd2-4604-a025-afff07e84cd1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.155479 Mar 08 14:58:20.990885 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 510/1003] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:20 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:20.995484 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-9604e161-85d1-4d19-833c-be2c3334e3be tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:20.996401 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-9604e161-85d1-4d19-833c-be2c3334e3be tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:21.003097 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9604e161-85d1-4d19-833c-be2c3334e3be tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:21.003553 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9604e161-85d1-4d19-833c-be2c3334e3be tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:21.004717 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9604e161-85d1-4d19-833c-be2c3334e3be tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:21.005165 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9604e161-85d1-4d19-833c-be2c3334e3be tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:21.015741 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-709134aa-1808-494f-a509-323aa5e9d134 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:21.023052 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-709134aa-1808-494f-a509-323aa5e9d134 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080405 Mar 08 14:58:21.023606 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 494/1004] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:20 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:21.034630 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-9604e161-85d1-4d19-833c-be2c3334e3be tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042704 Mar 08 14:58:21.035168 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 511/1005] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:20 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:58:21.414452 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-8de967a3-042a-403a-9b92-a7199e6d8152 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:21.415370 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-8de967a3-042a-403a-9b92-a7199e6d8152 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:21.422717 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8de967a3-042a-403a-9b92-a7199e6d8152 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:21.423173 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8de967a3-042a-403a-9b92-a7199e6d8152 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:21.423942 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8de967a3-042a-403a-9b92-a7199e6d8152 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:21.424384 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8de967a3-042a-403a-9b92-a7199e6d8152 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:21.452120 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-8de967a3-042a-403a-9b92-a7199e6d8152 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041439 Mar 08 14:58:21.452780 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 495/1006] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:21 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:58:22.008248 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-1036fab5-60fc-43e4-b62f-1dc064e06351 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:22.008863 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-1036fab5-60fc-43e4-b62f-1dc064e06351 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:22.015650 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1036fab5-60fc-43e4-b62f-1dc064e06351 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:22.016103 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1036fab5-60fc-43e4-b62f-1dc064e06351 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:22.016871 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1036fab5-60fc-43e4-b62f-1dc064e06351 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:22.017309 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1036fab5-60fc-43e4-b62f-1dc064e06351 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:22.040065 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-8e57da16-1b8c-4f23-bff1-e7058a15089c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:22.040704 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-8e57da16-1b8c-4f23-bff1-e7058a15089c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:22.046717 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8e57da16-1b8c-4f23-bff1-e7058a15089c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:22.047215 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8e57da16-1b8c-4f23-bff1-e7058a15089c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:22.048031 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8e57da16-1b8c-4f23-bff1-e7058a15089c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:22.048475 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8e57da16-1b8c-4f23-bff1-e7058a15089c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:22.108354 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-8e57da16-1b8c-4f23-bff1-e7058a15089c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:22.115756 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-8e57da16-1b8c-4f23-bff1-e7058a15089c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079528 Mar 08 14:58:22.116527 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 496/1007] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:22 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:22.123351 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-6abcb31e-ece6-4295-a9e5-d14746ef2c4e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:22.124382 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-6abcb31e-ece6-4295-a9e5-d14746ef2c4e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:22.129981 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6abcb31e-ece6-4295-a9e5-d14746ef2c4e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:22.130433 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6abcb31e-ece6-4295-a9e5-d14746ef2c4e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:22.131206 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6abcb31e-ece6-4295-a9e5-d14746ef2c4e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:22.131642 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6abcb31e-ece6-4295-a9e5-d14746ef2c4e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:22.150719 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-1036fab5-60fc-43e4-b62f-1dc064e06351 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:22.158479 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-1036fab5-60fc-43e4-b62f-1dc064e06351 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.154075 Mar 08 14:58:22.159039 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 512/1008] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:22 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:22.161896 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-6abcb31e-ece6-4295-a9e5-d14746ef2c4e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042179 Mar 08 14:58:22.162639 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 497/1009] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:22 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:58:22.463799 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-8faa64fb-e0e8-4dea-8299-53695627156d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:22.464800 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-8faa64fb-e0e8-4dea-8299-53695627156d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:22.471158 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8faa64fb-e0e8-4dea-8299-53695627156d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:22.471601 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8faa64fb-e0e8-4dea-8299-53695627156d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:22.472388 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8faa64fb-e0e8-4dea-8299-53695627156d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:22.472823 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8faa64fb-e0e8-4dea-8299-53695627156d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:22.500128 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-8faa64fb-e0e8-4dea-8299-53695627156d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040324 Mar 08 14:58:22.500752 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 513/1010] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:22 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:58:23.132426 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-41490aad-0806-48cf-80cb-17232fb89109 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:23.133033 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-41490aad-0806-48cf-80cb-17232fb89109 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:23.139915 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-41490aad-0806-48cf-80cb-17232fb89109 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:23.140364 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-41490aad-0806-48cf-80cb-17232fb89109 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:23.141124 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-41490aad-0806-48cf-80cb-17232fb89109 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:23.141560 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-41490aad-0806-48cf-80cb-17232fb89109 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:23.173950 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-55d3f1ba-2ff2-43bb-8a50-0899233c57a4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:23.175000 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-55d3f1ba-2ff2-43bb-8a50-0899233c57a4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:23.181639 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-55d3f1ba-2ff2-43bb-8a50-0899233c57a4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:23.182127 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-55d3f1ba-2ff2-43bb-8a50-0899233c57a4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:23.182910 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-55d3f1ba-2ff2-43bb-8a50-0899233c57a4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:23.183351 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-55d3f1ba-2ff2-43bb-8a50-0899233c57a4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:23.204492 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-41490aad-0806-48cf-80cb-17232fb89109 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:23.211945 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-41490aad-0806-48cf-80cb-17232fb89109 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.083349 Mar 08 14:58:23.212529 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-55d3f1ba-2ff2-43bb-8a50-0899233c57a4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042702 Mar 08 14:58:23.212695 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 498/1011] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:23 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:23.213318 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 514/1012] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:23 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:58:23.217109 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-59eff301-b0b8-4e5c-bc46-3f5be88e7d0d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:23.217705 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-59eff301-b0b8-4e5c-bc46-3f5be88e7d0d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:23.223366 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-59eff301-b0b8-4e5c-bc46-3f5be88e7d0d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:23.223812 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-59eff301-b0b8-4e5c-bc46-3f5be88e7d0d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:23.224568 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-59eff301-b0b8-4e5c-bc46-3f5be88e7d0d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:23.225001 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-59eff301-b0b8-4e5c-bc46-3f5be88e7d0d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:23.355547 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-59eff301-b0b8-4e5c-bc46-3f5be88e7d0d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:23.363235 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-59eff301-b0b8-4e5c-bc46-3f5be88e7d0d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.149660 Mar 08 14:58:23.363803 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 499/1013] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:23 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:23.511283 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-22aab82d-0bf0-4bf2-87e3-989043e7c549 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:23.512251 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-22aab82d-0bf0-4bf2-87e3-989043e7c549 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:23.518554 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-22aab82d-0bf0-4bf2-87e3-989043e7c549 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:23.519007 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-22aab82d-0bf0-4bf2-87e3-989043e7c549 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:23.519778 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-22aab82d-0bf0-4bf2-87e3-989043e7c549 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:23.520213 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-22aab82d-0bf0-4bf2-87e3-989043e7c549 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:23.547508 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-22aab82d-0bf0-4bf2-87e3-989043e7c549 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040163 Mar 08 14:58:23.548047 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 515/1014] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:23 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:58:24.224593 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-76feaa62-a473-4612-8a37-be86b723547e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:24.225438 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-76feaa62-a473-4612-8a37-be86b723547e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:24.228670 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-02dfa8d7-a578-47e5-bfbe-0372ededaf7e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:24.229270 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-02dfa8d7-a578-47e5-bfbe-0372ededaf7e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:24.232171 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-76feaa62-a473-4612-8a37-be86b723547e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:24.232636 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-76feaa62-a473-4612-8a37-be86b723547e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:24.233456 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-76feaa62-a473-4612-8a37-be86b723547e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:24.234048 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-76feaa62-a473-4612-8a37-be86b723547e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:24.236183 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-02dfa8d7-a578-47e5-bfbe-0372ededaf7e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:24.236636 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-02dfa8d7-a578-47e5-bfbe-0372ededaf7e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:24.237400 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-02dfa8d7-a578-47e5-bfbe-0372ededaf7e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:24.237843 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-02dfa8d7-a578-47e5-bfbe-0372ededaf7e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:24.263069 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-76feaa62-a473-4612-8a37-be86b723547e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042511 Mar 08 14:58:24.263639 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 500/1015] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:24 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:58:24.297221 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-02dfa8d7-a578-47e5-bfbe-0372ededaf7e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:24.304713 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-02dfa8d7-a578-47e5-bfbe-0372ededaf7e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079529 Mar 08 14:58:24.305267 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 516/1016] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:24 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:58:24.380311 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-74866499-7920-44f2-ab8c-24e9b7562985 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:24.380915 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-74866499-7920-44f2-ab8c-24e9b7562985 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:24.387809 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-74866499-7920-44f2-ab8c-24e9b7562985 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:24.388678 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-74866499-7920-44f2-ab8c-24e9b7562985 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:24.390125 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-74866499-7920-44f2-ab8c-24e9b7562985 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:24.390726 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-74866499-7920-44f2-ab8c-24e9b7562985 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:24.523366 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-74866499-7920-44f2-ab8c-24e9b7562985 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:24.530807 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-74866499-7920-44f2-ab8c-24e9b7562985 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.154328 Mar 08 14:58:24.531365 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 501/1017] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:24 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:24.559181 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-7189d393-57d7-4121-b0b6-b08297c366d9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:24.560135 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-7189d393-57d7-4121-b0b6-b08297c366d9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:24.566591 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7189d393-57d7-4121-b0b6-b08297c366d9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:24.567050 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7189d393-57d7-4121-b0b6-b08297c366d9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:24.567828 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7189d393-57d7-4121-b0b6-b08297c366d9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:24.568278 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7189d393-57d7-4121-b0b6-b08297c366d9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:24.595583 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-7189d393-57d7-4121-b0b6-b08297c366d9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040366 Mar 08 14:58:24.596122 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 517/1018] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:24 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:58:25.275540 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-2d6e1c6a-57c4-44a5-bde2-33bce579eafa tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:25.276444 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-2d6e1c6a-57c4-44a5-bde2-33bce579eafa tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:25.283212 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2d6e1c6a-57c4-44a5-bde2-33bce579eafa tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:25.283660 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2d6e1c6a-57c4-44a5-bde2-33bce579eafa tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:25.284420 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2d6e1c6a-57c4-44a5-bde2-33bce579eafa tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:25.284857 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2d6e1c6a-57c4-44a5-bde2-33bce579eafa tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:25.312842 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-2d6e1c6a-57c4-44a5-bde2-33bce579eafa tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041251 Mar 08 14:58:25.313386 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 502/1019] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:25 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:58:25.321540 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-2041ad5b-492d-47aa-80db-f2a24c0f9837 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:25.322247 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-2041ad5b-492d-47aa-80db-f2a24c0f9837 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:25.328443 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2041ad5b-492d-47aa-80db-f2a24c0f9837 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:25.328905 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2041ad5b-492d-47aa-80db-f2a24c0f9837 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:25.329684 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2041ad5b-492d-47aa-80db-f2a24c0f9837 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:25.330144 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2041ad5b-492d-47aa-80db-f2a24c0f9837 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:25.392007 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-2041ad5b-492d-47aa-80db-f2a24c0f9837 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:25.399218 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-2041ad5b-492d-47aa-80db-f2a24c0f9837 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081515 Mar 08 14:58:25.399759 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 518/1020] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:25 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:58:25.548093 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-11e2352a-d45a-4ad3-9ed7-5c1e770e8969 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:25.548640 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-11e2352a-d45a-4ad3-9ed7-5c1e770e8969 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:25.554688 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-11e2352a-d45a-4ad3-9ed7-5c1e770e8969 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:25.555164 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-11e2352a-d45a-4ad3-9ed7-5c1e770e8969 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:25.555922 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-11e2352a-d45a-4ad3-9ed7-5c1e770e8969 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:25.556384 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-11e2352a-d45a-4ad3-9ed7-5c1e770e8969 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:25.606712 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-1b2a4700-dd63-4b34-af5e-d179211e3925 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:25.607632 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-1b2a4700-dd63-4b34-af5e-d179211e3925 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:25.613460 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1b2a4700-dd63-4b34-af5e-d179211e3925 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:25.613945 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1b2a4700-dd63-4b34-af5e-d179211e3925 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:25.614716 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1b2a4700-dd63-4b34-af5e-d179211e3925 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:25.615151 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1b2a4700-dd63-4b34-af5e-d179211e3925 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:25.643040 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-1b2a4700-dd63-4b34-af5e-d179211e3925 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040311 Mar 08 14:58:25.643592 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 519/1021] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:25 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:58:25.693609 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-11e2352a-d45a-4ad3-9ed7-5c1e770e8969 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:25.700911 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-11e2352a-d45a-4ad3-9ed7-5c1e770e8969 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.157350 Mar 08 14:58:25.702219 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 503/1022] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:25 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:26.324486 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-e3f4478f-905e-4dbc-a6c1-b384a549c182 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:26.325388 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-e3f4478f-905e-4dbc-a6c1-b384a549c182 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:26.331702 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e3f4478f-905e-4dbc-a6c1-b384a549c182 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:26.332152 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e3f4478f-905e-4dbc-a6c1-b384a549c182 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:26.332907 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e3f4478f-905e-4dbc-a6c1-b384a549c182 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:26.333340 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e3f4478f-905e-4dbc-a6c1-b384a549c182 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:26.366184 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-e3f4478f-905e-4dbc-a6c1-b384a549c182 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045629 Mar 08 14:58:26.366728 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 520/1023] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:26 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:58:26.416380 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-648eb52d-3ac2-482d-ad3e-4a97002f5b78 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:26.416986 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-648eb52d-3ac2-482d-ad3e-4a97002f5b78 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:26.424764 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-648eb52d-3ac2-482d-ad3e-4a97002f5b78 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:26.425212 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-648eb52d-3ac2-482d-ad3e-4a97002f5b78 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:26.426003 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-648eb52d-3ac2-482d-ad3e-4a97002f5b78 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:26.426442 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-648eb52d-3ac2-482d-ad3e-4a97002f5b78 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:26.485326 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-648eb52d-3ac2-482d-ad3e-4a97002f5b78 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:26.492447 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-648eb52d-3ac2-482d-ad3e-4a97002f5b78 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079926 Mar 08 14:58:26.493004 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 504/1024] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:26 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:26.655131 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-67726242-27f5-49f4-a103-79cd89ba2689 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:26.656167 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-67726242-27f5-49f4-a103-79cd89ba2689 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:26.661976 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-67726242-27f5-49f4-a103-79cd89ba2689 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:26.662426 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-67726242-27f5-49f4-a103-79cd89ba2689 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:26.663187 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-67726242-27f5-49f4-a103-79cd89ba2689 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:26.663620 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-67726242-27f5-49f4-a103-79cd89ba2689 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:26.691585 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-67726242-27f5-49f4-a103-79cd89ba2689 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040950 Mar 08 14:58:26.692117 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 521/1025] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:26 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:58:26.719414 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-54fabff5-5088-4779-98a7-05d29328cfdd tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:26.720056 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-54fabff5-5088-4779-98a7-05d29328cfdd tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:26.725971 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-54fabff5-5088-4779-98a7-05d29328cfdd tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:26.726430 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-54fabff5-5088-4779-98a7-05d29328cfdd tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:26.727199 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-54fabff5-5088-4779-98a7-05d29328cfdd tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:26.727639 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-54fabff5-5088-4779-98a7-05d29328cfdd tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:26.863991 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-54fabff5-5088-4779-98a7-05d29328cfdd tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:26.871198 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-54fabff5-5088-4779-98a7-05d29328cfdd tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.156678 Mar 08 14:58:26.871754 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 505/1026] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:26 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:27.377593 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5e7a0027-a0aa-4bbb-8548-0fb029c24e85 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:27.378567 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5e7a0027-a0aa-4bbb-8548-0fb029c24e85 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:27.384737 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5e7a0027-a0aa-4bbb-8548-0fb029c24e85 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:27.385183 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5e7a0027-a0aa-4bbb-8548-0fb029c24e85 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:27.385971 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5e7a0027-a0aa-4bbb-8548-0fb029c24e85 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:27.386404 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5e7a0027-a0aa-4bbb-8548-0fb029c24e85 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:27.413925 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5e7a0027-a0aa-4bbb-8548-0fb029c24e85 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040967 Mar 08 14:58:27.414460 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 522/1027] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:27 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:58:27.509623 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-899b15fb-2c13-421e-92ac-ceeca707677c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:27.510260 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-899b15fb-2c13-421e-92ac-ceeca707677c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:27.517094 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-899b15fb-2c13-421e-92ac-ceeca707677c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:27.517545 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-899b15fb-2c13-421e-92ac-ceeca707677c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:27.518336 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-899b15fb-2c13-421e-92ac-ceeca707677c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:27.518774 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-899b15fb-2c13-421e-92ac-ceeca707677c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:27.578052 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-899b15fb-2c13-421e-92ac-ceeca707677c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:27.585240 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-899b15fb-2c13-421e-92ac-ceeca707677c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079465 Mar 08 14:58:27.585795 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 506/1028] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:27 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:27.703717 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c6449f35-8a4e-491f-9771-69ac2f5ea96a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:27.704540 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-c6449f35-8a4e-491f-9771-69ac2f5ea96a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:27.710340 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c6449f35-8a4e-491f-9771-69ac2f5ea96a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:27.710788 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c6449f35-8a4e-491f-9771-69ac2f5ea96a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:27.711547 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c6449f35-8a4e-491f-9771-69ac2f5ea96a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:27.711978 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c6449f35-8a4e-491f-9771-69ac2f5ea96a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:27.738517 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-c6449f35-8a4e-491f-9771-69ac2f5ea96a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039395 Mar 08 14:58:27.739053 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 523/1029] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:27 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:58:27.887881 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-e5b88481-4e21-46b3-ab1b-efda35ea0139 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:27.888494 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-e5b88481-4e21-46b3-ab1b-efda35ea0139 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:27.894865 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e5b88481-4e21-46b3-ab1b-efda35ea0139 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:27.895318 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e5b88481-4e21-46b3-ab1b-efda35ea0139 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:27.896087 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e5b88481-4e21-46b3-ab1b-efda35ea0139 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:27.896526 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e5b88481-4e21-46b3-ab1b-efda35ea0139 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:28.029700 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-e5b88481-4e21-46b3-ab1b-efda35ea0139 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:28.036983 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-e5b88481-4e21-46b3-ab1b-efda35ea0139 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.152946 Mar 08 14:58:28.037537 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 507/1030] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:27 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:28.426134 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-e061ac6c-ba6b-46eb-b8ad-b318f0835e87 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:28.426975 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-e061ac6c-ba6b-46eb-b8ad-b318f0835e87 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:28.433457 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e061ac6c-ba6b-46eb-b8ad-b318f0835e87 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:28.433938 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e061ac6c-ba6b-46eb-b8ad-b318f0835e87 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:28.434730 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e061ac6c-ba6b-46eb-b8ad-b318f0835e87 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:28.435169 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e061ac6c-ba6b-46eb-b8ad-b318f0835e87 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:28.463763 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-e061ac6c-ba6b-46eb-b8ad-b318f0835e87 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041779 Mar 08 14:58:28.464307 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 524/1031] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:28 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:58:28.602084 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-a7d0eeaf-21da-4fd8-b1e6-caa0f2c2a8c0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:28.602685 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-a7d0eeaf-21da-4fd8-b1e6-caa0f2c2a8c0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:28.609232 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a7d0eeaf-21da-4fd8-b1e6-caa0f2c2a8c0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:28.609682 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a7d0eeaf-21da-4fd8-b1e6-caa0f2c2a8c0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:28.610478 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a7d0eeaf-21da-4fd8-b1e6-caa0f2c2a8c0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:28.610918 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a7d0eeaf-21da-4fd8-b1e6-caa0f2c2a8c0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:28.671134 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-a7d0eeaf-21da-4fd8-b1e6-caa0f2c2a8c0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:28.678527 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-a7d0eeaf-21da-4fd8-b1e6-caa0f2c2a8c0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080248 Mar 08 14:58:28.679028 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 508/1032] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:28 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:28.749893 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-0d8aafa8-798e-4d01-b983-458bfd2402cc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:28.750828 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-0d8aafa8-798e-4d01-b983-458bfd2402cc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:28.756686 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0d8aafa8-798e-4d01-b983-458bfd2402cc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:28.757139 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0d8aafa8-798e-4d01-b983-458bfd2402cc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:28.757930 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0d8aafa8-798e-4d01-b983-458bfd2402cc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:28.758362 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0d8aafa8-798e-4d01-b983-458bfd2402cc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:28.786672 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-0d8aafa8-798e-4d01-b983-458bfd2402cc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040765 Mar 08 14:58:28.787207 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 525/1033] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:28 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:58:29.054112 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-7f7b1b0f-9fb6-4d19-b6fe-3f4b1fdc8298 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:29.054986 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-7f7b1b0f-9fb6-4d19-b6fe-3f4b1fdc8298 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:29.061379 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7f7b1b0f-9fb6-4d19-b6fe-3f4b1fdc8298 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:29.061963 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7f7b1b0f-9fb6-4d19-b6fe-3f4b1fdc8298 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:29.062748 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7f7b1b0f-9fb6-4d19-b6fe-3f4b1fdc8298 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:29.063191 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7f7b1b0f-9fb6-4d19-b6fe-3f4b1fdc8298 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:29.199025 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-7f7b1b0f-9fb6-4d19-b6fe-3f4b1fdc8298 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:29.206920 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-7f7b1b0f-9fb6-4d19-b6fe-3f4b1fdc8298 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.156766 Mar 08 14:58:29.207481 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 509/1034] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:29 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:29.475914 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-aef5c294-a22e-4128-b7a9-1e7919a8fcb4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:29.476818 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-aef5c294-a22e-4128-b7a9-1e7919a8fcb4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:29.483587 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-aef5c294-a22e-4128-b7a9-1e7919a8fcb4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:29.484104 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-aef5c294-a22e-4128-b7a9-1e7919a8fcb4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:29.484871 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-aef5c294-a22e-4128-b7a9-1e7919a8fcb4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:29.485303 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-aef5c294-a22e-4128-b7a9-1e7919a8fcb4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:29.513322 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-aef5c294-a22e-4128-b7a9-1e7919a8fcb4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041274 Mar 08 14:58:29.513872 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 526/1035] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:29 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:58:29.694551 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-2d824cbc-1f08-4475-a47f-98857e76e7ec tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:29.695187 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-2d824cbc-1f08-4475-a47f-98857e76e7ec tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:29.701449 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2d824cbc-1f08-4475-a47f-98857e76e7ec tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:29.701929 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2d824cbc-1f08-4475-a47f-98857e76e7ec tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:29.702693 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2d824cbc-1f08-4475-a47f-98857e76e7ec tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:29.703128 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2d824cbc-1f08-4475-a47f-98857e76e7ec tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:29.761676 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-2d824cbc-1f08-4475-a47f-98857e76e7ec tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:29.769166 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-2d824cbc-1f08-4475-a47f-98857e76e7ec tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078481 Mar 08 14:58:29.769728 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 510/1036] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:29 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:29.798735 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b2bc13c9-c321-49ba-a8c9-bcffa3c87933 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:29.799652 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b2bc13c9-c321-49ba-a8c9-bcffa3c87933 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:29.805634 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b2bc13c9-c321-49ba-a8c9-bcffa3c87933 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:29.806143 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b2bc13c9-c321-49ba-a8c9-bcffa3c87933 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:29.806903 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b2bc13c9-c321-49ba-a8c9-bcffa3c87933 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:29.807347 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b2bc13c9-c321-49ba-a8c9-bcffa3c87933 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:29.834048 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b2bc13c9-c321-49ba-a8c9-bcffa3c87933 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039931 Mar 08 14:58:29.834582 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 527/1037] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:29 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:58:30.224103 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-cf4a2ab0-e2d1-4324-97d5-b4a2b9e15662 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:30.224659 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-cf4a2ab0-e2d1-4324-97d5-b4a2b9e15662 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:30.230525 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cf4a2ab0-e2d1-4324-97d5-b4a2b9e15662 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:30.230977 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cf4a2ab0-e2d1-4324-97d5-b4a2b9e15662 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:30.231736 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cf4a2ab0-e2d1-4324-97d5-b4a2b9e15662 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:30.232172 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cf4a2ab0-e2d1-4324-97d5-b4a2b9e15662 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:30.365444 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-cf4a2ab0-e2d1-4324-97d5-b4a2b9e15662 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:30.373273 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-cf4a2ab0-e2d1-4324-97d5-b4a2b9e15662 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.153063 Mar 08 14:58:30.373905 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 511/1038] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:30 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:30.524849 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-caaad808-c1ae-497b-9f27-b292203de311 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:30.525749 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-caaad808-c1ae-497b-9f27-b292203de311 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:30.532330 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-caaad808-c1ae-497b-9f27-b292203de311 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:30.532789 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-caaad808-c1ae-497b-9f27-b292203de311 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:30.533598 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-caaad808-c1ae-497b-9f27-b292203de311 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:30.534092 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-caaad808-c1ae-497b-9f27-b292203de311 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:30.562437 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-caaad808-c1ae-497b-9f27-b292203de311 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041506 Mar 08 14:58:30.562991 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 528/1039] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:30 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:58:30.785910 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-ee3ccad1-e0c2-49be-809a-aeb95eeac4ca tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:30.786451 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-ee3ccad1-e0c2-49be-809a-aeb95eeac4ca tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:30.792599 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ee3ccad1-e0c2-49be-809a-aeb95eeac4ca tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:30.793050 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ee3ccad1-e0c2-49be-809a-aeb95eeac4ca tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:30.793810 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ee3ccad1-e0c2-49be-809a-aeb95eeac4ca tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:30.794337 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ee3ccad1-e0c2-49be-809a-aeb95eeac4ca tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:30.845604 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c20ac55f-033c-44d3-b8a0-9a91614e95fc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:30.846554 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-c20ac55f-033c-44d3-b8a0-9a91614e95fc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:30.852382 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c20ac55f-033c-44d3-b8a0-9a91614e95fc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:30.852836 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c20ac55f-033c-44d3-b8a0-9a91614e95fc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:30.853616 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c20ac55f-033c-44d3-b8a0-9a91614e95fc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:30.854085 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c20ac55f-033c-44d3-b8a0-9a91614e95fc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:30.859105 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-ee3ccad1-e0c2-49be-809a-aeb95eeac4ca tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:30.867824 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-ee3ccad1-e0c2-49be-809a-aeb95eeac4ca tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.085829 Mar 08 14:58:30.868380 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 512/1040] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:30 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:30.882500 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-c20ac55f-033c-44d3-b8a0-9a91614e95fc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041690 Mar 08 14:58:30.883042 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 529/1041] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:30 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:58:31.391163 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-81aa86b0-8725-4270-865b-fe3e6c6a2117 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:31.391772 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-81aa86b0-8725-4270-865b-fe3e6c6a2117 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:31.397603 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-81aa86b0-8725-4270-865b-fe3e6c6a2117 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:31.398088 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-81aa86b0-8725-4270-865b-fe3e6c6a2117 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:31.398853 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-81aa86b0-8725-4270-865b-fe3e6c6a2117 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:31.399288 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-81aa86b0-8725-4270-865b-fe3e6c6a2117 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:31.531391 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-81aa86b0-8725-4270-865b-fe3e6c6a2117 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:31.538571 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-81aa86b0-8725-4270-865b-fe3e6c6a2117 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.151989 Mar 08 14:58:31.539117 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 513/1042] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:31 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:31.573819 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-cb283ff2-441a-468e-967c-33b968fd4592 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:31.574749 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-cb283ff2-441a-468e-967c-33b968fd4592 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:31.581128 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cb283ff2-441a-468e-967c-33b968fd4592 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:31.581594 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cb283ff2-441a-468e-967c-33b968fd4592 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:31.582396 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cb283ff2-441a-468e-967c-33b968fd4592 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:31.582837 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cb283ff2-441a-468e-967c-33b968fd4592 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:31.611886 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-cb283ff2-441a-468e-967c-33b968fd4592 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042021 Mar 08 14:58:31.612430 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 530/1043] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:31 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:58:31.885377 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-15cce436-2bb7-4173-9433-9cc8352c7e5e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:31.886021 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-15cce436-2bb7-4173-9433-9cc8352c7e5e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:31.892444 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-15cce436-2bb7-4173-9433-9cc8352c7e5e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:31.892905 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-15cce436-2bb7-4173-9433-9cc8352c7e5e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:31.893684 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-15cce436-2bb7-4173-9433-9cc8352c7e5e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:31.893814 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-baeffa2a-795f-4431-af11-f5332ef1f67f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:31.894168 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-15cce436-2bb7-4173-9433-9cc8352c7e5e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:31.894786 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-baeffa2a-795f-4431-af11-f5332ef1f67f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:31.900400 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-baeffa2a-795f-4431-af11-f5332ef1f67f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:31.900851 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-baeffa2a-795f-4431-af11-f5332ef1f67f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:31.901613 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-baeffa2a-795f-4431-af11-f5332ef1f67f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:31.902080 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-baeffa2a-795f-4431-af11-f5332ef1f67f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:31.931092 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-baeffa2a-795f-4431-af11-f5332ef1f67f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041212 Mar 08 14:58:31.934951 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 531/1044] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:31 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:58:31.956788 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-15cce436-2bb7-4173-9433-9cc8352c7e5e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:31.964369 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-15cce436-2bb7-4173-9433-9cc8352c7e5e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.082918 Mar 08 14:58:31.964925 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 514/1045] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:31 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:32.555993 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-57f57559-b5b1-40a1-9176-33d8e91aba3e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:32.556600 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-57f57559-b5b1-40a1-9176-33d8e91aba3e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:32.562547 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-57f57559-b5b1-40a1-9176-33d8e91aba3e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:32.563005 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-57f57559-b5b1-40a1-9176-33d8e91aba3e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:32.563771 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-57f57559-b5b1-40a1-9176-33d8e91aba3e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:32.564213 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-57f57559-b5b1-40a1-9176-33d8e91aba3e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:32.623603 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-91467558-be7c-4094-ad98-47a939460c69 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:32.624787 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-91467558-be7c-4094-ad98-47a939460c69 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:32.630644 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-91467558-be7c-4094-ad98-47a939460c69 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:32.631091 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-91467558-be7c-4094-ad98-47a939460c69 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:32.631854 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-91467558-be7c-4094-ad98-47a939460c69 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:32.632288 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-91467558-be7c-4094-ad98-47a939460c69 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:32.661376 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-91467558-be7c-4094-ad98-47a939460c69 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041824 Mar 08 14:58:32.661956 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 515/1046] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:32 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:58:32.697819 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-57f57559-b5b1-40a1-9176-33d8e91aba3e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:32.705640 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-57f57559-b5b1-40a1-9176-33d8e91aba3e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.153843 Mar 08 14:58:32.706226 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 532/1047] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:32 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:32.942821 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-c2d430aa-39b1-488a-a4b8-b3a60be274e5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:32.943771 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-c2d430aa-39b1-488a-a4b8-b3a60be274e5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:32.950090 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c2d430aa-39b1-488a-a4b8-b3a60be274e5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:32.950556 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c2d430aa-39b1-488a-a4b8-b3a60be274e5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:32.952057 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c2d430aa-39b1-488a-a4b8-b3a60be274e5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:32.952562 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c2d430aa-39b1-488a-a4b8-b3a60be274e5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:32.979834 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-c2d430aa-39b1-488a-a4b8-b3a60be274e5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040941 Mar 08 14:58:32.980386 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 516/1048] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:32 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:58:32.981166 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5dfbec68-7e5c-4ffc-9bbb-2e0ca7c8545d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:32.981881 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5dfbec68-7e5c-4ffc-9bbb-2e0ca7c8545d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:32.988238 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5dfbec68-7e5c-4ffc-9bbb-2e0ca7c8545d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:32.988690 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5dfbec68-7e5c-4ffc-9bbb-2e0ca7c8545d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:32.989464 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5dfbec68-7e5c-4ffc-9bbb-2e0ca7c8545d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:32.989925 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5dfbec68-7e5c-4ffc-9bbb-2e0ca7c8545d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:33.049187 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-5dfbec68-7e5c-4ffc-9bbb-2e0ca7c8545d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:33.056561 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5dfbec68-7e5c-4ffc-9bbb-2e0ca7c8545d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079266 Mar 08 14:58:33.057128 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 533/1049] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:32 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:58:33.673500 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-addbb3f3-d0f7-4d9a-9b5b-7ba6e7f6f270 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:33.674526 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-addbb3f3-d0f7-4d9a-9b5b-7ba6e7f6f270 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:33.680705 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-addbb3f3-d0f7-4d9a-9b5b-7ba6e7f6f270 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:33.681165 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-addbb3f3-d0f7-4d9a-9b5b-7ba6e7f6f270 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:33.681967 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-addbb3f3-d0f7-4d9a-9b5b-7ba6e7f6f270 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:33.682415 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-addbb3f3-d0f7-4d9a-9b5b-7ba6e7f6f270 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:33.709523 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-addbb3f3-d0f7-4d9a-9b5b-7ba6e7f6f270 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040615 Mar 08 14:58:33.710104 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 517/1050] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:33 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:58:33.722812 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-70ff222d-047f-4e82-90c4-5dd56b3ead27 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:33.723424 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-70ff222d-047f-4e82-90c4-5dd56b3ead27 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:33.729588 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-70ff222d-047f-4e82-90c4-5dd56b3ead27 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:33.730089 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-70ff222d-047f-4e82-90c4-5dd56b3ead27 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:33.730852 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-70ff222d-047f-4e82-90c4-5dd56b3ead27 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:33.731284 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-70ff222d-047f-4e82-90c4-5dd56b3ead27 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:33.865397 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-70ff222d-047f-4e82-90c4-5dd56b3ead27 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:33.872715 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-70ff222d-047f-4e82-90c4-5dd56b3ead27 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.153718 Mar 08 14:58:33.873331 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 534/1051] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:33 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:33.991312 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-41ba2a4d-fd8d-4ad6-bf2f-34ae05d97264 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:33.992231 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-41ba2a4d-fd8d-4ad6-bf2f-34ae05d97264 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:33.998606 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-41ba2a4d-fd8d-4ad6-bf2f-34ae05d97264 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:33.999067 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-41ba2a4d-fd8d-4ad6-bf2f-34ae05d97264 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:33.999835 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-41ba2a4d-fd8d-4ad6-bf2f-34ae05d97264 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:34.000281 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-41ba2a4d-fd8d-4ad6-bf2f-34ae05d97264 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:34.027755 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-41ba2a4d-fd8d-4ad6-bf2f-34ae05d97264 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040381 Mar 08 14:58:34.028292 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 518/1052] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:33 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:58:34.074245 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-0906431e-bdc6-468e-aed4-17b6570cb215 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:34.074798 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-0906431e-bdc6-468e-aed4-17b6570cb215 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:34.081094 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0906431e-bdc6-468e-aed4-17b6570cb215 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:34.081544 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0906431e-bdc6-468e-aed4-17b6570cb215 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:34.082346 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0906431e-bdc6-468e-aed4-17b6570cb215 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:34.082815 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0906431e-bdc6-468e-aed4-17b6570cb215 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:34.142071 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-0906431e-bdc6-468e-aed4-17b6570cb215 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:34.149742 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-0906431e-bdc6-468e-aed4-17b6570cb215 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079260 Mar 08 14:58:34.150365 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 535/1053] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:34 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:34.720765 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-3a7ab90b-cd4c-4362-b182-ed44a9a7b721 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:34.721670 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-3a7ab90b-cd4c-4362-b182-ed44a9a7b721 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:34.727710 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3a7ab90b-cd4c-4362-b182-ed44a9a7b721 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:34.728169 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3a7ab90b-cd4c-4362-b182-ed44a9a7b721 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:34.728940 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3a7ab90b-cd4c-4362-b182-ed44a9a7b721 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:34.729386 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3a7ab90b-cd4c-4362-b182-ed44a9a7b721 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:34.758090 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-3a7ab90b-cd4c-4362-b182-ed44a9a7b721 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041306 Mar 08 14:58:34.758629 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 519/1054] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:34 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:58:34.889643 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-7785a381-bf65-4464-bc55-b1eac23adf91 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:34.890363 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-7785a381-bf65-4464-bc55-b1eac23adf91 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:34.897412 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7785a381-bf65-4464-bc55-b1eac23adf91 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:34.897872 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7785a381-bf65-4464-bc55-b1eac23adf91 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:34.898656 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7785a381-bf65-4464-bc55-b1eac23adf91 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:34.899089 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7785a381-bf65-4464-bc55-b1eac23adf91 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:35.030214 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-7785a381-bf65-4464-bc55-b1eac23adf91 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:35.037649 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-7785a381-bf65-4464-bc55-b1eac23adf91 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.151862 Mar 08 14:58:35.038250 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 536/1055] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:34 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:35.039751 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-48cbb248-2742-4c30-a686-aa93351f445d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:35.040668 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-48cbb248-2742-4c30-a686-aa93351f445d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:35.047297 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-48cbb248-2742-4c30-a686-aa93351f445d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:35.047750 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-48cbb248-2742-4c30-a686-aa93351f445d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:35.048513 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-48cbb248-2742-4c30-a686-aa93351f445d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:35.048948 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-48cbb248-2742-4c30-a686-aa93351f445d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:35.077955 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-48cbb248-2742-4c30-a686-aa93351f445d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042080 Mar 08 14:58:35.078502 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 520/1056] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:35 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:58:35.168350 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-8c2ac1c9-c3c6-428b-a262-8c7394f3fd24 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:35.168957 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-8c2ac1c9-c3c6-428b-a262-8c7394f3fd24 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:35.174779 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8c2ac1c9-c3c6-428b-a262-8c7394f3fd24 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:35.175227 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8c2ac1c9-c3c6-428b-a262-8c7394f3fd24 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:35.175992 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8c2ac1c9-c3c6-428b-a262-8c7394f3fd24 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:35.176426 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8c2ac1c9-c3c6-428b-a262-8c7394f3fd24 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:35.234762 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-8c2ac1c9-c3c6-428b-a262-8c7394f3fd24 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:35.241869 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-8c2ac1c9-c3c6-428b-a262-8c7394f3fd24 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.077371 Mar 08 14:58:35.242498 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 537/1057] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:35 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:35.768807 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-e7bcb9a5-83dd-45e9-9670-3383b761a2e2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:35.769680 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-e7bcb9a5-83dd-45e9-9670-3383b761a2e2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:35.775569 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e7bcb9a5-83dd-45e9-9670-3383b761a2e2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:35.776025 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e7bcb9a5-83dd-45e9-9670-3383b761a2e2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:35.776801 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e7bcb9a5-83dd-45e9-9670-3383b761a2e2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:35.777245 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e7bcb9a5-83dd-45e9-9670-3383b761a2e2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:35.805828 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-e7bcb9a5-83dd-45e9-9670-3383b761a2e2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041104 Mar 08 14:58:35.806401 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 521/1058] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:35 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:58:36.055525 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-27856c49-8c15-4fe2-9175-07359a008120 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:36.056100 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-27856c49-8c15-4fe2-9175-07359a008120 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:36.062629 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-27856c49-8c15-4fe2-9175-07359a008120 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:36.063091 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-27856c49-8c15-4fe2-9175-07359a008120 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:36.063864 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-27856c49-8c15-4fe2-9175-07359a008120 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:36.064308 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-27856c49-8c15-4fe2-9175-07359a008120 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:36.088858 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-e33d157e-6576-4bb6-9036-1867fa30e31b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:36.089876 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-e33d157e-6576-4bb6-9036-1867fa30e31b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:36.096893 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e33d157e-6576-4bb6-9036-1867fa30e31b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:36.097347 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e33d157e-6576-4bb6-9036-1867fa30e31b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:36.098144 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e33d157e-6576-4bb6-9036-1867fa30e31b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:36.098583 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e33d157e-6576-4bb6-9036-1867fa30e31b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:36.126419 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-e33d157e-6576-4bb6-9036-1867fa30e31b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041496 Mar 08 14:58:36.126977 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 522/1059] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:36 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:58:36.205250 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-27856c49-8c15-4fe2-9175-07359a008120 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:36.211576 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-27856c49-8c15-4fe2-9175-07359a008120 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.160225 Mar 08 14:58:36.212133 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 538/1060] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:36 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:36.259029 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-fd24a748-312e-463d-97e2-d040f7e5a602 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:36.259636 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-fd24a748-312e-463d-97e2-d040f7e5a602 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:36.266028 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fd24a748-312e-463d-97e2-d040f7e5a602 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:36.266480 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fd24a748-312e-463d-97e2-d040f7e5a602 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:36.267243 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fd24a748-312e-463d-97e2-d040f7e5a602 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:36.267676 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fd24a748-312e-463d-97e2-d040f7e5a602 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:36.329291 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-fd24a748-312e-463d-97e2-d040f7e5a602 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:36.336722 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-fd24a748-312e-463d-97e2-d040f7e5a602 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081466 Mar 08 14:58:36.337305 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 523/1061] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:36 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:36.817374 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-37d07d1a-8e08-4af9-aac6-3007c2455145 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:36.818304 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-37d07d1a-8e08-4af9-aac6-3007c2455145 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:36.824090 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-37d07d1a-8e08-4af9-aac6-3007c2455145 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:36.824559 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-37d07d1a-8e08-4af9-aac6-3007c2455145 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:36.825317 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-37d07d1a-8e08-4af9-aac6-3007c2455145 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:36.825748 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-37d07d1a-8e08-4af9-aac6-3007c2455145 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:36.853255 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-37d07d1a-8e08-4af9-aac6-3007c2455145 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039852 Mar 08 14:58:36.853800 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 539/1062] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:36 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:58:37.138009 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-2b0d1361-6e85-4584-be1d-810b8a7bf7c1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:37.139078 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-2b0d1361-6e85-4584-be1d-810b8a7bf7c1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:37.145387 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2b0d1361-6e85-4584-be1d-810b8a7bf7c1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:37.145838 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2b0d1361-6e85-4584-be1d-810b8a7bf7c1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:37.146630 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2b0d1361-6e85-4584-be1d-810b8a7bf7c1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:37.147067 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2b0d1361-6e85-4584-be1d-810b8a7bf7c1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:37.175378 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-2b0d1361-6e85-4584-be1d-810b8a7bf7c1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041414 Mar 08 14:58:37.175910 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 524/1063] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:37 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:58:37.229167 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-26a89c4b-0462-4ec5-bb36-39d8a65f5a5d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:37.229778 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-26a89c4b-0462-4ec5-bb36-39d8a65f5a5d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:37.236580 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-26a89c4b-0462-4ec5-bb36-39d8a65f5a5d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:37.237033 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-26a89c4b-0462-4ec5-bb36-39d8a65f5a5d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:37.237805 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-26a89c4b-0462-4ec5-bb36-39d8a65f5a5d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:37.238269 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-26a89c4b-0462-4ec5-bb36-39d8a65f5a5d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:37.354113 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-04e8a3de-aef7-491b-b9d9-a29fd819a741 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:37.354732 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-04e8a3de-aef7-491b-b9d9-a29fd819a741 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:37.361345 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-04e8a3de-aef7-491b-b9d9-a29fd819a741 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:37.361796 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-04e8a3de-aef7-491b-b9d9-a29fd819a741 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:37.362623 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-04e8a3de-aef7-491b-b9d9-a29fd819a741 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:37.363059 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-04e8a3de-aef7-491b-b9d9-a29fd819a741 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:37.371578 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-26a89c4b-0462-4ec5-bb36-39d8a65f5a5d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:37.379805 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-26a89c4b-0462-4ec5-bb36-39d8a65f5a5d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.154481 Mar 08 14:58:37.380498 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 540/1064] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:37 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:58:37.422937 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-04e8a3de-aef7-491b-b9d9-a29fd819a741 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:37.430583 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-04e8a3de-aef7-491b-b9d9-a29fd819a741 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080281 Mar 08 14:58:37.431140 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 525/1065] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:37 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:58:37.864713 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c5c37db3-d655-40e2-8b6d-926a830b87c0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:37.865625 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-c5c37db3-d655-40e2-8b6d-926a830b87c0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:37.871621 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c5c37db3-d655-40e2-8b6d-926a830b87c0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:37.872075 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c5c37db3-d655-40e2-8b6d-926a830b87c0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:37.872840 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c5c37db3-d655-40e2-8b6d-926a830b87c0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:37.873436 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c5c37db3-d655-40e2-8b6d-926a830b87c0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:37.900656 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-c5c37db3-d655-40e2-8b6d-926a830b87c0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039969 Mar 08 14:58:37.901187 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 541/1066] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:37 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:58:38.187490 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-84f9d0ce-bf4e-45a3-b0f7-78f200d82f3b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:38.188362 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-84f9d0ce-bf4e-45a3-b0f7-78f200d82f3b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:38.194701 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-84f9d0ce-bf4e-45a3-b0f7-78f200d82f3b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:38.195161 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-84f9d0ce-bf4e-45a3-b0f7-78f200d82f3b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:38.195934 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-84f9d0ce-bf4e-45a3-b0f7-78f200d82f3b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:38.196377 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-84f9d0ce-bf4e-45a3-b0f7-78f200d82f3b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:38.224499 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-84f9d0ce-bf4e-45a3-b0f7-78f200d82f3b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041574 Mar 08 14:58:38.225047 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 526/1067] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:38 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:58:38.396525 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ac60d7a8-dfbf-422e-b01a-11e5a2f739c8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:38.397146 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ac60d7a8-dfbf-422e-b01a-11e5a2f739c8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:38.403404 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ac60d7a8-dfbf-422e-b01a-11e5a2f739c8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:38.403860 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ac60d7a8-dfbf-422e-b01a-11e5a2f739c8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:38.404655 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ac60d7a8-dfbf-422e-b01a-11e5a2f739c8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:38.405095 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ac60d7a8-dfbf-422e-b01a-11e5a2f739c8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:38.447395 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-17fe36b6-1c85-4342-b106-18db380e9c47 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:38.447924 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-17fe36b6-1c85-4342-b106-18db380e9c47 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:38.454354 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-17fe36b6-1c85-4342-b106-18db380e9c47 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:38.454813 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-17fe36b6-1c85-4342-b106-18db380e9c47 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:38.455616 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-17fe36b6-1c85-4342-b106-18db380e9c47 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:38.456058 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-17fe36b6-1c85-4342-b106-18db380e9c47 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:38.517890 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-17fe36b6-1c85-4342-b106-18db380e9c47 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:38.525348 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-17fe36b6-1c85-4342-b106-18db380e9c47 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081945 Mar 08 14:58:38.526141 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 527/1068] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:38 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:58:38.542127 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ac60d7a8-dfbf-422e-b01a-11e5a2f739c8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:38.550445 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ac60d7a8-dfbf-422e-b01a-11e5a2f739c8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.157811 Mar 08 14:58:38.550995 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 542/1069] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:38 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:38.912134 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-ea000e51-9bb7-474d-9df2-504f89d4f677 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:38.913091 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-ea000e51-9bb7-474d-9df2-504f89d4f677 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:38.918955 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ea000e51-9bb7-474d-9df2-504f89d4f677 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:38.919410 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ea000e51-9bb7-474d-9df2-504f89d4f677 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:38.920831 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ea000e51-9bb7-474d-9df2-504f89d4f677 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:38.921290 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ea000e51-9bb7-474d-9df2-504f89d4f677 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:38.949218 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-ea000e51-9bb7-474d-9df2-504f89d4f677 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041145 Mar 08 14:58:38.949771 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 528/1070] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:38 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:58:39.236509 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c87838bd-cb77-43b3-b81a-18bbfeca3ac4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:39.237522 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-c87838bd-cb77-43b3-b81a-18bbfeca3ac4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:39.243412 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c87838bd-cb77-43b3-b81a-18bbfeca3ac4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:39.243860 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c87838bd-cb77-43b3-b81a-18bbfeca3ac4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:39.244621 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c87838bd-cb77-43b3-b81a-18bbfeca3ac4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:39.245058 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c87838bd-cb77-43b3-b81a-18bbfeca3ac4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:39.272459 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-c87838bd-cb77-43b3-b81a-18bbfeca3ac4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040460 Mar 08 14:58:39.272990 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 543/1071] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:39 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:58:39.542865 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-564582e0-e036-4cff-8b68-ee107727cfd2 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:39.543477 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-564582e0-e036-4cff-8b68-ee107727cfd2 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:39.550740 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-564582e0-e036-4cff-8b68-ee107727cfd2 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:39.551198 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-564582e0-e036-4cff-8b68-ee107727cfd2 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:39.551966 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-564582e0-e036-4cff-8b68-ee107727cfd2 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:39.552411 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-564582e0-e036-4cff-8b68-ee107727cfd2 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:39.568003 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-8b414b65-8559-4069-b195-7328948d1c7b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:39.568610 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-8b414b65-8559-4069-b195-7328948d1c7b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:39.574769 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8b414b65-8559-4069-b195-7328948d1c7b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:39.575217 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8b414b65-8559-4069-b195-7328948d1c7b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:39.575976 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8b414b65-8559-4069-b195-7328948d1c7b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:39.576410 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8b414b65-8559-4069-b195-7328948d1c7b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:39.613774 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-564582e0-e036-4cff-8b68-ee107727cfd2 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:39.621259 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-564582e0-e036-4cff-8b68-ee107727cfd2 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.082227 Mar 08 14:58:39.621827 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 529/1072] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:39 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:39.710069 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-8b414b65-8559-4069-b195-7328948d1c7b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:39.717758 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-8b414b65-8559-4069-b195-7328948d1c7b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.153541 Mar 08 14:58:39.718345 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 544/1073] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:39 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:58:39.960747 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-56124780-80a4-404b-adcd-3334e0271a09 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:39.961658 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-56124780-80a4-404b-adcd-3334e0271a09 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:39.968379 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-56124780-80a4-404b-adcd-3334e0271a09 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:39.968832 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-56124780-80a4-404b-adcd-3334e0271a09 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:39.969601 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-56124780-80a4-404b-adcd-3334e0271a09 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:39.970089 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-56124780-80a4-404b-adcd-3334e0271a09 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:39.996730 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-56124780-80a4-404b-adcd-3334e0271a09 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040006 Mar 08 14:58:39.997265 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 530/1074] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:39 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:58:40.284153 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-52671ac6-b078-41c1-ac91-52a50cb496a0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:40.285089 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-52671ac6-b078-41c1-ac91-52a50cb496a0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:40.290875 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-52671ac6-b078-41c1-ac91-52a50cb496a0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:40.291320 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-52671ac6-b078-41c1-ac91-52a50cb496a0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:40.292106 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-52671ac6-b078-41c1-ac91-52a50cb496a0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:40.292540 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-52671ac6-b078-41c1-ac91-52a50cb496a0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:40.319837 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-52671ac6-b078-41c1-ac91-52a50cb496a0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039686 Mar 08 14:58:40.320363 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 545/1075] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:40 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:58:40.637500 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b15d06e8-182c-4c40-9428-bb7ff5fa79ba tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:40.638047 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-b15d06e8-182c-4c40-9428-bb7ff5fa79ba tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:40.644432 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b15d06e8-182c-4c40-9428-bb7ff5fa79ba tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:40.644884 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b15d06e8-182c-4c40-9428-bb7ff5fa79ba tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:40.645649 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b15d06e8-182c-4c40-9428-bb7ff5fa79ba tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:40.646116 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b15d06e8-182c-4c40-9428-bb7ff5fa79ba tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:40.707749 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-b15d06e8-182c-4c40-9428-bb7ff5fa79ba tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:40.715002 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-b15d06e8-182c-4c40-9428-bb7ff5fa79ba tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081358 Mar 08 14:58:40.715569 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 531/1076] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:40 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:40.735138 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-02acc192-2a86-4c1f-8a7a-89a8bfea5aaf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:40.735744 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-02acc192-2a86-4c1f-8a7a-89a8bfea5aaf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:40.741898 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-02acc192-2a86-4c1f-8a7a-89a8bfea5aaf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:40.742351 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-02acc192-2a86-4c1f-8a7a-89a8bfea5aaf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:40.743108 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-02acc192-2a86-4c1f-8a7a-89a8bfea5aaf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:40.743537 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-02acc192-2a86-4c1f-8a7a-89a8bfea5aaf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:40.879772 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-02acc192-2a86-4c1f-8a7a-89a8bfea5aaf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:40.886983 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-02acc192-2a86-4c1f-8a7a-89a8bfea5aaf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.156256 Mar 08 14:58:40.887596 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 546/1077] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:40 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:41.008896 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-fe2f458f-b967-4e7c-aa1d-03a266cb6193 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:41.009804 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-fe2f458f-b967-4e7c-aa1d-03a266cb6193 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:41.015761 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fe2f458f-b967-4e7c-aa1d-03a266cb6193 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:41.016210 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fe2f458f-b967-4e7c-aa1d-03a266cb6193 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:41.016977 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fe2f458f-b967-4e7c-aa1d-03a266cb6193 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:41.017420 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fe2f458f-b967-4e7c-aa1d-03a266cb6193 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:41.045977 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-fe2f458f-b967-4e7c-aa1d-03a266cb6193 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040423 Mar 08 14:58:41.046523 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 532/1078] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:41 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:58:41.331984 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-789dd315-8a91-4483-b485-5ffd32a01456 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:41.332942 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-789dd315-8a91-4483-b485-5ffd32a01456 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:41.338873 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-789dd315-8a91-4483-b485-5ffd32a01456 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:41.339325 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-789dd315-8a91-4483-b485-5ffd32a01456 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:41.340106 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-789dd315-8a91-4483-b485-5ffd32a01456 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:41.340547 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-789dd315-8a91-4483-b485-5ffd32a01456 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:41.367988 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-789dd315-8a91-4483-b485-5ffd32a01456 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040004 Mar 08 14:58:41.368532 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 547/1079] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:41 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:58:41.732040 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-1e7449b1-00a2-4bfe-8af7-2720fc088623 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:41.732809 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-1e7449b1-00a2-4bfe-8af7-2720fc088623 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:41.739075 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1e7449b1-00a2-4bfe-8af7-2720fc088623 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:41.739542 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1e7449b1-00a2-4bfe-8af7-2720fc088623 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:41.740312 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1e7449b1-00a2-4bfe-8af7-2720fc088623 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:41.740755 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1e7449b1-00a2-4bfe-8af7-2720fc088623 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:41.904268 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-19d7ff6d-5129-4fca-94c3-164d4957bce3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:41.904971 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-19d7ff6d-5129-4fca-94c3-164d4957bce3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:41.911442 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-19d7ff6d-5129-4fca-94c3-164d4957bce3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:41.911897 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-19d7ff6d-5129-4fca-94c3-164d4957bce3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:41.912681 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-19d7ff6d-5129-4fca-94c3-164d4957bce3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:41.913120 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-19d7ff6d-5129-4fca-94c3-164d4957bce3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:42.062970 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-1e7449b1-00a2-4bfe-8af7-2720fc088623 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:42.070803 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-1e7449b1-00a2-4bfe-8af7-2720fc088623 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.342528 Mar 08 14:58:42.071385 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 533/1080] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:41 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:42.076402 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-ec08a7b0-57ce-4f84-801f-a627461ae5e8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:42.077464 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-ec08a7b0-57ce-4f84-801f-a627461ae5e8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:42.083850 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ec08a7b0-57ce-4f84-801f-a627461ae5e8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:42.084311 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ec08a7b0-57ce-4f84-801f-a627461ae5e8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:42.085128 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ec08a7b0-57ce-4f84-801f-a627461ae5e8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:42.085571 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ec08a7b0-57ce-4f84-801f-a627461ae5e8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:42.115711 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-ec08a7b0-57ce-4f84-801f-a627461ae5e8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043242 Mar 08 14:58:42.116296 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 534/1081] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:42 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:58:42.281665 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-19d7ff6d-5129-4fca-94c3-164d4957bce3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:42.289132 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-19d7ff6d-5129-4fca-94c3-164d4957bce3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.388821 Mar 08 14:58:42.289697 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 548/1082] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:41 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:58:42.380648 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-638d75f7-4507-4d6c-a738-53cda0cd1a6b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:42.381531 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-638d75f7-4507-4d6c-a738-53cda0cd1a6b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:42.387328 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-638d75f7-4507-4d6c-a738-53cda0cd1a6b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:42.387777 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-638d75f7-4507-4d6c-a738-53cda0cd1a6b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:42.388533 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-638d75f7-4507-4d6c-a738-53cda0cd1a6b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:42.389075 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-638d75f7-4507-4d6c-a738-53cda0cd1a6b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:42.418468 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-638d75f7-4507-4d6c-a738-53cda0cd1a6b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042014 Mar 08 14:58:42.419017 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 535/1083] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:42 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:58:43.088191 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-db5bb980-c494-4d30-9705-d8466f518df5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:43.088826 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-db5bb980-c494-4d30-9705-d8466f518df5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:43.095653 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-db5bb980-c494-4d30-9705-d8466f518df5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:43.096099 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-db5bb980-c494-4d30-9705-d8466f518df5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:43.096859 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-db5bb980-c494-4d30-9705-d8466f518df5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:43.097292 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-db5bb980-c494-4d30-9705-d8466f518df5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:43.127406 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-e145deba-405d-457e-b18b-78ef214cc499 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:43.128321 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-e145deba-405d-457e-b18b-78ef214cc499 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:43.134693 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e145deba-405d-457e-b18b-78ef214cc499 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:43.135152 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e145deba-405d-457e-b18b-78ef214cc499 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:43.135930 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e145deba-405d-457e-b18b-78ef214cc499 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:43.136372 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e145deba-405d-457e-b18b-78ef214cc499 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:43.156032 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-db5bb980-c494-4d30-9705-d8466f518df5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:43.163407 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-db5bb980-c494-4d30-9705-d8466f518df5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079075 Mar 08 14:58:43.163973 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 549/1084] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:43 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:43.165784 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-e145deba-405d-457e-b18b-78ef214cc499 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042254 Mar 08 14:58:43.166373 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 536/1085] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:43 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:58:43.307125 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-e9add169-2c49-47f7-9a60-1e400beab7dd tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:43.307741 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-e9add169-2c49-47f7-9a60-1e400beab7dd tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:43.314217 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e9add169-2c49-47f7-9a60-1e400beab7dd tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:43.314679 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e9add169-2c49-47f7-9a60-1e400beab7dd tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:43.315458 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e9add169-2c49-47f7-9a60-1e400beab7dd tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:43.315900 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e9add169-2c49-47f7-9a60-1e400beab7dd tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:43.431006 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-9724a509-068f-45b7-8d2f-048696b4066d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:43.431946 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-9724a509-068f-45b7-8d2f-048696b4066d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:43.438420 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9724a509-068f-45b7-8d2f-048696b4066d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:43.438869 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9724a509-068f-45b7-8d2f-048696b4066d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:43.439641 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9724a509-068f-45b7-8d2f-048696b4066d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:43.440079 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9724a509-068f-45b7-8d2f-048696b4066d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:43.451892 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-e9add169-2c49-47f7-9a60-1e400beab7dd tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:43.459177 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-e9add169-2c49-47f7-9a60-1e400beab7dd tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.156137 Mar 08 14:58:43.459736 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 550/1086] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:43 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:58:43.468665 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-9724a509-068f-45b7-8d2f-048696b4066d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041969 Mar 08 14:58:43.469204 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 537/1087] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:43 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:58:44.177269 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-df7b5c87-43bc-4de7-8acb-6271b5cf580f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:44.178310 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-df7b5c87-43bc-4de7-8acb-6271b5cf580f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:44.179498 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-38fe51ea-d6ab-499c-a1c2-e49aee73358e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:44.180117 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-38fe51ea-d6ab-499c-a1c2-e49aee73358e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:44.184900 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-df7b5c87-43bc-4de7-8acb-6271b5cf580f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:44.185361 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-df7b5c87-43bc-4de7-8acb-6271b5cf580f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:44.186117 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-38fe51ea-d6ab-499c-a1c2-e49aee73358e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:44.186258 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-df7b5c87-43bc-4de7-8acb-6271b5cf580f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:44.186589 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-38fe51ea-d6ab-499c-a1c2-e49aee73358e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:44.186705 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-df7b5c87-43bc-4de7-8acb-6271b5cf580f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:44.187368 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-38fe51ea-d6ab-499c-a1c2-e49aee73358e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:44.187817 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-38fe51ea-d6ab-499c-a1c2-e49aee73358e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:44.215736 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-df7b5c87-43bc-4de7-8acb-6271b5cf580f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042367 Mar 08 14:58:44.216188 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 551/1088] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:44 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:58:44.248601 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-38fe51ea-d6ab-499c-a1c2-e49aee73358e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:44.256046 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-38fe51ea-d6ab-499c-a1c2-e49aee73358e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080599 Mar 08 14:58:44.256600 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 538/1089] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:44 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:58:44.476423 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-2e912967-a003-41ea-9c98-c51e99f8cf85 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:44.477102 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-2e912967-a003-41ea-9c98-c51e99f8cf85 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:44.479255 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-aa6e4111-783c-4c22-85f1-69076f89e278 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:44.480179 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-aa6e4111-783c-4c22-85f1-69076f89e278 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:44.483470 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2e912967-a003-41ea-9c98-c51e99f8cf85 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:44.483930 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2e912967-a003-41ea-9c98-c51e99f8cf85 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:44.484703 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2e912967-a003-41ea-9c98-c51e99f8cf85 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:44.485143 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2e912967-a003-41ea-9c98-c51e99f8cf85 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:44.486433 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-aa6e4111-783c-4c22-85f1-69076f89e278 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:44.486896 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-aa6e4111-783c-4c22-85f1-69076f89e278 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:44.487671 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-aa6e4111-783c-4c22-85f1-69076f89e278 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:44.488114 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-aa6e4111-783c-4c22-85f1-69076f89e278 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:44.516502 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-aa6e4111-783c-4c22-85f1-69076f89e278 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041177 Mar 08 14:58:44.517065 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 539/1090] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:44 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:58:44.622287 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-2e912967-a003-41ea-9c98-c51e99f8cf85 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:44.629704 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-2e912967-a003-41ea-9c98-c51e99f8cf85 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.157279 Mar 08 14:58:44.630289 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 552/1091] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:44 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:45.228099 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-48729139-6f1a-4ddc-8568-8c9542348f74 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:45.229004 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-48729139-6f1a-4ddc-8568-8c9542348f74 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:45.235459 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-48729139-6f1a-4ddc-8568-8c9542348f74 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:45.235908 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-48729139-6f1a-4ddc-8568-8c9542348f74 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:45.236672 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-48729139-6f1a-4ddc-8568-8c9542348f74 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:45.237137 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-48729139-6f1a-4ddc-8568-8c9542348f74 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:45.267369 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-48729139-6f1a-4ddc-8568-8c9542348f74 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043194 Mar 08 14:58:45.267919 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 540/1092] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:45 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:58:45.272343 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-0796172a-4bf3-45b2-a929-82dd2c6e46ec tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:45.272952 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-0796172a-4bf3-45b2-a929-82dd2c6e46ec tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:45.279138 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0796172a-4bf3-45b2-a929-82dd2c6e46ec tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:45.279599 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0796172a-4bf3-45b2-a929-82dd2c6e46ec tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:45.280368 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0796172a-4bf3-45b2-a929-82dd2c6e46ec tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:45.280801 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0796172a-4bf3-45b2-a929-82dd2c6e46ec tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:45.340288 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-0796172a-4bf3-45b2-a929-82dd2c6e46ec tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:45.347617 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-0796172a-4bf3-45b2-a929-82dd2c6e46ec tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079042 Mar 08 14:58:45.348167 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 553/1093] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:45 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:58:45.528258 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-f27efa8b-2728-4d82-81f8-ff4f5864327d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:45.529717 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-f27efa8b-2728-4d82-81f8-ff4f5864327d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:45.535929 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f27efa8b-2728-4d82-81f8-ff4f5864327d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:45.536382 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f27efa8b-2728-4d82-81f8-ff4f5864327d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:45.537139 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f27efa8b-2728-4d82-81f8-ff4f5864327d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:45.537577 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f27efa8b-2728-4d82-81f8-ff4f5864327d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:45.565408 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-f27efa8b-2728-4d82-81f8-ff4f5864327d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041146 Mar 08 14:58:45.565971 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 541/1094] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:45 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:58:45.647391 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f1e0f583-a867-4794-8a50-7a4e7d9e0b5a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:45.648012 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f1e0f583-a867-4794-8a50-7a4e7d9e0b5a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:45.653801 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f1e0f583-a867-4794-8a50-7a4e7d9e0b5a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:45.655227 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f1e0f583-a867-4794-8a50-7a4e7d9e0b5a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:45.656012 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f1e0f583-a867-4794-8a50-7a4e7d9e0b5a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:45.656454 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f1e0f583-a867-4794-8a50-7a4e7d9e0b5a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:45.792323 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f1e0f583-a867-4794-8a50-7a4e7d9e0b5a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:45.799906 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f1e0f583-a867-4794-8a50-7a4e7d9e0b5a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.156382 Mar 08 14:58:45.800459 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 554/1095] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:45 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:46.280785 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-a9cd0c63-dc9c-45c0-a717-e7f1876b2e2e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:46.281728 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-a9cd0c63-dc9c-45c0-a717-e7f1876b2e2e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:46.287627 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a9cd0c63-dc9c-45c0-a717-e7f1876b2e2e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:46.288114 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a9cd0c63-dc9c-45c0-a717-e7f1876b2e2e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:46.288882 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a9cd0c63-dc9c-45c0-a717-e7f1876b2e2e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:46.289324 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a9cd0c63-dc9c-45c0-a717-e7f1876b2e2e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:46.318428 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-a9cd0c63-dc9c-45c0-a717-e7f1876b2e2e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042204 Mar 08 14:58:46.318973 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 542/1096] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:46 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:58:46.364414 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d9e3c660-6b84-40bf-adc2-13bbe23f0523 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:46.365020 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d9e3c660-6b84-40bf-adc2-13bbe23f0523 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:46.371258 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d9e3c660-6b84-40bf-adc2-13bbe23f0523 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:46.371708 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d9e3c660-6b84-40bf-adc2-13bbe23f0523 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:46.372473 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d9e3c660-6b84-40bf-adc2-13bbe23f0523 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:46.374133 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d9e3c660-6b84-40bf-adc2-13bbe23f0523 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:46.437727 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d9e3c660-6b84-40bf-adc2-13bbe23f0523 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:46.444893 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d9e3c660-6b84-40bf-adc2-13bbe23f0523 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.084263 Mar 08 14:58:46.445440 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 555/1097] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:46 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:46.576773 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-42b43c85-8a9f-464c-b505-26d832c52adb tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:46.577626 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-42b43c85-8a9f-464c-b505-26d832c52adb tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:46.583922 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-42b43c85-8a9f-464c-b505-26d832c52adb tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:46.584381 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-42b43c85-8a9f-464c-b505-26d832c52adb tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:46.585177 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-42b43c85-8a9f-464c-b505-26d832c52adb tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:46.585623 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-42b43c85-8a9f-464c-b505-26d832c52adb tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:46.613099 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-42b43c85-8a9f-464c-b505-26d832c52adb tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040508 Mar 08 14:58:46.613647 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 543/1098] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:46 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:58:46.817252 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3a168856-f96b-4e00-b653-7ad14d02cec6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:46.817875 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-3a168856-f96b-4e00-b653-7ad14d02cec6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:46.823827 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3a168856-f96b-4e00-b653-7ad14d02cec6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:46.824279 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3a168856-f96b-4e00-b653-7ad14d02cec6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:46.825037 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3a168856-f96b-4e00-b653-7ad14d02cec6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:46.825471 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3a168856-f96b-4e00-b653-7ad14d02cec6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:46.956626 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-3a168856-f96b-4e00-b653-7ad14d02cec6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:46.963878 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-3a168856-f96b-4e00-b653-7ad14d02cec6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.150440 Mar 08 14:58:46.964431 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 556/1099] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:46 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:47.330994 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-47f25914-7895-4ec2-8ca9-8573482f0d43 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:47.331897 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-47f25914-7895-4ec2-8ca9-8573482f0d43 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:47.337735 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-47f25914-7895-4ec2-8ca9-8573482f0d43 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:47.338215 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-47f25914-7895-4ec2-8ca9-8573482f0d43 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:47.338981 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-47f25914-7895-4ec2-8ca9-8573482f0d43 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:47.339416 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-47f25914-7895-4ec2-8ca9-8573482f0d43 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:47.367699 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-47f25914-7895-4ec2-8ca9-8573482f0d43 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041444 Mar 08 14:58:47.368229 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 544/1100] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:47 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:58:47.462197 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-8b3bc71e-1345-45a3-9360-e171ddb67f9b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:47.462805 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-8b3bc71e-1345-45a3-9360-e171ddb67f9b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:47.469640 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8b3bc71e-1345-45a3-9360-e171ddb67f9b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:47.470128 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8b3bc71e-1345-45a3-9360-e171ddb67f9b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:47.470894 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8b3bc71e-1345-45a3-9360-e171ddb67f9b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:47.471326 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8b3bc71e-1345-45a3-9360-e171ddb67f9b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:47.532696 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-8b3bc71e-1345-45a3-9360-e171ddb67f9b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:47.539980 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-8b3bc71e-1345-45a3-9360-e171ddb67f9b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081646 Mar 08 14:58:47.540531 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 557/1101] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:47 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:47.624407 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-a1025565-b9fa-48a2-a839-4808e8f3573b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:47.625301 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-a1025565-b9fa-48a2-a839-4808e8f3573b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:47.631535 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a1025565-b9fa-48a2-a839-4808e8f3573b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:47.631986 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a1025565-b9fa-48a2-a839-4808e8f3573b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:47.632748 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a1025565-b9fa-48a2-a839-4808e8f3573b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:47.633182 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a1025565-b9fa-48a2-a839-4808e8f3573b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:47.661357 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-a1025565-b9fa-48a2-a839-4808e8f3573b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040987 Mar 08 14:58:47.661917 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 545/1102] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:47 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:58:47.981898 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-6f08bb73-e27f-40dc-99f6-0f1c66d3ccd4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:47.982528 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-6f08bb73-e27f-40dc-99f6-0f1c66d3ccd4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:47.988367 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6f08bb73-e27f-40dc-99f6-0f1c66d3ccd4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:47.988820 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6f08bb73-e27f-40dc-99f6-0f1c66d3ccd4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:47.989585 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6f08bb73-e27f-40dc-99f6-0f1c66d3ccd4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:47.990055 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6f08bb73-e27f-40dc-99f6-0f1c66d3ccd4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:48.121470 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-6f08bb73-e27f-40dc-99f6-0f1c66d3ccd4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:48.129513 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-6f08bb73-e27f-40dc-99f6-0f1c66d3ccd4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.151522 Mar 08 14:58:48.130109 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 558/1103] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:47 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:48.380042 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-d2d5e2f9-b6b5-4a99-9f4f-2b4108336e13 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:48.380979 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-d2d5e2f9-b6b5-4a99-9f4f-2b4108336e13 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:48.386852 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d2d5e2f9-b6b5-4a99-9f4f-2b4108336e13 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:48.387303 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d2d5e2f9-b6b5-4a99-9f4f-2b4108336e13 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:48.388068 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d2d5e2f9-b6b5-4a99-9f4f-2b4108336e13 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:48.388701 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d2d5e2f9-b6b5-4a99-9f4f-2b4108336e13 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:48.416342 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-d2d5e2f9-b6b5-4a99-9f4f-2b4108336e13 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040243 Mar 08 14:58:48.416874 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 546/1104] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:48 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:58:48.556668 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-6c7fc7f0-0e7b-4cec-9547-6cb2b5d2c914 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:48.557277 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-6c7fc7f0-0e7b-4cec-9547-6cb2b5d2c914 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:48.563929 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6c7fc7f0-0e7b-4cec-9547-6cb2b5d2c914 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:48.564384 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6c7fc7f0-0e7b-4cec-9547-6cb2b5d2c914 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:48.565160 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6c7fc7f0-0e7b-4cec-9547-6cb2b5d2c914 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:48.565602 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6c7fc7f0-0e7b-4cec-9547-6cb2b5d2c914 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:48.625972 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-6c7fc7f0-0e7b-4cec-9547-6cb2b5d2c914 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:48.633314 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-6c7fc7f0-0e7b-4cec-9547-6cb2b5d2c914 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080710 Mar 08 14:58:48.633816 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 559/1105] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:48 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:48.673480 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-43be6105-e577-4727-ba99-29d7e9c62e89 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:48.674413 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-43be6105-e577-4727-ba99-29d7e9c62e89 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:48.680831 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-43be6105-e577-4727-ba99-29d7e9c62e89 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:48.681273 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-43be6105-e577-4727-ba99-29d7e9c62e89 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:48.682092 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-43be6105-e577-4727-ba99-29d7e9c62e89 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:48.682529 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-43be6105-e577-4727-ba99-29d7e9c62e89 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:48.709871 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-43be6105-e577-4727-ba99-29d7e9c62e89 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041009 Mar 08 14:58:48.710411 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 547/1106] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:48 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:58:49.146586 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-906c84c4-fd50-45fb-a743-aaeb1d9ad635 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:49.147187 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-906c84c4-fd50-45fb-a743-aaeb1d9ad635 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:49.153231 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-906c84c4-fd50-45fb-a743-aaeb1d9ad635 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:49.153684 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-906c84c4-fd50-45fb-a743-aaeb1d9ad635 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:49.155178 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-906c84c4-fd50-45fb-a743-aaeb1d9ad635 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:49.155622 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-906c84c4-fd50-45fb-a743-aaeb1d9ad635 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:49.292095 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-906c84c4-fd50-45fb-a743-aaeb1d9ad635 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:49.299971 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-906c84c4-fd50-45fb-a743-aaeb1d9ad635 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.157362 Mar 08 14:58:49.300524 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 560/1107] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:49 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:49.429255 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-cedda7b9-2231-456d-91f5-c946b0a38390 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:49.430189 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-cedda7b9-2231-456d-91f5-c946b0a38390 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:49.436076 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cedda7b9-2231-456d-91f5-c946b0a38390 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:49.436528 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cedda7b9-2231-456d-91f5-c946b0a38390 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:49.437287 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cedda7b9-2231-456d-91f5-c946b0a38390 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:49.437724 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cedda7b9-2231-456d-91f5-c946b0a38390 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:49.465378 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-cedda7b9-2231-456d-91f5-c946b0a38390 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040321 Mar 08 14:58:49.465975 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 548/1108] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:49 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:58:49.650158 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-cc78763f-d095-4d32-bd54-8d8be0de6fdf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:49.650784 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-cc78763f-d095-4d32-bd54-8d8be0de6fdf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:49.657686 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cc78763f-d095-4d32-bd54-8d8be0de6fdf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:49.658179 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cc78763f-d095-4d32-bd54-8d8be0de6fdf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:49.658979 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cc78763f-d095-4d32-bd54-8d8be0de6fdf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:49.659404 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cc78763f-d095-4d32-bd54-8d8be0de6fdf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:49.719253 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-cc78763f-d095-4d32-bd54-8d8be0de6fdf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:49.721212 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-276caaf2-237c-4f52-856f-ef17068a0096 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:49.722194 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-276caaf2-237c-4f52-856f-ef17068a0096 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:49.726731 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-cc78763f-d095-4d32-bd54-8d8be0de6fdf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080520 Mar 08 14:58:49.727305 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 561/1109] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:49 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:49.728397 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-276caaf2-237c-4f52-856f-ef17068a0096 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:49.728854 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-276caaf2-237c-4f52-856f-ef17068a0096 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:49.729637 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-276caaf2-237c-4f52-856f-ef17068a0096 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:49.730104 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-276caaf2-237c-4f52-856f-ef17068a0096 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:49.757579 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-276caaf2-237c-4f52-856f-ef17068a0096 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040765 Mar 08 14:58:49.758060 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 549/1110] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:49 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:58:50.317548 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5b6f7064-ef20-41c2-97a8-51709d278630 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:50.318194 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5b6f7064-ef20-41c2-97a8-51709d278630 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:50.323993 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5b6f7064-ef20-41c2-97a8-51709d278630 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:50.324447 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5b6f7064-ef20-41c2-97a8-51709d278630 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:50.325211 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5b6f7064-ef20-41c2-97a8-51709d278630 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:50.325650 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5b6f7064-ef20-41c2-97a8-51709d278630 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:50.465230 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-5b6f7064-ef20-41c2-97a8-51709d278630 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:50.473386 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5b6f7064-ef20-41c2-97a8-51709d278630 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.159719 Mar 08 14:58:50.474111 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 562/1111] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:50 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:50.477327 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b8452e93-9920-4114-95ea-421b811e5308 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:50.478312 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-b8452e93-9920-4114-95ea-421b811e5308 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:50.484081 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b8452e93-9920-4114-95ea-421b811e5308 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:50.484529 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b8452e93-9920-4114-95ea-421b811e5308 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:50.485301 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b8452e93-9920-4114-95ea-421b811e5308 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:50.485739 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b8452e93-9920-4114-95ea-421b811e5308 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:50.512939 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-b8452e93-9920-4114-95ea-421b811e5308 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039546 Mar 08 14:58:50.514337 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 550/1112] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:50 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:58:50.743020 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-333725eb-5e78-4a09-996f-55cc985df55f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:50.743636 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-333725eb-5e78-4a09-996f-55cc985df55f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:50.750441 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-333725eb-5e78-4a09-996f-55cc985df55f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:50.750891 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-333725eb-5e78-4a09-996f-55cc985df55f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:50.751662 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-333725eb-5e78-4a09-996f-55cc985df55f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:50.752099 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-333725eb-5e78-4a09-996f-55cc985df55f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:50.769576 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-f9d1bae3-b0c4-476f-bdb9-a2dd70582f0a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:50.770511 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-f9d1bae3-b0c4-476f-bdb9-a2dd70582f0a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:50.776796 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f9d1bae3-b0c4-476f-bdb9-a2dd70582f0a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:50.777250 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f9d1bae3-b0c4-476f-bdb9-a2dd70582f0a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:50.778042 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f9d1bae3-b0c4-476f-bdb9-a2dd70582f0a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:50.778487 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f9d1bae3-b0c4-476f-bdb9-a2dd70582f0a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:50.809009 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-f9d1bae3-b0c4-476f-bdb9-a2dd70582f0a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043227 Mar 08 14:58:50.809559 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 551/1113] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:50 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:58:50.816511 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-333725eb-5e78-4a09-996f-55cc985df55f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:50.823835 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-333725eb-5e78-4a09-996f-55cc985df55f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.084671 Mar 08 14:58:50.824378 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 563/1114] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:50 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:51.490665 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-130fa25b-e99b-486b-a0c4-6c291e2284dc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:51.491298 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-130fa25b-e99b-486b-a0c4-6c291e2284dc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:51.497405 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-130fa25b-e99b-486b-a0c4-6c291e2284dc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:51.498074 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-130fa25b-e99b-486b-a0c4-6c291e2284dc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:51.498865 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-130fa25b-e99b-486b-a0c4-6c291e2284dc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:51.499696 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-130fa25b-e99b-486b-a0c4-6c291e2284dc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:51.524570 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-e2af9d6c-9e09-4f86-b5b1-b5b9a624bdba tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:51.525479 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-e2af9d6c-9e09-4f86-b5b1-b5b9a624bdba tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:51.532119 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e2af9d6c-9e09-4f86-b5b1-b5b9a624bdba tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:51.532565 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e2af9d6c-9e09-4f86-b5b1-b5b9a624bdba tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:51.533335 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e2af9d6c-9e09-4f86-b5b1-b5b9a624bdba tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:51.533768 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e2af9d6c-9e09-4f86-b5b1-b5b9a624bdba tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:51.563214 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-e2af9d6c-9e09-4f86-b5b1-b5b9a624bdba tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042451 Mar 08 14:58:51.563788 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 564/1115] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:51 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:58:51.631291 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-130fa25b-e99b-486b-a0c4-6c291e2284dc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:51.638564 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-130fa25b-e99b-486b-a0c4-6c291e2284dc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.151733 Mar 08 14:58:51.639123 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 552/1116] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:51 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:51.820623 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b5ac24a5-8eec-4640-9f17-8354aa391d67 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:51.821460 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b5ac24a5-8eec-4640-9f17-8354aa391d67 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:51.828273 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b5ac24a5-8eec-4640-9f17-8354aa391d67 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:51.828716 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b5ac24a5-8eec-4640-9f17-8354aa391d67 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:51.829481 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b5ac24a5-8eec-4640-9f17-8354aa391d67 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:51.829946 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b5ac24a5-8eec-4640-9f17-8354aa391d67 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:51.840293 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-a173a460-f402-465e-9abc-b98cc82ff426 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:51.840905 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-a173a460-f402-465e-9abc-b98cc82ff426 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:51.848277 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a173a460-f402-465e-9abc-b98cc82ff426 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:51.848812 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a173a460-f402-465e-9abc-b98cc82ff426 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:51.849594 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a173a460-f402-465e-9abc-b98cc82ff426 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:51.850064 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a173a460-f402-465e-9abc-b98cc82ff426 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:51.857558 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b5ac24a5-8eec-4640-9f17-8354aa391d67 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040892 Mar 08 14:58:51.858135 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 565/1117] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:51 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:58:51.912744 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-a173a460-f402-465e-9abc-b98cc82ff426 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:51.920143 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-a173a460-f402-465e-9abc-b98cc82ff426 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.083647 Mar 08 14:58:51.920702 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 553/1118] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:51 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:58:52.574793 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ae902157-194a-4e63-9d33-9d3ca611643d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:52.575706 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ae902157-194a-4e63-9d33-9d3ca611643d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:52.582117 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ae902157-194a-4e63-9d33-9d3ca611643d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:52.582572 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ae902157-194a-4e63-9d33-9d3ca611643d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:52.583348 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ae902157-194a-4e63-9d33-9d3ca611643d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:52.583786 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ae902157-194a-4e63-9d33-9d3ca611643d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:52.611878 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ae902157-194a-4e63-9d33-9d3ca611643d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041068 Mar 08 14:58:52.612414 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 566/1119] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:52 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:58:52.655311 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-85a54381-26c0-42db-8336-f3a70e49e1d0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:52.655928 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-85a54381-26c0-42db-8336-f3a70e49e1d0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:52.661767 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-85a54381-26c0-42db-8336-f3a70e49e1d0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:52.662267 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-85a54381-26c0-42db-8336-f3a70e49e1d0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:52.663042 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-85a54381-26c0-42db-8336-f3a70e49e1d0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:52.663506 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-85a54381-26c0-42db-8336-f3a70e49e1d0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:52.795674 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-85a54381-26c0-42db-8336-f3a70e49e1d0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:52.802913 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-85a54381-26c0-42db-8336-f3a70e49e1d0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.151563 Mar 08 14:58:52.803485 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 554/1120] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:52 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:52.868985 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-34020411-85bf-498e-97d8-66776dce67fd tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:52.869831 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-34020411-85bf-498e-97d8-66776dce67fd tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:52.876966 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-34020411-85bf-498e-97d8-66776dce67fd tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:52.877418 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-34020411-85bf-498e-97d8-66776dce67fd tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:52.878207 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-34020411-85bf-498e-97d8-66776dce67fd tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:52.878649 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-34020411-85bf-498e-97d8-66776dce67fd tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:52.905685 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-34020411-85bf-498e-97d8-66776dce67fd tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040690 Mar 08 14:58:52.906321 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 567/1121] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:52 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:58:52.936867 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-beb3d297-9052-4dee-9092-f70c709e2572 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:52.937492 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-beb3d297-9052-4dee-9092-f70c709e2572 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:52.943845 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-beb3d297-9052-4dee-9092-f70c709e2572 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:52.944298 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-beb3d297-9052-4dee-9092-f70c709e2572 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:52.945072 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-beb3d297-9052-4dee-9092-f70c709e2572 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:52.945507 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-beb3d297-9052-4dee-9092-f70c709e2572 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:53.005455 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-beb3d297-9052-4dee-9092-f70c709e2572 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:53.012588 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-beb3d297-9052-4dee-9092-f70c709e2572 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080143 Mar 08 14:58:53.013138 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 555/1122] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:52 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:53.623705 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-9e04f43a-4f24-4708-9a88-06867586f878 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:53.624605 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-9e04f43a-4f24-4708-9a88-06867586f878 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:53.630480 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9e04f43a-4f24-4708-9a88-06867586f878 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:53.630932 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9e04f43a-4f24-4708-9a88-06867586f878 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:53.631693 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9e04f43a-4f24-4708-9a88-06867586f878 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:53.632127 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9e04f43a-4f24-4708-9a88-06867586f878 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:53.660008 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-9e04f43a-4f24-4708-9a88-06867586f878 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040554 Mar 08 14:58:53.660541 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 568/1123] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:53 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:58:53.821093 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-9e215450-1913-4313-9713-e6fdfb058b9b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:53.821644 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-9e215450-1913-4313-9713-e6fdfb058b9b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:53.828519 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9e215450-1913-4313-9713-e6fdfb058b9b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:53.828968 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9e215450-1913-4313-9713-e6fdfb058b9b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:53.829732 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9e215450-1913-4313-9713-e6fdfb058b9b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:53.830201 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9e215450-1913-4313-9713-e6fdfb058b9b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:53.916792 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-7c0d9ebf-c53f-4d92-a893-fdf8d6475ea5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:53.917710 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-7c0d9ebf-c53f-4d92-a893-fdf8d6475ea5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:53.924505 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7c0d9ebf-c53f-4d92-a893-fdf8d6475ea5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:53.924958 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7c0d9ebf-c53f-4d92-a893-fdf8d6475ea5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:53.925736 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7c0d9ebf-c53f-4d92-a893-fdf8d6475ea5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:53.926201 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7c0d9ebf-c53f-4d92-a893-fdf8d6475ea5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:53.957548 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-7c0d9ebf-c53f-4d92-a893-fdf8d6475ea5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044656 Mar 08 14:58:53.958145 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 569/1124] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:53 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:58:53.966411 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-9e215450-1913-4313-9713-e6fdfb058b9b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:53.974213 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-9e215450-1913-4313-9713-e6fdfb058b9b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.156985 Mar 08 14:58:53.974771 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 556/1125] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:53 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:54.028408 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-2ebe1b19-3b25-402c-9703-cec3916e71b5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:54.029139 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-2ebe1b19-3b25-402c-9703-cec3916e71b5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:54.034993 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2ebe1b19-3b25-402c-9703-cec3916e71b5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:54.035455 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2ebe1b19-3b25-402c-9703-cec3916e71b5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:54.036230 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2ebe1b19-3b25-402c-9703-cec3916e71b5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:54.036690 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2ebe1b19-3b25-402c-9703-cec3916e71b5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:54.095664 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-2ebe1b19-3b25-402c-9703-cec3916e71b5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:54.102892 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-2ebe1b19-3b25-402c-9703-cec3916e71b5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078285 Mar 08 14:58:54.103448 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 570/1126] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:54 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:54.671686 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-52323e10-1213-4931-9ee8-e7bf3874a718 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:54.672633 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-52323e10-1213-4931-9ee8-e7bf3874a718 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:54.678528 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-52323e10-1213-4931-9ee8-e7bf3874a718 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:54.679230 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-52323e10-1213-4931-9ee8-e7bf3874a718 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:54.679993 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-52323e10-1213-4931-9ee8-e7bf3874a718 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:54.680428 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-52323e10-1213-4931-9ee8-e7bf3874a718 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:54.709756 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-52323e10-1213-4931-9ee8-e7bf3874a718 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042154 Mar 08 14:58:54.710329 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 557/1127] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:54 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:58:54.968741 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-875c538a-44f7-4f8c-8191-13c1f0743f80 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:54.969656 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-875c538a-44f7-4f8c-8191-13c1f0743f80 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:54.975911 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-875c538a-44f7-4f8c-8191-13c1f0743f80 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:54.976362 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-875c538a-44f7-4f8c-8191-13c1f0743f80 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:54.977152 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-875c538a-44f7-4f8c-8191-13c1f0743f80 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:54.977586 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-875c538a-44f7-4f8c-8191-13c1f0743f80 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:54.991221 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-17c17a0d-9ed8-4c60-8644-8e2199e44fc1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:54.991931 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-17c17a0d-9ed8-4c60-8644-8e2199e44fc1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:54.999318 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-17c17a0d-9ed8-4c60-8644-8e2199e44fc1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:54.999776 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-17c17a0d-9ed8-4c60-8644-8e2199e44fc1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:55.000848 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-17c17a0d-9ed8-4c60-8644-8e2199e44fc1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:55.001302 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-17c17a0d-9ed8-4c60-8644-8e2199e44fc1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:55.006138 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-875c538a-44f7-4f8c-8191-13c1f0743f80 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041438 Mar 08 14:58:55.006693 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 571/1128] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:54 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:58:55.119597 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d97e07f4-0074-4e5f-8179-b469a3db54a8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:55.120199 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d97e07f4-0074-4e5f-8179-b469a3db54a8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:55.126727 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d97e07f4-0074-4e5f-8179-b469a3db54a8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:55.127225 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d97e07f4-0074-4e5f-8179-b469a3db54a8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:55.127995 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d97e07f4-0074-4e5f-8179-b469a3db54a8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:55.128428 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d97e07f4-0074-4e5f-8179-b469a3db54a8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:55.135868 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-17c17a0d-9ed8-4c60-8644-8e2199e44fc1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:55.143220 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-17c17a0d-9ed8-4c60-8644-8e2199e44fc1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.155739 Mar 08 14:58:55.143790 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 558/1129] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:54 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:58:55.189806 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d97e07f4-0074-4e5f-8179-b469a3db54a8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:55.197035 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d97e07f4-0074-4e5f-8179-b469a3db54a8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081167 Mar 08 14:58:55.197529 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 572/1130] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:55 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:58:55.721368 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-e9457e64-4f16-4acd-9883-641400225d62 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:55.722309 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-e9457e64-4f16-4acd-9883-641400225d62 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:55.728139 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e9457e64-4f16-4acd-9883-641400225d62 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:55.728587 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e9457e64-4f16-4acd-9883-641400225d62 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:55.729346 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e9457e64-4f16-4acd-9883-641400225d62 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:55.729781 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e9457e64-4f16-4acd-9883-641400225d62 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:55.757602 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-e9457e64-4f16-4acd-9883-641400225d62 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040791 Mar 08 14:58:55.758102 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 559/1131] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:55 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:58:56.017511 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-6e4faa8e-0208-4ddc-9864-98086c88732c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:56.018400 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-6e4faa8e-0208-4ddc-9864-98086c88732c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:56.024623 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6e4faa8e-0208-4ddc-9864-98086c88732c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:56.025075 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6e4faa8e-0208-4ddc-9864-98086c88732c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:56.025847 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6e4faa8e-0208-4ddc-9864-98086c88732c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:56.026320 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6e4faa8e-0208-4ddc-9864-98086c88732c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:56.054385 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-6e4faa8e-0208-4ddc-9864-98086c88732c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041365 Mar 08 14:58:56.054926 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 573/1132] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:56 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:58:56.160351 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-cdcf3a51-d974-4053-a65b-c2f8db0e0012 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:56.160957 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-cdcf3a51-d974-4053-a65b-c2f8db0e0012 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:56.167123 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cdcf3a51-d974-4053-a65b-c2f8db0e0012 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:56.167573 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cdcf3a51-d974-4053-a65b-c2f8db0e0012 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:56.168332 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cdcf3a51-d974-4053-a65b-c2f8db0e0012 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:56.168767 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cdcf3a51-d974-4053-a65b-c2f8db0e0012 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:56.213951 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-537a749d-9613-41a3-baab-c02e15648cca tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:56.214661 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-537a749d-9613-41a3-baab-c02e15648cca tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:56.221089 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-537a749d-9613-41a3-baab-c02e15648cca tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:56.221620 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-537a749d-9613-41a3-baab-c02e15648cca tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:56.222495 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-537a749d-9613-41a3-baab-c02e15648cca tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:56.222933 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-537a749d-9613-41a3-baab-c02e15648cca tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:56.291051 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-537a749d-9613-41a3-baab-c02e15648cca tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:56.299577 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-537a749d-9613-41a3-baab-c02e15648cca tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.089501 Mar 08 14:58:56.300145 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 574/1133] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:56 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:58:56.307772 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-cdcf3a51-d974-4053-a65b-c2f8db0e0012 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:56.315226 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-cdcf3a51-d974-4053-a65b-c2f8db0e0012 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.158723 Mar 08 14:58:56.315794 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 560/1134] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:56 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:56.769404 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-0537e8d7-b240-42da-aa62-a1616266561f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:56.770351 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-0537e8d7-b240-42da-aa62-a1616266561f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:56.776212 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0537e8d7-b240-42da-aa62-a1616266561f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:56.776671 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0537e8d7-b240-42da-aa62-a1616266561f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:56.777438 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0537e8d7-b240-42da-aa62-a1616266561f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:56.777892 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0537e8d7-b240-42da-aa62-a1616266561f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:56.806744 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-0537e8d7-b240-42da-aa62-a1616266561f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041444 Mar 08 14:58:56.807283 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 575/1135] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:56 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:58:57.066583 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-9b048d1b-a29c-4935-ad38-c7bc948956bd tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:57.067479 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-9b048d1b-a29c-4935-ad38-c7bc948956bd tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:57.073252 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9b048d1b-a29c-4935-ad38-c7bc948956bd tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:57.073703 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9b048d1b-a29c-4935-ad38-c7bc948956bd tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:57.074494 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9b048d1b-a29c-4935-ad38-c7bc948956bd tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:57.074926 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9b048d1b-a29c-4935-ad38-c7bc948956bd tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:57.102908 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-9b048d1b-a29c-4935-ad38-c7bc948956bd tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040431 Mar 08 14:58:57.103440 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 561/1136] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:57 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:58:57.332429 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-4d851450-9db7-45b3-b7eb-cba6519f12e5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:57.333042 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-4d851450-9db7-45b3-b7eb-cba6519f12e5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:57.339363 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4d851450-9db7-45b3-b7eb-cba6519f12e5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:57.339684 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4d851450-9db7-45b3-b7eb-cba6519f12e5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:57.340446 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4d851450-9db7-45b3-b7eb-cba6519f12e5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:57.340881 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4d851450-9db7-45b3-b7eb-cba6519f12e5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:57.414328 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-a80ea4c4-8c90-4a7a-afcd-a5f77b2cbddb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:57.415585 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-a80ea4c4-8c90-4a7a-afcd-a5f77b2cbddb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:57.421584 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a80ea4c4-8c90-4a7a-afcd-a5f77b2cbddb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:57.422149 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a80ea4c4-8c90-4a7a-afcd-a5f77b2cbddb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:57.423008 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a80ea4c4-8c90-4a7a-afcd-a5f77b2cbddb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:57.423514 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a80ea4c4-8c90-4a7a-afcd-a5f77b2cbddb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:57.476730 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-4d851450-9db7-45b3-b7eb-cba6519f12e5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:57.483558 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-a80ea4c4-8c90-4a7a-afcd-a5f77b2cbddb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:57.484445 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-4d851450-9db7-45b3-b7eb-cba6519f12e5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.155733 Mar 08 14:58:57.485016 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 562/1137] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:57 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:58:57.490921 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-a80ea4c4-8c90-4a7a-afcd-a5f77b2cbddb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.177771 Mar 08 14:58:57.491462 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 576/1138] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:57 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:57.818313 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-e976cf25-ad81-4e21-9bf7-e2cd5293016a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:57.819246 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-e976cf25-ad81-4e21-9bf7-e2cd5293016a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:57.825057 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e976cf25-ad81-4e21-9bf7-e2cd5293016a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:57.825526 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e976cf25-ad81-4e21-9bf7-e2cd5293016a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:57.826309 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e976cf25-ad81-4e21-9bf7-e2cd5293016a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:57.826747 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e976cf25-ad81-4e21-9bf7-e2cd5293016a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:57.853950 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-e976cf25-ad81-4e21-9bf7-e2cd5293016a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039594 Mar 08 14:58:57.854486 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 563/1139] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:57 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:58:58.114614 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-a825055f-07f8-4643-92e8-3d80d846a424 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:58.115546 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-a825055f-07f8-4643-92e8-3d80d846a424 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:58.121357 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a825055f-07f8-4643-92e8-3d80d846a424 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:58.121804 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a825055f-07f8-4643-92e8-3d80d846a424 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:58.123206 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a825055f-07f8-4643-92e8-3d80d846a424 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:58.123646 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a825055f-07f8-4643-92e8-3d80d846a424 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:58.150281 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-a825055f-07f8-4643-92e8-3d80d846a424 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039757 Mar 08 14:58:58.150821 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 577/1140] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:58 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:58:58.501641 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-95bf39d3-927a-4cae-a0df-ca41b85ad434 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:58.504128 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-95bf39d3-927a-4cae-a0df-ca41b85ad434 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:58.508795 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-95bf39d3-927a-4cae-a0df-ca41b85ad434 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:58.509265 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-95bf39d3-927a-4cae-a0df-ca41b85ad434 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:58.510146 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-95bf39d3-927a-4cae-a0df-ca41b85ad434 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:58.510597 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-95bf39d3-927a-4cae-a0df-ca41b85ad434 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:58.514394 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-e8a711e5-003d-49d6-b72d-75c83b239088 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:58.515014 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-e8a711e5-003d-49d6-b72d-75c83b239088 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:58.521120 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e8a711e5-003d-49d6-b72d-75c83b239088 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:58.521575 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e8a711e5-003d-49d6-b72d-75c83b239088 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:58.522403 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e8a711e5-003d-49d6-b72d-75c83b239088 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:58.522831 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e8a711e5-003d-49d6-b72d-75c83b239088 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:58.583129 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-e8a711e5-003d-49d6-b72d-75c83b239088 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:58.590577 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-e8a711e5-003d-49d6-b72d-75c83b239088 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081753 Mar 08 14:58:58.591509 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 578/1141] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:58 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:58.647339 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-95bf39d3-927a-4cae-a0df-ca41b85ad434 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:58.654809 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-95bf39d3-927a-4cae-a0df-ca41b85ad434 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.157268 Mar 08 14:58:58.655378 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 564/1142] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:58 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:58.733016 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 14:58:58.733216 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: Tue Mar 8 14:58:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 14:58:58.866000 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5598619c-9b99-4a5e-b3ad-98f3f87d82be tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:58.866839 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5598619c-9b99-4a5e-b3ad-98f3f87d82be tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:58.873224 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5598619c-9b99-4a5e-b3ad-98f3f87d82be tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:58.873785 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5598619c-9b99-4a5e-b3ad-98f3f87d82be tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:58.874587 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5598619c-9b99-4a5e-b3ad-98f3f87d82be tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:58.875030 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5598619c-9b99-4a5e-b3ad-98f3f87d82be tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:58.902249 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5598619c-9b99-4a5e-b3ad-98f3f87d82be tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040344 Mar 08 14:58:58.902788 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 579/1143] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:58 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:58:59.161831 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-5b78089c-cb9b-4cd0-903c-17c5e70a5388 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:59.162700 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-5b78089c-cb9b-4cd0-903c-17c5e70a5388 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:59.168533 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5b78089c-cb9b-4cd0-903c-17c5e70a5388 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:59.168984 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5b78089c-cb9b-4cd0-903c-17c5e70a5388 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:59.170498 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5b78089c-cb9b-4cd0-903c-17c5e70a5388 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:59.170933 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5b78089c-cb9b-4cd0-903c-17c5e70a5388 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:59.199951 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-5b78089c-cb9b-4cd0-903c-17c5e70a5388 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042160 Mar 08 14:58:59.200535 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 565/1144] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:58:59 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:58:59.607557 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-444469af-945b-453b-af81-4bb445985f09 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:59.608169 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-444469af-945b-453b-af81-4bb445985f09 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:59.614430 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-444469af-945b-453b-af81-4bb445985f09 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:59.614886 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-444469af-945b-453b-af81-4bb445985f09 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:59.615680 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-444469af-945b-453b-af81-4bb445985f09 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:59.616118 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-444469af-945b-453b-af81-4bb445985f09 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:59.671854 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-872ffcb1-9378-4206-97a8-228e38dc2cc1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:59.672590 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-872ffcb1-9378-4206-97a8-228e38dc2cc1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:59.679128 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-444469af-945b-453b-af81-4bb445985f09 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:59.679803 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-872ffcb1-9378-4206-97a8-228e38dc2cc1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:59.680338 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-872ffcb1-9378-4206-97a8-228e38dc2cc1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:59.681136 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-872ffcb1-9378-4206-97a8-228e38dc2cc1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:59.681665 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-872ffcb1-9378-4206-97a8-228e38dc2cc1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:59.687436 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-444469af-945b-453b-af81-4bb445985f09 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.084030 Mar 08 14:58:59.688001 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 580/1145] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:59 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:58:59.818734 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-872ffcb1-9378-4206-97a8-228e38dc2cc1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:58:59.826580 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-872ffcb1-9378-4206-97a8-228e38dc2cc1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.158731 Mar 08 14:58:59.827121 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 566/1146] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:58:59 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:58:59.914410 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-bca0a342-1f60-45fb-9cc2-8978f101ad1a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:58:59.915329 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-bca0a342-1f60-45fb-9cc2-8978f101ad1a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:58:59.921125 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bca0a342-1f60-45fb-9cc2-8978f101ad1a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:59.921582 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bca0a342-1f60-45fb-9cc2-8978f101ad1a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:59.922386 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bca0a342-1f60-45fb-9cc2-8978f101ad1a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:58:59.922831 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bca0a342-1f60-45fb-9cc2-8978f101ad1a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:58:59.952191 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-bca0a342-1f60-45fb-9cc2-8978f101ad1a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041857 Mar 08 14:58:59.952748 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 581/1147] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:58:59 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:59:00.211585 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-be30d7e4-5433-406c-bff3-25c7ee2864a6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:00.212431 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-be30d7e4-5433-406c-bff3-25c7ee2864a6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:00.218388 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-be30d7e4-5433-406c-bff3-25c7ee2864a6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:00.218849 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-be30d7e4-5433-406c-bff3-25c7ee2864a6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:00.219624 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-be30d7e4-5433-406c-bff3-25c7ee2864a6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:00.220069 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-be30d7e4-5433-406c-bff3-25c7ee2864a6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:00.249112 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-be30d7e4-5433-406c-bff3-25c7ee2864a6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041667 Mar 08 14:59:00.249666 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 567/1148] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:00 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:59:00.704657 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-a56edf71-8de7-492e-bcb8-628b02f85203 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:00.705293 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-a56edf71-8de7-492e-bcb8-628b02f85203 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:00.711521 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a56edf71-8de7-492e-bcb8-628b02f85203 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:00.711969 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a56edf71-8de7-492e-bcb8-628b02f85203 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:00.712734 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a56edf71-8de7-492e-bcb8-628b02f85203 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:00.713169 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a56edf71-8de7-492e-bcb8-628b02f85203 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:00.773451 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-a56edf71-8de7-492e-bcb8-628b02f85203 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:00.781144 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-a56edf71-8de7-492e-bcb8-628b02f85203 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080333 Mar 08 14:59:00.781692 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 582/1149] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:00 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:00.938059 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-22dfd84a-ee0b-499a-b52b-c5f8b3e5fdcf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:00.938675 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-22dfd84a-ee0b-499a-b52b-c5f8b3e5fdcf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:00.944503 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-22dfd84a-ee0b-499a-b52b-c5f8b3e5fdcf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:00.944948 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-22dfd84a-ee0b-499a-b52b-c5f8b3e5fdcf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:00.945714 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-22dfd84a-ee0b-499a-b52b-c5f8b3e5fdcf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:00.946178 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-22dfd84a-ee0b-499a-b52b-c5f8b3e5fdcf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:00.963968 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-71c9a578-cd1d-423a-982a-f0c6f71b7961 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:00.964810 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-71c9a578-cd1d-423a-982a-f0c6f71b7961 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:00.971810 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-71c9a578-cd1d-423a-982a-f0c6f71b7961 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:00.972262 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-71c9a578-cd1d-423a-982a-f0c6f71b7961 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:00.973035 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-71c9a578-cd1d-423a-982a-f0c6f71b7961 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:00.973478 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-71c9a578-cd1d-423a-982a-f0c6f71b7961 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:01.002603 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-71c9a578-cd1d-423a-982a-f0c6f71b7961 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042654 Mar 08 14:59:01.003181 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 583/1150] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:00 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:59:01.079431 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-22dfd84a-ee0b-499a-b52b-c5f8b3e5fdcf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:01.086652 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-22dfd84a-ee0b-499a-b52b-c5f8b3e5fdcf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.247929 Mar 08 14:59:01.087203 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 568/1151] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:00 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:01.260667 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5d0801e0-d5dc-4558-857a-93c9b76f33ac tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:01.261586 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5d0801e0-d5dc-4558-857a-93c9b76f33ac tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:01.268168 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5d0801e0-d5dc-4558-857a-93c9b76f33ac tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:01.268623 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5d0801e0-d5dc-4558-857a-93c9b76f33ac tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:01.269396 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5d0801e0-d5dc-4558-857a-93c9b76f33ac tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:01.269831 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5d0801e0-d5dc-4558-857a-93c9b76f33ac tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:01.296780 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5d0801e0-d5dc-4558-857a-93c9b76f33ac tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040137 Mar 08 14:59:01.297318 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 584/1152] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:01 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:59:01.798212 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-553f13d9-260f-4c21-bf1a-ac564bbbef34 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:01.798830 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-553f13d9-260f-4c21-bf1a-ac564bbbef34 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:01.804956 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-553f13d9-260f-4c21-bf1a-ac564bbbef34 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:01.805414 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-553f13d9-260f-4c21-bf1a-ac564bbbef34 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:01.806215 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-553f13d9-260f-4c21-bf1a-ac564bbbef34 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:01.806664 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-553f13d9-260f-4c21-bf1a-ac564bbbef34 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:01.868702 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-553f13d9-260f-4c21-bf1a-ac564bbbef34 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:01.878718 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-553f13d9-260f-4c21-bf1a-ac564bbbef34 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.084399 Mar 08 14:59:01.879739 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 569/1153] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:01 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:02.014661 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-bb804a30-9675-4e69-b5d3-0fe9d406de94 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:02.015576 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-bb804a30-9675-4e69-b5d3-0fe9d406de94 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:02.021929 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bb804a30-9675-4e69-b5d3-0fe9d406de94 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:02.022389 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bb804a30-9675-4e69-b5d3-0fe9d406de94 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:02.023172 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bb804a30-9675-4e69-b5d3-0fe9d406de94 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:02.023612 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bb804a30-9675-4e69-b5d3-0fe9d406de94 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:02.052188 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-bb804a30-9675-4e69-b5d3-0fe9d406de94 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041516 Mar 08 14:59:02.052666 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 585/1154] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:02 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:59:02.104204 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-0a677d42-2238-4181-ad94-b9f89dd017bf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:02.104817 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-0a677d42-2238-4181-ad94-b9f89dd017bf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:02.111297 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0a677d42-2238-4181-ad94-b9f89dd017bf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:02.111745 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0a677d42-2238-4181-ad94-b9f89dd017bf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:02.112507 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0a677d42-2238-4181-ad94-b9f89dd017bf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:02.112944 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0a677d42-2238-4181-ad94-b9f89dd017bf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:02.249357 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-0a677d42-2238-4181-ad94-b9f89dd017bf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:02.256661 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-0a677d42-2238-4181-ad94-b9f89dd017bf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.156281 Mar 08 14:59:02.257213 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 570/1155] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:02 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:02.308338 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3cbaf544-0541-4a5f-a037-96f36e1bd57d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:02.309218 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-3cbaf544-0541-4a5f-a037-96f36e1bd57d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:02.315012 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3cbaf544-0541-4a5f-a037-96f36e1bd57d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:02.315466 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3cbaf544-0541-4a5f-a037-96f36e1bd57d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:02.316230 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3cbaf544-0541-4a5f-a037-96f36e1bd57d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:02.316671 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3cbaf544-0541-4a5f-a037-96f36e1bd57d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:02.344527 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-3cbaf544-0541-4a5f-a037-96f36e1bd57d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040220 Mar 08 14:59:02.345072 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 586/1156] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:02 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:59:02.896765 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-38fe0f7a-3c29-4f9b-9a62-8f1a8199d89f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:02.897386 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-38fe0f7a-3c29-4f9b-9a62-8f1a8199d89f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:02.904544 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-38fe0f7a-3c29-4f9b-9a62-8f1a8199d89f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:02.904999 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-38fe0f7a-3c29-4f9b-9a62-8f1a8199d89f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:02.905771 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-38fe0f7a-3c29-4f9b-9a62-8f1a8199d89f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:02.906241 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-38fe0f7a-3c29-4f9b-9a62-8f1a8199d89f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:02.965139 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-38fe0f7a-3c29-4f9b-9a62-8f1a8199d89f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:02.972905 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-38fe0f7a-3c29-4f9b-9a62-8f1a8199d89f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080074 Mar 08 14:59:02.973464 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 571/1157] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:02 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:03.064051 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-12bf5d88-6263-4c27-9581-5dfed630836d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:03.064966 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-12bf5d88-6263-4c27-9581-5dfed630836d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:03.071189 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-12bf5d88-6263-4c27-9581-5dfed630836d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:03.071649 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-12bf5d88-6263-4c27-9581-5dfed630836d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:03.072425 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-12bf5d88-6263-4c27-9581-5dfed630836d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:03.072866 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-12bf5d88-6263-4c27-9581-5dfed630836d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:03.101608 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-12bf5d88-6263-4c27-9581-5dfed630836d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041640 Mar 08 14:59:03.102188 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 587/1158] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:03 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:59:03.273449 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-ea98a069-290a-4f80-8d3d-a917783b7b10 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:03.274095 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-ea98a069-290a-4f80-8d3d-a917783b7b10 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:03.281072 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ea98a069-290a-4f80-8d3d-a917783b7b10 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:03.281527 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ea98a069-290a-4f80-8d3d-a917783b7b10 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:03.282333 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ea98a069-290a-4f80-8d3d-a917783b7b10 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:03.282781 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ea98a069-290a-4f80-8d3d-a917783b7b10 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:03.420985 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-ea98a069-290a-4f80-8d3d-a917783b7b10 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:03.428353 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-ea98a069-290a-4f80-8d3d-a917783b7b10 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.158731 Mar 08 14:59:03.429170 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 572/1159] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:03 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:03.450636 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-07157533-47bb-43a9-a0c6-9629b4ddaf3c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:03.451544 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-07157533-47bb-43a9-a0c6-9629b4ddaf3c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:03.457224 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-07157533-47bb-43a9-a0c6-9629b4ddaf3c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:03.457670 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-07157533-47bb-43a9-a0c6-9629b4ddaf3c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:03.458489 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-07157533-47bb-43a9-a0c6-9629b4ddaf3c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:03.458921 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-07157533-47bb-43a9-a0c6-9629b4ddaf3c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:03.486487 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-07157533-47bb-43a9-a0c6-9629b4ddaf3c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135160 Mar 08 14:59:03.487025 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 588/1160] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:03 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:59:03.990293 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-def5610c-add5-4a10-8e05-0489b8b5e6c0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:03.990902 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-def5610c-add5-4a10-8e05-0489b8b5e6c0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:03.997095 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-def5610c-add5-4a10-8e05-0489b8b5e6c0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:03.997577 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-def5610c-add5-4a10-8e05-0489b8b5e6c0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:03.998369 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-def5610c-add5-4a10-8e05-0489b8b5e6c0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:03.998800 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-def5610c-add5-4a10-8e05-0489b8b5e6c0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:04.057349 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-def5610c-add5-4a10-8e05-0489b8b5e6c0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:04.064683 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-def5610c-add5-4a10-8e05-0489b8b5e6c0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078234 Mar 08 14:59:04.065237 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 573/1161] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:03 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:04.113351 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d9f2e5c0-54dc-42fa-ba15-6b4d3f15b133 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:04.114297 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d9f2e5c0-54dc-42fa-ba15-6b4d3f15b133 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:04.120446 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d9f2e5c0-54dc-42fa-ba15-6b4d3f15b133 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:04.120895 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d9f2e5c0-54dc-42fa-ba15-6b4d3f15b133 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:04.121648 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d9f2e5c0-54dc-42fa-ba15-6b4d3f15b133 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:04.122170 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d9f2e5c0-54dc-42fa-ba15-6b4d3f15b133 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:04.149609 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d9f2e5c0-54dc-42fa-ba15-6b4d3f15b133 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040519 Mar 08 14:59:04.150179 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 589/1162] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:04 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:59:04.445693 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-c05d1173-7749-4260-b9e2-d7cf7f0afcc1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:04.446326 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-c05d1173-7749-4260-b9e2-d7cf7f0afcc1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:04.452893 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c05d1173-7749-4260-b9e2-d7cf7f0afcc1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:04.453348 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c05d1173-7749-4260-b9e2-d7cf7f0afcc1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:04.454143 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c05d1173-7749-4260-b9e2-d7cf7f0afcc1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:04.454587 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c05d1173-7749-4260-b9e2-d7cf7f0afcc1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:04.498925 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-55711067-8e46-4136-bd3b-2cfb7715ce61 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:04.499838 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-55711067-8e46-4136-bd3b-2cfb7715ce61 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:04.505563 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-55711067-8e46-4136-bd3b-2cfb7715ce61 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:04.506035 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-55711067-8e46-4136-bd3b-2cfb7715ce61 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:04.506798 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-55711067-8e46-4136-bd3b-2cfb7715ce61 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:04.507232 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-55711067-8e46-4136-bd3b-2cfb7715ce61 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:04.537290 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-55711067-8e46-4136-bd3b-2cfb7715ce61 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043062 Mar 08 14:59:04.537865 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 590/1163] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:04 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:59:04.596477 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-c05d1173-7749-4260-b9e2-d7cf7f0afcc1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:04.603753 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-c05d1173-7749-4260-b9e2-d7cf7f0afcc1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.161967 Mar 08 14:59:04.604313 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 574/1164] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:04 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:05.081067 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-9b264001-52df-4307-8d2b-b4d168b5552e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:05.081671 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-9b264001-52df-4307-8d2b-b4d168b5552e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:05.087641 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9b264001-52df-4307-8d2b-b4d168b5552e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:05.088102 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9b264001-52df-4307-8d2b-b4d168b5552e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:05.088876 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9b264001-52df-4307-8d2b-b4d168b5552e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:05.089317 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9b264001-52df-4307-8d2b-b4d168b5552e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:05.150235 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-9b264001-52df-4307-8d2b-b4d168b5552e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:05.158575 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-9b264001-52df-4307-8d2b-b4d168b5552e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081612 Mar 08 14:59:05.159139 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 591/1165] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:05 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:59:05.162115 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-204f48ac-f5d8-4e37-b0ea-1ebbb52e012f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:05.163103 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-204f48ac-f5d8-4e37-b0ea-1ebbb52e012f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:05.170024 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-204f48ac-f5d8-4e37-b0ea-1ebbb52e012f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:05.170482 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-204f48ac-f5d8-4e37-b0ea-1ebbb52e012f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:05.171253 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-204f48ac-f5d8-4e37-b0ea-1ebbb52e012f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:05.171692 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-204f48ac-f5d8-4e37-b0ea-1ebbb52e012f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:05.200168 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-204f48ac-f5d8-4e37-b0ea-1ebbb52e012f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041983 Mar 08 14:59:05.200698 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 575/1166] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:05 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:59:05.550550 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3d91494c-f659-423b-820d-11cbe7e1a324 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:05.551465 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-3d91494c-f659-423b-820d-11cbe7e1a324 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:05.558258 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3d91494c-f659-423b-820d-11cbe7e1a324 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:05.558708 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3d91494c-f659-423b-820d-11cbe7e1a324 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:05.559482 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3d91494c-f659-423b-820d-11cbe7e1a324 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:05.559945 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3d91494c-f659-423b-820d-11cbe7e1a324 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:05.589390 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-3d91494c-f659-423b-820d-11cbe7e1a324 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044358 Mar 08 14:59:05.590074 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 592/1167] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:05 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:59:05.621145 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-7ffcab05-5f16-4565-802d-f5f7a215e9e6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:05.621758 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-7ffcab05-5f16-4565-802d-f5f7a215e9e6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:05.628152 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7ffcab05-5f16-4565-802d-f5f7a215e9e6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:05.628613 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7ffcab05-5f16-4565-802d-f5f7a215e9e6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:05.629390 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7ffcab05-5f16-4565-802d-f5f7a215e9e6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:05.629831 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7ffcab05-5f16-4565-802d-f5f7a215e9e6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:05.782557 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-7ffcab05-5f16-4565-802d-f5f7a215e9e6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:05.790356 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-7ffcab05-5f16-4565-802d-f5f7a215e9e6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.172559 Mar 08 14:59:05.790923 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 576/1168] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:05 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:06.176102 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-59fd7815-d9da-4801-bfa3-c1b00f4e3ce0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:06.176657 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-59fd7815-d9da-4801-bfa3-c1b00f4e3ce0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:06.183228 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-59fd7815-d9da-4801-bfa3-c1b00f4e3ce0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:06.183679 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-59fd7815-d9da-4801-bfa3-c1b00f4e3ce0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:06.184532 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-59fd7815-d9da-4801-bfa3-c1b00f4e3ce0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:06.186865 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-59fd7815-d9da-4801-bfa3-c1b00f4e3ce0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:06.211241 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-1379cd41-6a98-4785-9177-c66a8a67077c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:06.212211 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-1379cd41-6a98-4785-9177-c66a8a67077c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:06.218706 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1379cd41-6a98-4785-9177-c66a8a67077c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:06.219167 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1379cd41-6a98-4785-9177-c66a8a67077c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:06.219943 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1379cd41-6a98-4785-9177-c66a8a67077c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:06.220383 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1379cd41-6a98-4785-9177-c66a8a67077c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:06.250277 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-1379cd41-6a98-4785-9177-c66a8a67077c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042979 Mar 08 14:59:06.250860 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 577/1169] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:06 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:59:06.251280 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-59fd7815-d9da-4801-bfa3-c1b00f4e3ce0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:06.258958 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-59fd7815-d9da-4801-bfa3-c1b00f4e3ce0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.086802 Mar 08 14:59:06.259506 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 593/1170] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:06 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:06.602102 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-f4c3d24c-6e7c-476c-97d5-eb825da3ac93 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:06.603037 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-f4c3d24c-6e7c-476c-97d5-eb825da3ac93 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:06.609719 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f4c3d24c-6e7c-476c-97d5-eb825da3ac93 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:06.610200 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f4c3d24c-6e7c-476c-97d5-eb825da3ac93 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:06.610966 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f4c3d24c-6e7c-476c-97d5-eb825da3ac93 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:06.611414 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f4c3d24c-6e7c-476c-97d5-eb825da3ac93 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:06.638507 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-f4c3d24c-6e7c-476c-97d5-eb825da3ac93 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040419 Mar 08 14:59:06.639121 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 578/1171] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:06 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:59:06.810694 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-fa277813-9920-4a9a-882e-250c440b8361 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:06.811340 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-fa277813-9920-4a9a-882e-250c440b8361 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:06.817070 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fa277813-9920-4a9a-882e-250c440b8361 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:06.817515 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fa277813-9920-4a9a-882e-250c440b8361 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:06.818296 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fa277813-9920-4a9a-882e-250c440b8361 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:06.818728 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fa277813-9920-4a9a-882e-250c440b8361 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:06.953516 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-fa277813-9920-4a9a-882e-250c440b8361 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:06.960782 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-fa277813-9920-4a9a-882e-250c440b8361 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.153932 Mar 08 14:59:06.961329 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 594/1172] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:06 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:07.261359 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-121161ac-5324-4f8a-8f2d-df69375d1ff8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:07.262305 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-121161ac-5324-4f8a-8f2d-df69375d1ff8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:07.269355 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-121161ac-5324-4f8a-8f2d-df69375d1ff8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:07.269807 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-121161ac-5324-4f8a-8f2d-df69375d1ff8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:07.270620 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-121161ac-5324-4f8a-8f2d-df69375d1ff8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:07.271058 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-121161ac-5324-4f8a-8f2d-df69375d1ff8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:07.275201 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ef785742-7a56-4148-80bd-e418dc254ac8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:07.275818 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ef785742-7a56-4148-80bd-e418dc254ac8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:07.282551 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ef785742-7a56-4148-80bd-e418dc254ac8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:07.283006 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ef785742-7a56-4148-80bd-e418dc254ac8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:07.283780 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ef785742-7a56-4148-80bd-e418dc254ac8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:07.284220 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ef785742-7a56-4148-80bd-e418dc254ac8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:07.299004 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-121161ac-5324-4f8a-8f2d-df69375d1ff8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041553 Mar 08 14:59:07.299556 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 579/1173] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:07 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:59:07.344793 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ef785742-7a56-4148-80bd-e418dc254ac8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:07.352061 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ef785742-7a56-4148-80bd-e418dc254ac8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080719 Mar 08 14:59:07.352615 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 595/1174] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:07 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:59:07.650038 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-73583968-4f00-4b4b-bfc3-3dad796a8203 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:07.650892 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-73583968-4f00-4b4b-bfc3-3dad796a8203 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:07.657420 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-73583968-4f00-4b4b-bfc3-3dad796a8203 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:07.657902 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-73583968-4f00-4b4b-bfc3-3dad796a8203 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:07.658682 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-73583968-4f00-4b4b-bfc3-3dad796a8203 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:07.659126 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-73583968-4f00-4b4b-bfc3-3dad796a8203 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:07.686526 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-73583968-4f00-4b4b-bfc3-3dad796a8203 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040512 Mar 08 14:59:07.687077 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 580/1175] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:07 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:59:07.978397 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-a6626a61-0cf6-46f7-af21-ecfaf0dd1783 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:07.979021 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-a6626a61-0cf6-46f7-af21-ecfaf0dd1783 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:07.984960 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a6626a61-0cf6-46f7-af21-ecfaf0dd1783 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:07.985416 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a6626a61-0cf6-46f7-af21-ecfaf0dd1783 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:07.986221 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a6626a61-0cf6-46f7-af21-ecfaf0dd1783 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:07.986664 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a6626a61-0cf6-46f7-af21-ecfaf0dd1783 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:08.118575 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-a6626a61-0cf6-46f7-af21-ecfaf0dd1783 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:08.126963 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-a6626a61-0cf6-46f7-af21-ecfaf0dd1783 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.152433 Mar 08 14:59:08.127520 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 596/1176] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:07 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:08.311222 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-bf334362-8996-475c-a8aa-591119aa9934 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:08.312133 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-bf334362-8996-475c-a8aa-591119aa9934 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:08.318432 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bf334362-8996-475c-a8aa-591119aa9934 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:08.318890 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bf334362-8996-475c-a8aa-591119aa9934 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:08.319695 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bf334362-8996-475c-a8aa-591119aa9934 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:08.320142 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bf334362-8996-475c-a8aa-591119aa9934 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:08.348547 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-bf334362-8996-475c-a8aa-591119aa9934 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041885 Mar 08 14:59:08.349108 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 581/1177] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:08 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:59:08.368373 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d0cca3ef-27d1-4ee7-8dbb-023b609ce15e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:08.369172 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d0cca3ef-27d1-4ee7-8dbb-023b609ce15e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:08.376739 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d0cca3ef-27d1-4ee7-8dbb-023b609ce15e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:08.377189 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d0cca3ef-27d1-4ee7-8dbb-023b609ce15e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:08.377987 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d0cca3ef-27d1-4ee7-8dbb-023b609ce15e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:08.378420 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d0cca3ef-27d1-4ee7-8dbb-023b609ce15e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:08.438707 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d0cca3ef-27d1-4ee7-8dbb-023b609ce15e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:08.446335 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d0cca3ef-27d1-4ee7-8dbb-023b609ce15e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081890 Mar 08 14:59:08.446883 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 597/1178] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:08 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:08.697693 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-def4ce7e-50fb-46c3-8bce-a4bc61cb8cbe tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:08.698636 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-def4ce7e-50fb-46c3-8bce-a4bc61cb8cbe tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:08.705802 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-def4ce7e-50fb-46c3-8bce-a4bc61cb8cbe tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:08.706284 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-def4ce7e-50fb-46c3-8bce-a4bc61cb8cbe tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:08.707047 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-def4ce7e-50fb-46c3-8bce-a4bc61cb8cbe tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:08.707482 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-def4ce7e-50fb-46c3-8bce-a4bc61cb8cbe tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:08.734485 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-def4ce7e-50fb-46c3-8bce-a4bc61cb8cbe tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040844 Mar 08 14:59:08.735021 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 582/1179] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:08 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:59:09.143768 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-65bf93bc-6ab0-4f1b-9b70-4748821477e3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:09.144381 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-65bf93bc-6ab0-4f1b-9b70-4748821477e3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:09.150393 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-65bf93bc-6ab0-4f1b-9b70-4748821477e3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:09.150842 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-65bf93bc-6ab0-4f1b-9b70-4748821477e3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:09.151606 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-65bf93bc-6ab0-4f1b-9b70-4748821477e3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:09.152035 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-65bf93bc-6ab0-4f1b-9b70-4748821477e3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:09.291847 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-65bf93bc-6ab0-4f1b-9b70-4748821477e3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:09.299712 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-65bf93bc-6ab0-4f1b-9b70-4748821477e3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.159814 Mar 08 14:59:09.300273 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 598/1180] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:09 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:09.360278 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-6c61d3f4-1d44-41d9-9183-bb0d9983285f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:09.361212 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-6c61d3f4-1d44-41d9-9183-bb0d9983285f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:09.367396 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6c61d3f4-1d44-41d9-9183-bb0d9983285f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:09.367844 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6c61d3f4-1d44-41d9-9183-bb0d9983285f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:09.368604 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6c61d3f4-1d44-41d9-9183-bb0d9983285f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:09.369040 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6c61d3f4-1d44-41d9-9183-bb0d9983285f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:09.397380 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-6c61d3f4-1d44-41d9-9183-bb0d9983285f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041016 Mar 08 14:59:09.397959 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 583/1181] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:09 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:59:09.464509 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-91c5d332-e778-475b-a6b0-79288a271f60 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:09.465129 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-91c5d332-e778-475b-a6b0-79288a271f60 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:09.471340 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-91c5d332-e778-475b-a6b0-79288a271f60 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:09.471794 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-91c5d332-e778-475b-a6b0-79288a271f60 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:09.472558 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-91c5d332-e778-475b-a6b0-79288a271f60 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:09.472998 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-91c5d332-e778-475b-a6b0-79288a271f60 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:09.531755 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-91c5d332-e778-475b-a6b0-79288a271f60 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:09.539016 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-91c5d332-e778-475b-a6b0-79288a271f60 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078330 Mar 08 14:59:09.539580 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 599/1182] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:09 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:09.745943 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-6fe685a1-a73f-4c2f-8968-13128757118e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:09.747382 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-6fe685a1-a73f-4c2f-8968-13128757118e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:09.753746 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6fe685a1-a73f-4c2f-8968-13128757118e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:09.754227 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6fe685a1-a73f-4c2f-8968-13128757118e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:09.755000 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6fe685a1-a73f-4c2f-8968-13128757118e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:09.755441 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6fe685a1-a73f-4c2f-8968-13128757118e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:09.784247 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-6fe685a1-a73f-4c2f-8968-13128757118e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042217 Mar 08 14:59:09.784730 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 584/1183] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:09 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:59:10.316537 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f3755370-e9c5-4c6b-80b1-8ae99cad9a8c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:10.317158 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f3755370-e9c5-4c6b-80b1-8ae99cad9a8c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:10.323086 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f3755370-e9c5-4c6b-80b1-8ae99cad9a8c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:10.323542 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f3755370-e9c5-4c6b-80b1-8ae99cad9a8c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:10.324324 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f3755370-e9c5-4c6b-80b1-8ae99cad9a8c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:10.324766 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f3755370-e9c5-4c6b-80b1-8ae99cad9a8c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:10.409632 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-1d70095c-6d39-4b60-97f5-58184ab901cd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:10.410900 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-1d70095c-6d39-4b60-97f5-58184ab901cd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:10.418732 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1d70095c-6d39-4b60-97f5-58184ab901cd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:10.419956 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1d70095c-6d39-4b60-97f5-58184ab901cd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:10.420748 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1d70095c-6d39-4b60-97f5-58184ab901cd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:10.421196 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1d70095c-6d39-4b60-97f5-58184ab901cd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:10.453453 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-1d70095c-6d39-4b60-97f5-58184ab901cd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048011 Mar 08 14:59:10.454096 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 585/1184] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:10 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:59:10.463414 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f3755370-e9c5-4c6b-80b1-8ae99cad9a8c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:10.471830 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f3755370-e9c5-4c6b-80b1-8ae99cad9a8c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.159206 Mar 08 14:59:10.472426 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 600/1185] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:10 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:10.555545 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-f490de12-9ea0-4172-b9ff-8d2201a3cdf8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:10.556168 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-f490de12-9ea0-4172-b9ff-8d2201a3cdf8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:10.562959 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f490de12-9ea0-4172-b9ff-8d2201a3cdf8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:10.563362 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f490de12-9ea0-4172-b9ff-8d2201a3cdf8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:10.564143 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f490de12-9ea0-4172-b9ff-8d2201a3cdf8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:10.564592 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f490de12-9ea0-4172-b9ff-8d2201a3cdf8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:10.626990 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-f490de12-9ea0-4172-b9ff-8d2201a3cdf8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:10.634264 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-f490de12-9ea0-4172-b9ff-8d2201a3cdf8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.082796 Mar 08 14:59:10.634824 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 586/1186] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:10 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:10.796007 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-2ebfa4ec-8e27-436d-89c7-2433c7ec520b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:10.796967 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-2ebfa4ec-8e27-436d-89c7-2433c7ec520b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:10.803668 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2ebfa4ec-8e27-436d-89c7-2433c7ec520b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:10.804128 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2ebfa4ec-8e27-436d-89c7-2433c7ec520b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:10.804896 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2ebfa4ec-8e27-436d-89c7-2433c7ec520b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:10.805330 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2ebfa4ec-8e27-436d-89c7-2433c7ec520b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:10.832793 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-2ebfa4ec-8e27-436d-89c7-2433c7ec520b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041319 Mar 08 14:59:10.833266 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 601/1187] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:10 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:59:11.465222 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-2b565dfc-6664-440f-9c0f-718c7ff37b55 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:11.466856 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-2b565dfc-6664-440f-9c0f-718c7ff37b55 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:11.473078 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2b565dfc-6664-440f-9c0f-718c7ff37b55 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:11.473525 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2b565dfc-6664-440f-9c0f-718c7ff37b55 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:11.474315 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2b565dfc-6664-440f-9c0f-718c7ff37b55 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:11.474756 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2b565dfc-6664-440f-9c0f-718c7ff37b55 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:11.489197 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-94f65d46-6475-419f-8f54-4c981ed93cfa tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:11.489802 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-94f65d46-6475-419f-8f54-4c981ed93cfa tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:11.495869 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-94f65d46-6475-419f-8f54-4c981ed93cfa tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:11.496318 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-94f65d46-6475-419f-8f54-4c981ed93cfa tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:11.497082 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-94f65d46-6475-419f-8f54-4c981ed93cfa tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:11.497520 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-94f65d46-6475-419f-8f54-4c981ed93cfa tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:11.502951 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-2b565dfc-6664-440f-9c0f-718c7ff37b55 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041722 Mar 08 14:59:11.503501 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 587/1188] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:11 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:59:11.633904 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-94f65d46-6475-419f-8f54-4c981ed93cfa tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:11.641600 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-94f65d46-6475-419f-8f54-4c981ed93cfa tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.156255 Mar 08 14:59:11.642193 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 602/1189] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:11 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:59:11.652402 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-56b2f42b-efee-452c-8b44-1e7f01982d6d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:11.653030 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-56b2f42b-efee-452c-8b44-1e7f01982d6d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:11.659652 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-56b2f42b-efee-452c-8b44-1e7f01982d6d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:11.660111 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-56b2f42b-efee-452c-8b44-1e7f01982d6d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:11.660885 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-56b2f42b-efee-452c-8b44-1e7f01982d6d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:11.661358 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-56b2f42b-efee-452c-8b44-1e7f01982d6d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:11.719904 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-56b2f42b-efee-452c-8b44-1e7f01982d6d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:11.727067 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-56b2f42b-efee-452c-8b44-1e7f01982d6d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078537 Mar 08 14:59:11.727637 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 588/1190] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:11 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:11.845185 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f7f2ebe6-f1d4-45c6-b007-51b530a2640e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:11.846137 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f7f2ebe6-f1d4-45c6-b007-51b530a2640e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:11.852000 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f7f2ebe6-f1d4-45c6-b007-51b530a2640e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:11.852458 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f7f2ebe6-f1d4-45c6-b007-51b530a2640e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:11.853256 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f7f2ebe6-f1d4-45c6-b007-51b530a2640e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:11.853677 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f7f2ebe6-f1d4-45c6-b007-51b530a2640e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:11.881364 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f7f2ebe6-f1d4-45c6-b007-51b530a2640e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041158 Mar 08 14:59:11.881928 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 603/1191] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:11 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:59:12.514951 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-7cd13bf4-8de2-489e-b059-1397bbae0dee tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:12.515874 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-7cd13bf4-8de2-489e-b059-1397bbae0dee tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:12.522146 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7cd13bf4-8de2-489e-b059-1397bbae0dee tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:12.522606 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7cd13bf4-8de2-489e-b059-1397bbae0dee tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:12.523381 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7cd13bf4-8de2-489e-b059-1397bbae0dee tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:12.523827 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7cd13bf4-8de2-489e-b059-1397bbae0dee tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:12.552334 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-7cd13bf4-8de2-489e-b059-1397bbae0dee tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041416 Mar 08 14:59:12.552870 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 589/1192] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:12 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:59:12.658902 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ddc993e7-4bee-499f-8b33-3b86b84f0b8c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:12.659513 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ddc993e7-4bee-499f-8b33-3b86b84f0b8c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:12.666150 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ddc993e7-4bee-499f-8b33-3b86b84f0b8c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:12.666601 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ddc993e7-4bee-499f-8b33-3b86b84f0b8c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:12.667377 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ddc993e7-4bee-499f-8b33-3b86b84f0b8c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:12.667800 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ddc993e7-4bee-499f-8b33-3b86b84f0b8c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:12.744808 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-2d5ecab1-f9e5-4029-a261-a5841352e9b0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:12.745423 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-2d5ecab1-f9e5-4029-a261-a5841352e9b0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:12.751387 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2d5ecab1-f9e5-4029-a261-a5841352e9b0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:12.751854 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2d5ecab1-f9e5-4029-a261-a5841352e9b0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:12.752642 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2d5ecab1-f9e5-4029-a261-a5841352e9b0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:12.753085 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2d5ecab1-f9e5-4029-a261-a5841352e9b0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:12.802111 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ddc993e7-4bee-499f-8b33-3b86b84f0b8c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:12.809832 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ddc993e7-4bee-499f-8b33-3b86b84f0b8c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.154665 Mar 08 14:59:12.810443 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 604/1193] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:12 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:12.814639 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-2d5ecab1-f9e5-4029-a261-a5841352e9b0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:12.821847 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-2d5ecab1-f9e5-4029-a261-a5841352e9b0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081018 Mar 08 14:59:12.822415 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 590/1194] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:12 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:59:12.893765 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5e95f8b9-a3e6-459b-a717-5e1af9a3232b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:12.894712 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5e95f8b9-a3e6-459b-a717-5e1af9a3232b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:12.900532 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5e95f8b9-a3e6-459b-a717-5e1af9a3232b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:12.900988 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5e95f8b9-a3e6-459b-a717-5e1af9a3232b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:12.901755 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5e95f8b9-a3e6-459b-a717-5e1af9a3232b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:12.902218 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5e95f8b9-a3e6-459b-a717-5e1af9a3232b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:12.929956 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5e95f8b9-a3e6-459b-a717-5e1af9a3232b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040092 Mar 08 14:59:12.930475 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 605/1195] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:12 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:59:13.565030 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-ed7d226b-eb92-446c-b045-d954a01c4bd8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:13.565957 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-ed7d226b-eb92-446c-b045-d954a01c4bd8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:13.571832 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ed7d226b-eb92-446c-b045-d954a01c4bd8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:13.572282 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ed7d226b-eb92-446c-b045-d954a01c4bd8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:13.573043 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ed7d226b-eb92-446c-b045-d954a01c4bd8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:13.573480 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ed7d226b-eb92-446c-b045-d954a01c4bd8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:13.601468 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-ed7d226b-eb92-446c-b045-d954a01c4bd8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040582 Mar 08 14:59:13.602049 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 591/1196] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:13 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:59:13.826662 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-75710121-fc47-4ccc-a0fd-aef8c3aa1281 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:13.827262 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-75710121-fc47-4ccc-a0fd-aef8c3aa1281 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:13.833467 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-75710121-fc47-4ccc-a0fd-aef8c3aa1281 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:13.834026 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-75710121-fc47-4ccc-a0fd-aef8c3aa1281 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:13.834810 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-75710121-fc47-4ccc-a0fd-aef8c3aa1281 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:13.835250 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-75710121-fc47-4ccc-a0fd-aef8c3aa1281 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:13.839092 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-9b5632b4-37f3-47c9-b401-b9ab8342e7a6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:13.839705 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-9b5632b4-37f3-47c9-b401-b9ab8342e7a6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:13.845921 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9b5632b4-37f3-47c9-b401-b9ab8342e7a6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:13.846380 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9b5632b4-37f3-47c9-b401-b9ab8342e7a6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:13.847147 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9b5632b4-37f3-47c9-b401-b9ab8342e7a6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:13.847587 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9b5632b4-37f3-47c9-b401-b9ab8342e7a6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:13.909327 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-9b5632b4-37f3-47c9-b401-b9ab8342e7a6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:13.916577 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-9b5632b4-37f3-47c9-b401-b9ab8342e7a6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081419 Mar 08 14:59:13.917143 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 592/1197] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:13 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:59:13.940778 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-a5c7a4f5-0157-4252-a0e8-9e1bbdc05081 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:13.941762 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-a5c7a4f5-0157-4252-a0e8-9e1bbdc05081 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:13.947685 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a5c7a4f5-0157-4252-a0e8-9e1bbdc05081 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:13.948139 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a5c7a4f5-0157-4252-a0e8-9e1bbdc05081 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:13.949007 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a5c7a4f5-0157-4252-a0e8-9e1bbdc05081 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:13.949349 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a5c7a4f5-0157-4252-a0e8-9e1bbdc05081 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:13.974822 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-75710121-fc47-4ccc-a0fd-aef8c3aa1281 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:13.978640 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-a5c7a4f5-0157-4252-a0e8-9e1bbdc05081 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041820 Mar 08 14:59:13.979201 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 593/1198] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:13 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:59:13.983224 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-75710121-fc47-4ccc-a0fd-aef8c3aa1281 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.160665 Mar 08 14:59:13.983784 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 606/1199] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:13 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:14.613196 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-e622375a-4e1c-4bda-9270-2a9001e5c851 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:14.614124 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-e622375a-4e1c-4bda-9270-2a9001e5c851 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:14.620306 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e622375a-4e1c-4bda-9270-2a9001e5c851 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:14.620756 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e622375a-4e1c-4bda-9270-2a9001e5c851 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:14.621511 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e622375a-4e1c-4bda-9270-2a9001e5c851 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:14.621976 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e622375a-4e1c-4bda-9270-2a9001e5c851 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:14.650954 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-e622375a-4e1c-4bda-9270-2a9001e5c851 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041785 Mar 08 14:59:14.651557 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 594/1200] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:14 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:59:14.933375 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b9d5eb4b-1192-4ae7-800c-22c5f1507ce2 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:14.933946 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b9d5eb4b-1192-4ae7-800c-22c5f1507ce2 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:14.941205 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b9d5eb4b-1192-4ae7-800c-22c5f1507ce2 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:14.941485 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b9d5eb4b-1192-4ae7-800c-22c5f1507ce2 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:14.942307 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b9d5eb4b-1192-4ae7-800c-22c5f1507ce2 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:14.942742 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b9d5eb4b-1192-4ae7-800c-22c5f1507ce2 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:14.990754 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-6e78082e-9c92-4206-9141-61c53886778c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:14.991682 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-6e78082e-9c92-4206-9141-61c53886778c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:14.998388 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6e78082e-9c92-4206-9141-61c53886778c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:14.998841 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6e78082e-9c92-4206-9141-61c53886778c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:14.999628 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6e78082e-9c92-4206-9141-61c53886778c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:15.000076 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6e78082e-9c92-4206-9141-61c53886778c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:15.007152 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b9d5eb4b-1192-4ae7-800c-22c5f1507ce2 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:15.015141 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b9d5eb4b-1192-4ae7-800c-22c5f1507ce2 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.085659 Mar 08 14:59:15.015752 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 607/1201] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:14 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:15.021032 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-047f3324-ba64-4306-b84a-f45766f7e93c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:15.021636 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-047f3324-ba64-4306-b84a-f45766f7e93c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:15.027183 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-047f3324-ba64-4306-b84a-f45766f7e93c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:15.027639 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-047f3324-ba64-4306-b84a-f45766f7e93c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:15.028520 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-047f3324-ba64-4306-b84a-f45766f7e93c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:15.028956 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-047f3324-ba64-4306-b84a-f45766f7e93c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:15.029128 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-6e78082e-9c92-4206-9141-61c53886778c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042113 Mar 08 14:59:15.029696 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 595/1202] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:14 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:59:15.160710 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-047f3324-ba64-4306-b84a-f45766f7e93c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:15.167989 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-047f3324-ba64-4306-b84a-f45766f7e93c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.151353 Mar 08 14:59:15.169074 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 608/1203] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:15 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:15.662449 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-0cb69d42-08d9-4112-b30b-15487ddf8c4f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:15.663422 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-0cb69d42-08d9-4112-b30b-15487ddf8c4f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:15.670357 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0cb69d42-08d9-4112-b30b-15487ddf8c4f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:15.670816 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0cb69d42-08d9-4112-b30b-15487ddf8c4f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:15.671589 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0cb69d42-08d9-4112-b30b-15487ddf8c4f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:15.672030 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0cb69d42-08d9-4112-b30b-15487ddf8c4f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:15.700471 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-0cb69d42-08d9-4112-b30b-15487ddf8c4f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041912 Mar 08 14:59:15.701022 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 596/1204] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:15 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:59:16.032729 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5bb26978-f67f-4aef-b369-f600d9686d22 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:16.033337 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5bb26978-f67f-4aef-b369-f600d9686d22 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:16.039653 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5bb26978-f67f-4aef-b369-f600d9686d22 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:16.040105 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5bb26978-f67f-4aef-b369-f600d9686d22 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:16.040519 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-c9686d50-7dbf-4b29-818e-4619f5ba0d08 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:16.040875 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5bb26978-f67f-4aef-b369-f600d9686d22 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:16.041305 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5bb26978-f67f-4aef-b369-f600d9686d22 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:16.041424 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-c9686d50-7dbf-4b29-818e-4619f5ba0d08 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:16.047260 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c9686d50-7dbf-4b29-818e-4619f5ba0d08 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:16.047707 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c9686d50-7dbf-4b29-818e-4619f5ba0d08 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:16.048470 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c9686d50-7dbf-4b29-818e-4619f5ba0d08 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:16.048907 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c9686d50-7dbf-4b29-818e-4619f5ba0d08 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:16.079218 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-c9686d50-7dbf-4b29-818e-4619f5ba0d08 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042626 Mar 08 14:59:16.079787 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 597/1205] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:16 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:59:16.106486 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-5bb26978-f67f-4aef-b369-f600d9686d22 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:16.113800 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5bb26978-f67f-4aef-b369-f600d9686d22 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.085490 Mar 08 14:59:16.114390 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 609/1206] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:16 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:16.185896 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-c3a5f923-9c8d-43cd-82eb-5f79147266cd tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:16.186508 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-c3a5f923-9c8d-43cd-82eb-5f79147266cd tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:16.192363 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c3a5f923-9c8d-43cd-82eb-5f79147266cd tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:16.192765 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c3a5f923-9c8d-43cd-82eb-5f79147266cd tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:16.193508 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c3a5f923-9c8d-43cd-82eb-5f79147266cd tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:16.193977 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c3a5f923-9c8d-43cd-82eb-5f79147266cd tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:16.332410 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-c3a5f923-9c8d-43cd-82eb-5f79147266cd tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:16.339586 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-c3a5f923-9c8d-43cd-82eb-5f79147266cd tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.158500 Mar 08 14:59:16.340145 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 598/1207] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:16 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:16.712178 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-913f9ed9-6b07-4f33-8c02-a89b5b49d669 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:16.713091 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-913f9ed9-6b07-4f33-8c02-a89b5b49d669 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:16.719620 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-913f9ed9-6b07-4f33-8c02-a89b5b49d669 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:16.720072 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-913f9ed9-6b07-4f33-8c02-a89b5b49d669 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:16.720842 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-913f9ed9-6b07-4f33-8c02-a89b5b49d669 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:16.721285 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-913f9ed9-6b07-4f33-8c02-a89b5b49d669 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:16.750294 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-913f9ed9-6b07-4f33-8c02-a89b5b49d669 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042119 Mar 08 14:59:16.750828 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 610/1208] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:16 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:59:17.096827 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-5b4b3eff-1153-413e-967a-1619d15b8d58 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:17.097749 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-5b4b3eff-1153-413e-967a-1619d15b8d58 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:17.104068 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5b4b3eff-1153-413e-967a-1619d15b8d58 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:17.104524 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5b4b3eff-1153-413e-967a-1619d15b8d58 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:17.105295 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5b4b3eff-1153-413e-967a-1619d15b8d58 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:17.105736 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5b4b3eff-1153-413e-967a-1619d15b8d58 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:17.130694 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-fd43ccf9-94cf-4f83-9afe-30f3f302f61e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:17.131411 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-fd43ccf9-94cf-4f83-9afe-30f3f302f61e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:17.133817 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-5b4b3eff-1153-413e-967a-1619d15b8d58 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041027 Mar 08 14:59:17.134401 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 599/1209] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:17 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:59:17.137702 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fd43ccf9-94cf-4f83-9afe-30f3f302f61e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:17.138183 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fd43ccf9-94cf-4f83-9afe-30f3f302f61e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:17.138959 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fd43ccf9-94cf-4f83-9afe-30f3f302f61e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:17.139397 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fd43ccf9-94cf-4f83-9afe-30f3f302f61e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:17.198027 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-fd43ccf9-94cf-4f83-9afe-30f3f302f61e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:17.205279 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-fd43ccf9-94cf-4f83-9afe-30f3f302f61e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078412 Mar 08 14:59:17.205828 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 611/1210] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:17 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:59:17.357151 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-3afadcab-fd96-43b9-a515-43851fa18edf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:17.357680 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-3afadcab-fd96-43b9-a515-43851fa18edf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:17.363345 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3afadcab-fd96-43b9-a515-43851fa18edf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:17.363793 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3afadcab-fd96-43b9-a515-43851fa18edf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:17.364552 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3afadcab-fd96-43b9-a515-43851fa18edf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:17.364989 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3afadcab-fd96-43b9-a515-43851fa18edf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:17.499337 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-3afadcab-fd96-43b9-a515-43851fa18edf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:17.506529 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-3afadcab-fd96-43b9-a515-43851fa18edf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.153902 Mar 08 14:59:17.507082 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 600/1211] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:17 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:17.761975 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-dd70d478-c7cb-403f-b4bb-2f80b587601a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:17.763526 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-dd70d478-c7cb-403f-b4bb-2f80b587601a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:17.769808 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dd70d478-c7cb-403f-b4bb-2f80b587601a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:17.770286 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dd70d478-c7cb-403f-b4bb-2f80b587601a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:17.771048 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dd70d478-c7cb-403f-b4bb-2f80b587601a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:17.771480 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dd70d478-c7cb-403f-b4bb-2f80b587601a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:17.798687 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-dd70d478-c7cb-403f-b4bb-2f80b587601a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040890 Mar 08 14:59:17.799221 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 612/1212] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:17 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:59:18.144796 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-f5a0fb31-7598-420e-8aad-437ca6f6613a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:18.145638 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-f5a0fb31-7598-420e-8aad-437ca6f6613a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:18.151984 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f5a0fb31-7598-420e-8aad-437ca6f6613a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:18.152469 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f5a0fb31-7598-420e-8aad-437ca6f6613a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:18.153633 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f5a0fb31-7598-420e-8aad-437ca6f6613a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:18.154139 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f5a0fb31-7598-420e-8aad-437ca6f6613a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:18.182497 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-f5a0fb31-7598-420e-8aad-437ca6f6613a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041758 Mar 08 14:59:18.183044 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 601/1213] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:18 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:59:18.222165 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-8b3dc2c5-7d73-4029-b716-191bb6ae5aeb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:18.222785 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-8b3dc2c5-7d73-4029-b716-191bb6ae5aeb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:18.228986 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8b3dc2c5-7d73-4029-b716-191bb6ae5aeb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:18.229443 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8b3dc2c5-7d73-4029-b716-191bb6ae5aeb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:18.230258 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8b3dc2c5-7d73-4029-b716-191bb6ae5aeb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:18.230707 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8b3dc2c5-7d73-4029-b716-191bb6ae5aeb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:18.290809 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-8b3dc2c5-7d73-4029-b716-191bb6ae5aeb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:18.298575 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-8b3dc2c5-7d73-4029-b716-191bb6ae5aeb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080462 Mar 08 14:59:18.299135 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 613/1214] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:18 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:18.523189 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-e40b5a9a-a333-4eb4-90cd-b1aca75f64ab tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:18.523834 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-e40b5a9a-a333-4eb4-90cd-b1aca75f64ab tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:18.531235 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e40b5a9a-a333-4eb4-90cd-b1aca75f64ab tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:18.531695 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e40b5a9a-a333-4eb4-90cd-b1aca75f64ab tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:18.532474 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e40b5a9a-a333-4eb4-90cd-b1aca75f64ab tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:18.532928 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e40b5a9a-a333-4eb4-90cd-b1aca75f64ab tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:18.668057 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-e40b5a9a-a333-4eb4-90cd-b1aca75f64ab tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:18.676432 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-e40b5a9a-a333-4eb4-90cd-b1aca75f64ab tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.157128 Mar 08 14:59:18.676991 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 602/1215] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:18 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:18.810413 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5f45ad40-91cc-4463-9025-8ed1f440248d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:18.811254 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5f45ad40-91cc-4463-9025-8ed1f440248d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:18.816929 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5f45ad40-91cc-4463-9025-8ed1f440248d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:18.817391 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5f45ad40-91cc-4463-9025-8ed1f440248d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:18.818192 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5f45ad40-91cc-4463-9025-8ed1f440248d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:18.818639 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5f45ad40-91cc-4463-9025-8ed1f440248d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:18.847177 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5f45ad40-91cc-4463-9025-8ed1f440248d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041082 Mar 08 14:59:18.847726 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 614/1216] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:18 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:59:19.195363 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-9d628248-3f92-42d8-85bc-3a879dcf9d75 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:19.196281 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-9d628248-3f92-42d8-85bc-3a879dcf9d75 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:19.203465 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9d628248-3f92-42d8-85bc-3a879dcf9d75 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:19.203929 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9d628248-3f92-42d8-85bc-3a879dcf9d75 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:19.204702 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9d628248-3f92-42d8-85bc-3a879dcf9d75 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:19.205144 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9d628248-3f92-42d8-85bc-3a879dcf9d75 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:19.232332 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-9d628248-3f92-42d8-85bc-3a879dcf9d75 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041093 Mar 08 14:59:19.232887 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 603/1217] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:19 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:59:19.315963 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-74ebdef1-a274-41b7-8577-cc08461feddd tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:19.316574 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-74ebdef1-a274-41b7-8577-cc08461feddd tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:19.322792 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-74ebdef1-a274-41b7-8577-cc08461feddd tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:19.323248 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-74ebdef1-a274-41b7-8577-cc08461feddd tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:19.324016 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-74ebdef1-a274-41b7-8577-cc08461feddd tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:19.324453 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-74ebdef1-a274-41b7-8577-cc08461feddd tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:19.384215 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-74ebdef1-a274-41b7-8577-cc08461feddd tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:19.392294 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-74ebdef1-a274-41b7-8577-cc08461feddd tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080176 Mar 08 14:59:19.392863 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 615/1218] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:19 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:19.694634 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-8fff4b28-902f-4fdb-83e8-7e05da821a17 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:19.695183 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-8fff4b28-902f-4fdb-83e8-7e05da821a17 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:19.701484 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8fff4b28-902f-4fdb-83e8-7e05da821a17 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:19.701972 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8fff4b28-902f-4fdb-83e8-7e05da821a17 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:19.702747 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8fff4b28-902f-4fdb-83e8-7e05da821a17 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:19.703186 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8fff4b28-902f-4fdb-83e8-7e05da821a17 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:19.849992 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-8fff4b28-902f-4fdb-83e8-7e05da821a17 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:19.858439 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-8fff4b28-902f-4fdb-83e8-7e05da821a17 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.168186 Mar 08 14:59:19.858583 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-63d062f0-7cfb-441a-bbbf-5453d0baf035 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:19.859253 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 604/1219] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:19 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:19.868090 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-63d062f0-7cfb-441a-bbbf-5453d0baf035 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:19.874185 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-63d062f0-7cfb-441a-bbbf-5453d0baf035 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:19.874639 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-63d062f0-7cfb-441a-bbbf-5453d0baf035 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:19.875420 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-63d062f0-7cfb-441a-bbbf-5453d0baf035 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:19.875858 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-63d062f0-7cfb-441a-bbbf-5453d0baf035 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:19.905304 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-63d062f0-7cfb-441a-bbbf-5453d0baf035 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051272 Mar 08 14:59:19.906067 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 616/1220] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:19 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:59:20.243900 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-aa1bcc7d-03d1-42bb-bfa6-0943e19c85b0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:20.244856 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-aa1bcc7d-03d1-42bb-bfa6-0943e19c85b0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:20.251731 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-aa1bcc7d-03d1-42bb-bfa6-0943e19c85b0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:20.252189 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-aa1bcc7d-03d1-42bb-bfa6-0943e19c85b0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:20.252966 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-aa1bcc7d-03d1-42bb-bfa6-0943e19c85b0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:20.253412 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-aa1bcc7d-03d1-42bb-bfa6-0943e19c85b0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:20.282428 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-aa1bcc7d-03d1-42bb-bfa6-0943e19c85b0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042578 Mar 08 14:59:20.282979 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 605/1221] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:20 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:59:20.408482 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-fb9282bb-2f77-49c4-9293-d24054976801 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:20.409100 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-fb9282bb-2f77-49c4-9293-d24054976801 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:20.416520 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fb9282bb-2f77-49c4-9293-d24054976801 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:20.416985 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fb9282bb-2f77-49c4-9293-d24054976801 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:20.417771 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fb9282bb-2f77-49c4-9293-d24054976801 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:20.418250 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fb9282bb-2f77-49c4-9293-d24054976801 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:20.478713 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-fb9282bb-2f77-49c4-9293-d24054976801 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:20.486509 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-fb9282bb-2f77-49c4-9293-d24054976801 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081918 Mar 08 14:59:20.487063 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 617/1222] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:20 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:20.875894 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-fadcd82b-5021-4103-ab89-4507408d77ec tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:20.876497 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-fadcd82b-5021-4103-ab89-4507408d77ec tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:20.882440 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fadcd82b-5021-4103-ab89-4507408d77ec tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:20.882903 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fadcd82b-5021-4103-ab89-4507408d77ec tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:20.883678 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fadcd82b-5021-4103-ab89-4507408d77ec tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:20.884122 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fadcd82b-5021-4103-ab89-4507408d77ec tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:20.916614 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-0dc01692-9f8d-4d81-b2ac-cca7a47c6078 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:20.917604 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-0dc01692-9f8d-4d81-b2ac-cca7a47c6078 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:20.925069 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0dc01692-9f8d-4d81-b2ac-cca7a47c6078 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:20.925605 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0dc01692-9f8d-4d81-b2ac-cca7a47c6078 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:20.926528 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0dc01692-9f8d-4d81-b2ac-cca7a47c6078 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:20.926960 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0dc01692-9f8d-4d81-b2ac-cca7a47c6078 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:20.957003 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-0dc01692-9f8d-4d81-b2ac-cca7a47c6078 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044258 Mar 08 14:59:20.957595 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 618/1223] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:20 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:59:21.019938 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-fadcd82b-5021-4103-ab89-4507408d77ec tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:21.027231 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-fadcd82b-5021-4103-ab89-4507408d77ec tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.155659 Mar 08 14:59:21.027861 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 606/1224] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:20 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:21.294595 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5c24fa19-e6e3-45e6-8505-3c2489aa89e3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:21.295513 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5c24fa19-e6e3-45e6-8505-3c2489aa89e3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:21.301300 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5c24fa19-e6e3-45e6-8505-3c2489aa89e3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:21.301754 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5c24fa19-e6e3-45e6-8505-3c2489aa89e3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:21.302561 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5c24fa19-e6e3-45e6-8505-3c2489aa89e3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:21.302997 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5c24fa19-e6e3-45e6-8505-3c2489aa89e3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:21.331386 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5c24fa19-e6e3-45e6-8505-3c2489aa89e3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041467 Mar 08 14:59:21.331926 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 619/1225] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:21 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:59:21.503381 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-517ed880-5a00-490e-b14b-8fed73c52b75 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:21.504131 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-517ed880-5a00-490e-b14b-8fed73c52b75 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:21.510402 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-517ed880-5a00-490e-b14b-8fed73c52b75 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:21.510847 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-517ed880-5a00-490e-b14b-8fed73c52b75 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:21.511605 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-517ed880-5a00-490e-b14b-8fed73c52b75 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:21.512134 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-517ed880-5a00-490e-b14b-8fed73c52b75 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:21.572990 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-517ed880-5a00-490e-b14b-8fed73c52b75 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:21.580868 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-517ed880-5a00-490e-b14b-8fed73c52b75 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081276 Mar 08 14:59:21.581431 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 607/1226] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:21 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:21.969402 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-6a1520be-ab8e-4646-8cbb-b2982a4bb68a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:21.970338 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-6a1520be-ab8e-4646-8cbb-b2982a4bb68a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:21.976574 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6a1520be-ab8e-4646-8cbb-b2982a4bb68a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:21.977038 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6a1520be-ab8e-4646-8cbb-b2982a4bb68a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:21.977815 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6a1520be-ab8e-4646-8cbb-b2982a4bb68a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:21.978287 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6a1520be-ab8e-4646-8cbb-b2982a4bb68a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:22.007365 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-6a1520be-ab8e-4646-8cbb-b2982a4bb68a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042659 Mar 08 14:59:22.007910 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 620/1227] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:21 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:59:22.044095 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-a7685852-ed19-4529-907d-c266e714185c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:22.044711 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-a7685852-ed19-4529-907d-c266e714185c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:22.050546 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a7685852-ed19-4529-907d-c266e714185c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:22.051007 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a7685852-ed19-4529-907d-c266e714185c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:22.051782 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a7685852-ed19-4529-907d-c266e714185c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:22.052227 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a7685852-ed19-4529-907d-c266e714185c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:22.188544 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-a7685852-ed19-4529-907d-c266e714185c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:22.195913 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-a7685852-ed19-4529-907d-c266e714185c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.155631 Mar 08 14:59:22.196421 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 608/1228] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:22 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:22.343256 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-9ed736c4-aea8-460a-86d7-1b115a17f4ca tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:22.344172 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-9ed736c4-aea8-460a-86d7-1b115a17f4ca tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:22.350070 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9ed736c4-aea8-460a-86d7-1b115a17f4ca tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:22.350521 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9ed736c4-aea8-460a-86d7-1b115a17f4ca tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:22.351289 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9ed736c4-aea8-460a-86d7-1b115a17f4ca tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:22.351726 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9ed736c4-aea8-460a-86d7-1b115a17f4ca tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:22.379484 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-9ed736c4-aea8-460a-86d7-1b115a17f4ca tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040510 Mar 08 14:59:22.380031 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 621/1229] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:22 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:59:22.597523 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-9679dfcd-31a2-417b-9d51-a8ee5f8409d0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:22.598165 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-9679dfcd-31a2-417b-9d51-a8ee5f8409d0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:22.604481 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9679dfcd-31a2-417b-9d51-a8ee5f8409d0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:22.604944 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9679dfcd-31a2-417b-9d51-a8ee5f8409d0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:22.606244 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9679dfcd-31a2-417b-9d51-a8ee5f8409d0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:22.606792 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9679dfcd-31a2-417b-9d51-a8ee5f8409d0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:22.665706 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-9679dfcd-31a2-417b-9d51-a8ee5f8409d0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:22.673652 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-9679dfcd-31a2-417b-9d51-a8ee5f8409d0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080002 Mar 08 14:59:22.674252 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 609/1230] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:22 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:23.021836 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-0e83882a-05d7-45a5-a9dc-4cd47e18027c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:23.022762 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-0e83882a-05d7-45a5-a9dc-4cd47e18027c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:23.029895 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0e83882a-05d7-45a5-a9dc-4cd47e18027c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:23.030357 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0e83882a-05d7-45a5-a9dc-4cd47e18027c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:23.031155 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0e83882a-05d7-45a5-a9dc-4cd47e18027c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:23.031593 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0e83882a-05d7-45a5-a9dc-4cd47e18027c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:23.059802 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-0e83882a-05d7-45a5-a9dc-4cd47e18027c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041983 Mar 08 14:59:23.060342 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 622/1231] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:23 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:59:23.212490 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-c425d719-5af2-48e1-9db6-0bd5fdfc1e59 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:23.213034 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-c425d719-5af2-48e1-9db6-0bd5fdfc1e59 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:23.219351 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c425d719-5af2-48e1-9db6-0bd5fdfc1e59 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:23.219806 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c425d719-5af2-48e1-9db6-0bd5fdfc1e59 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:23.220587 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c425d719-5af2-48e1-9db6-0bd5fdfc1e59 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:23.221027 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c425d719-5af2-48e1-9db6-0bd5fdfc1e59 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:23.356764 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-c425d719-5af2-48e1-9db6-0bd5fdfc1e59 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:23.363984 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-c425d719-5af2-48e1-9db6-0bd5fdfc1e59 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.155468 Mar 08 14:59:23.364542 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 610/1232] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:23 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:23.391690 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-8d1fa58c-34b1-4737-978e-6640daa31468 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:23.392599 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-8d1fa58c-34b1-4737-978e-6640daa31468 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:23.398347 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8d1fa58c-34b1-4737-978e-6640daa31468 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:23.398797 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8d1fa58c-34b1-4737-978e-6640daa31468 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:23.399559 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8d1fa58c-34b1-4737-978e-6640daa31468 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:23.399992 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8d1fa58c-34b1-4737-978e-6640daa31468 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:23.427032 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-8d1fa58c-34b1-4737-978e-6640daa31468 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040106 Mar 08 14:59:23.427562 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 623/1233] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:23 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:59:23.690792 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-f9d7234b-4580-42b6-b83f-5cbf2e20a5ef tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:23.691402 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-f9d7234b-4580-42b6-b83f-5cbf2e20a5ef tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:23.697629 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f9d7234b-4580-42b6-b83f-5cbf2e20a5ef tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:23.698141 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f9d7234b-4580-42b6-b83f-5cbf2e20a5ef tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:23.698911 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f9d7234b-4580-42b6-b83f-5cbf2e20a5ef tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:23.699350 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f9d7234b-4580-42b6-b83f-5cbf2e20a5ef tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:23.757998 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-f9d7234b-4580-42b6-b83f-5cbf2e20a5ef tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:23.765915 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-f9d7234b-4580-42b6-b83f-5cbf2e20a5ef tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078924 Mar 08 14:59:23.766421 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 611/1234] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:23 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:24.071570 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-80b58d19-63c3-4101-acea-f891c252d9ab tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:24.072408 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-80b58d19-63c3-4101-acea-f891c252d9ab tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:24.079222 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-80b58d19-63c3-4101-acea-f891c252d9ab tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:24.079672 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-80b58d19-63c3-4101-acea-f891c252d9ab tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:24.080435 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-80b58d19-63c3-4101-acea-f891c252d9ab tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:24.080868 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-80b58d19-63c3-4101-acea-f891c252d9ab tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:24.109014 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-80b58d19-63c3-4101-acea-f891c252d9ab tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041828 Mar 08 14:59:24.109563 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 624/1235] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:24 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:59:24.380882 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-57ab0d6b-8ba6-40e5-a262-9b1f670ba534 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:24.381416 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-57ab0d6b-8ba6-40e5-a262-9b1f670ba534 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:24.387970 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-57ab0d6b-8ba6-40e5-a262-9b1f670ba534 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:24.388429 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-57ab0d6b-8ba6-40e5-a262-9b1f670ba534 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:24.389196 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-57ab0d6b-8ba6-40e5-a262-9b1f670ba534 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:24.389666 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-57ab0d6b-8ba6-40e5-a262-9b1f670ba534 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:24.439872 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-baac0ed1-bfda-43b2-855b-fdcbfcfc35a7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:24.440785 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-baac0ed1-bfda-43b2-855b-fdcbfcfc35a7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:24.446725 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-baac0ed1-bfda-43b2-855b-fdcbfcfc35a7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:24.447176 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-baac0ed1-bfda-43b2-855b-fdcbfcfc35a7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:24.447944 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-baac0ed1-bfda-43b2-855b-fdcbfcfc35a7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:24.448384 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-baac0ed1-bfda-43b2-855b-fdcbfcfc35a7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:24.476736 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-baac0ed1-bfda-43b2-855b-fdcbfcfc35a7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040836 Mar 08 14:59:24.477304 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 625/1236] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:24 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:59:24.526301 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-57ab0d6b-8ba6-40e5-a262-9b1f670ba534 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:24.533729 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-57ab0d6b-8ba6-40e5-a262-9b1f670ba534 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.156817 Mar 08 14:59:24.534318 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 612/1237] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:24 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:24.782307 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-22d2cef5-0965-4bdc-b036-d819eddc9191 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:24.782921 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-22d2cef5-0965-4bdc-b036-d819eddc9191 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:24.788781 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-22d2cef5-0965-4bdc-b036-d819eddc9191 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:24.789228 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-22d2cef5-0965-4bdc-b036-d819eddc9191 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:24.790026 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-22d2cef5-0965-4bdc-b036-d819eddc9191 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:24.790464 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-22d2cef5-0965-4bdc-b036-d819eddc9191 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:24.849265 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-22d2cef5-0965-4bdc-b036-d819eddc9191 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:24.856524 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-22d2cef5-0965-4bdc-b036-d819eddc9191 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078263 Mar 08 14:59:24.857074 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 626/1238] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:24 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:25.120808 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-dfcb9f75-c09c-439b-ab62-c75c1ce74ce3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:25.122292 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-dfcb9f75-c09c-439b-ab62-c75c1ce74ce3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:25.128541 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-dfcb9f75-c09c-439b-ab62-c75c1ce74ce3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:25.128990 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-dfcb9f75-c09c-439b-ab62-c75c1ce74ce3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:25.129749 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-dfcb9f75-c09c-439b-ab62-c75c1ce74ce3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:25.130212 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-dfcb9f75-c09c-439b-ab62-c75c1ce74ce3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:25.158792 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-dfcb9f75-c09c-439b-ab62-c75c1ce74ce3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042042 Mar 08 14:59:25.159349 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 613/1239] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:25 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:59:25.488097 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-8577a925-a7b9-417b-9a08-742f619afb36 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:25.489047 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-8577a925-a7b9-417b-9a08-742f619afb36 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:25.495301 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8577a925-a7b9-417b-9a08-742f619afb36 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:25.495756 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8577a925-a7b9-417b-9a08-742f619afb36 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:25.497273 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8577a925-a7b9-417b-9a08-742f619afb36 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:25.497718 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8577a925-a7b9-417b-9a08-742f619afb36 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:25.524861 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-8577a925-a7b9-417b-9a08-742f619afb36 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040692 Mar 08 14:59:25.525437 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 627/1240] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:25 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:59:25.550531 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-e0d7108a-d09c-4215-afce-b8e4a7b38fd9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:25.551149 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-e0d7108a-d09c-4215-afce-b8e4a7b38fd9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:25.557185 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e0d7108a-d09c-4215-afce-b8e4a7b38fd9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:25.557642 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e0d7108a-d09c-4215-afce-b8e4a7b38fd9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:25.558446 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e0d7108a-d09c-4215-afce-b8e4a7b38fd9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:25.559526 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e0d7108a-d09c-4215-afce-b8e4a7b38fd9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:25.693800 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-e0d7108a-d09c-4215-afce-b8e4a7b38fd9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:25.701159 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-e0d7108a-d09c-4215-afce-b8e4a7b38fd9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.154440 Mar 08 14:59:25.701728 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 614/1241] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:25 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:25.872500 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-2c65d06d-ed46-4ee6-844e-8d66d0fe389a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:25.873052 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-2c65d06d-ed46-4ee6-844e-8d66d0fe389a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:25.878956 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2c65d06d-ed46-4ee6-844e-8d66d0fe389a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:25.879415 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2c65d06d-ed46-4ee6-844e-8d66d0fe389a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:25.880188 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2c65d06d-ed46-4ee6-844e-8d66d0fe389a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:25.880633 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2c65d06d-ed46-4ee6-844e-8d66d0fe389a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:25.943989 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-2c65d06d-ed46-4ee6-844e-8d66d0fe389a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:25.952431 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-2c65d06d-ed46-4ee6-844e-8d66d0fe389a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.083833 Mar 08 14:59:25.953008 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 628/1242] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:25 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:26.170698 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-08283fcb-c005-495a-88c2-6bb3d0166c6c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:26.171529 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-08283fcb-c005-495a-88c2-6bb3d0166c6c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:26.177683 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-08283fcb-c005-495a-88c2-6bb3d0166c6c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:26.178426 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-08283fcb-c005-495a-88c2-6bb3d0166c6c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:26.179185 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-08283fcb-c005-495a-88c2-6bb3d0166c6c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:26.179619 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-08283fcb-c005-495a-88c2-6bb3d0166c6c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:26.207698 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-08283fcb-c005-495a-88c2-6bb3d0166c6c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041084 Mar 08 14:59:26.208245 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 615/1243] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:26 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:59:26.536448 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ab8ea5b6-7340-4538-8590-48dca2a73f22 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:26.537366 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ab8ea5b6-7340-4538-8590-48dca2a73f22 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:26.543812 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ab8ea5b6-7340-4538-8590-48dca2a73f22 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:26.544316 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ab8ea5b6-7340-4538-8590-48dca2a73f22 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:26.545095 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ab8ea5b6-7340-4538-8590-48dca2a73f22 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:26.545540 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ab8ea5b6-7340-4538-8590-48dca2a73f22 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:26.573666 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ab8ea5b6-7340-4538-8590-48dca2a73f22 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041276 Mar 08 14:59:26.574251 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 629/1244] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:26 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:59:26.717978 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-2c4b10dc-c08e-4a8f-b1bc-64d2eb5489c4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:26.718586 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-2c4b10dc-c08e-4a8f-b1bc-64d2eb5489c4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:26.724456 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2c4b10dc-c08e-4a8f-b1bc-64d2eb5489c4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:26.724904 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2c4b10dc-c08e-4a8f-b1bc-64d2eb5489c4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:26.725666 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2c4b10dc-c08e-4a8f-b1bc-64d2eb5489c4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:26.726125 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2c4b10dc-c08e-4a8f-b1bc-64d2eb5489c4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:26.857029 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-2c4b10dc-c08e-4a8f-b1bc-64d2eb5489c4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:26.864367 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-2c4b10dc-c08e-4a8f-b1bc-64d2eb5489c4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.150445 Mar 08 14:59:26.864923 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 616/1245] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:26 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:26.968555 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3099e3d1-9ae2-4c79-a011-3a06bcd00e91 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:26.969167 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-3099e3d1-9ae2-4c79-a011-3a06bcd00e91 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:26.975171 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3099e3d1-9ae2-4c79-a011-3a06bcd00e91 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:26.975620 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3099e3d1-9ae2-4c79-a011-3a06bcd00e91 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:26.976394 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3099e3d1-9ae2-4c79-a011-3a06bcd00e91 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:26.976812 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3099e3d1-9ae2-4c79-a011-3a06bcd00e91 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:27.034640 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-3099e3d1-9ae2-4c79-a011-3a06bcd00e91 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:27.041682 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-3099e3d1-9ae2-4c79-a011-3a06bcd00e91 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.077105 Mar 08 14:59:27.042271 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 630/1246] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:26 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:27.220043 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b3d1bbe2-1ad1-403a-85ec-6338e3c18a3d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:27.220887 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-b3d1bbe2-1ad1-403a-85ec-6338e3c18a3d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:27.228084 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b3d1bbe2-1ad1-403a-85ec-6338e3c18a3d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:27.228641 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b3d1bbe2-1ad1-403a-85ec-6338e3c18a3d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:27.229507 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b3d1bbe2-1ad1-403a-85ec-6338e3c18a3d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:27.229980 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b3d1bbe2-1ad1-403a-85ec-6338e3c18a3d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:27.260528 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-b3d1bbe2-1ad1-403a-85ec-6338e3c18a3d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045503 Mar 08 14:59:27.261074 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 617/1247] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:27 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:59:27.585993 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-7fb84b15-65af-43f1-902b-7994b20f35c6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:27.586919 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-7fb84b15-65af-43f1-902b-7994b20f35c6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:27.593187 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7fb84b15-65af-43f1-902b-7994b20f35c6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:27.593619 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7fb84b15-65af-43f1-902b-7994b20f35c6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:27.594413 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7fb84b15-65af-43f1-902b-7994b20f35c6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:27.594850 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7fb84b15-65af-43f1-902b-7994b20f35c6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:27.622629 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-7fb84b15-65af-43f1-902b-7994b20f35c6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040675 Mar 08 14:59:27.623170 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 631/1248] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:27 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:59:27.881714 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-8cd4bc43-d61a-4a31-8654-cd4861f75bca tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:27.882361 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-8cd4bc43-d61a-4a31-8654-cd4861f75bca tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:27.888590 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8cd4bc43-d61a-4a31-8654-cd4861f75bca tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:27.889041 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8cd4bc43-d61a-4a31-8654-cd4861f75bca tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:27.889806 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8cd4bc43-d61a-4a31-8654-cd4861f75bca tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:27.890271 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8cd4bc43-d61a-4a31-8654-cd4861f75bca tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:28.023471 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-8cd4bc43-d61a-4a31-8654-cd4861f75bca tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:28.031249 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-8cd4bc43-d61a-4a31-8654-cd4861f75bca tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.153421 Mar 08 14:59:28.031804 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 618/1249] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:27 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:28.059144 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-fc0077bf-695d-4c6a-941e-97fee889ceca tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:28.059759 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-fc0077bf-695d-4c6a-941e-97fee889ceca tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:28.065643 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fc0077bf-695d-4c6a-941e-97fee889ceca tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:28.066146 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fc0077bf-695d-4c6a-941e-97fee889ceca tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:28.066924 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fc0077bf-695d-4c6a-941e-97fee889ceca tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:28.067367 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fc0077bf-695d-4c6a-941e-97fee889ceca tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:28.125580 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-fc0077bf-695d-4c6a-941e-97fee889ceca tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:28.132719 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-fc0077bf-695d-4c6a-941e-97fee889ceca tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.077340 Mar 08 14:59:28.133274 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 632/1250] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:28 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:28.272163 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-d4c64a89-f890-4218-ba1e-218e152f755c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:28.273098 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-d4c64a89-f890-4218-ba1e-218e152f755c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:28.280201 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d4c64a89-f890-4218-ba1e-218e152f755c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:28.280656 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d4c64a89-f890-4218-ba1e-218e152f755c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:28.281420 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d4c64a89-f890-4218-ba1e-218e152f755c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:28.281887 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d4c64a89-f890-4218-ba1e-218e152f755c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:28.309911 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-d4c64a89-f890-4218-ba1e-218e152f755c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041791 Mar 08 14:59:28.310456 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 619/1251] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:28 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:59:28.640017 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-0ad5356b-d319-4532-9a19-2d4034f017d5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:28.640933 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-0ad5356b-d319-4532-9a19-2d4034f017d5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:28.647190 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0ad5356b-d319-4532-9a19-2d4034f017d5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:28.647642 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0ad5356b-d319-4532-9a19-2d4034f017d5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:28.648413 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0ad5356b-d319-4532-9a19-2d4034f017d5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:28.648850 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0ad5356b-d319-4532-9a19-2d4034f017d5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:28.675866 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-0ad5356b-d319-4532-9a19-2d4034f017d5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046736 Mar 08 14:59:28.676416 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 633/1252] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:28 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:59:29.049167 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-69c5a019-37a0-45e0-856c-dd75720992a2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:29.049779 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-69c5a019-37a0-45e0-856c-dd75720992a2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:29.056095 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-69c5a019-37a0-45e0-856c-dd75720992a2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:29.056541 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-69c5a019-37a0-45e0-856c-dd75720992a2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:29.057299 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-69c5a019-37a0-45e0-856c-dd75720992a2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:29.057735 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-69c5a019-37a0-45e0-856c-dd75720992a2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:29.153079 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3d6014ef-499b-4897-8d64-58ef03f99340 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:29.153825 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-3d6014ef-499b-4897-8d64-58ef03f99340 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:29.160174 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3d6014ef-499b-4897-8d64-58ef03f99340 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:29.160626 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3d6014ef-499b-4897-8d64-58ef03f99340 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:29.161392 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3d6014ef-499b-4897-8d64-58ef03f99340 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:29.161824 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3d6014ef-499b-4897-8d64-58ef03f99340 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:29.200037 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-69c5a019-37a0-45e0-856c-dd75720992a2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:29.207576 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-69c5a019-37a0-45e0-856c-dd75720992a2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.162220 Mar 08 14:59:29.208153 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 620/1253] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:29 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:29.221895 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-3d6014ef-499b-4897-8d64-58ef03f99340 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:29.229051 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-3d6014ef-499b-4897-8d64-58ef03f99340 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.082392 Mar 08 14:59:29.229599 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 634/1254] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:29 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:29.321707 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-eb7507bf-f00e-4c1a-ad35-8775f17030f5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:29.323327 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-eb7507bf-f00e-4c1a-ad35-8775f17030f5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:29.329555 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-eb7507bf-f00e-4c1a-ad35-8775f17030f5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:29.330048 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-eb7507bf-f00e-4c1a-ad35-8775f17030f5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:29.330813 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-eb7507bf-f00e-4c1a-ad35-8775f17030f5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:29.331247 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-eb7507bf-f00e-4c1a-ad35-8775f17030f5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:29.359674 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-eb7507bf-f00e-4c1a-ad35-8775f17030f5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041860 Mar 08 14:59:29.360215 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 621/1255] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:29 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:59:29.687708 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-dfae44db-1277-4332-85cb-b5cf2f19beef tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:29.688625 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-dfae44db-1277-4332-85cb-b5cf2f19beef tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:29.694979 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dfae44db-1277-4332-85cb-b5cf2f19beef tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:29.695452 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dfae44db-1277-4332-85cb-b5cf2f19beef tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:29.696223 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dfae44db-1277-4332-85cb-b5cf2f19beef tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:29.696661 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dfae44db-1277-4332-85cb-b5cf2f19beef tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:29.724570 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-dfae44db-1277-4332-85cb-b5cf2f19beef tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040947 Mar 08 14:59:29.725118 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 635/1256] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:29 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:59:30.224451 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-4b33f84c-79dd-43d8-a455-d452e3a0064a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:30.224971 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-4b33f84c-79dd-43d8-a455-d452e3a0064a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:30.231015 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4b33f84c-79dd-43d8-a455-d452e3a0064a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:30.231465 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4b33f84c-79dd-43d8-a455-d452e3a0064a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:30.232251 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4b33f84c-79dd-43d8-a455-d452e3a0064a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:30.232715 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4b33f84c-79dd-43d8-a455-d452e3a0064a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:30.247227 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-8704d2f9-84a1-4f21-86e1-027fc6780726 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:30.247966 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-8704d2f9-84a1-4f21-86e1-027fc6780726 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:30.253788 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8704d2f9-84a1-4f21-86e1-027fc6780726 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:30.254252 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8704d2f9-84a1-4f21-86e1-027fc6780726 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:30.255022 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8704d2f9-84a1-4f21-86e1-027fc6780726 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:30.255456 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8704d2f9-84a1-4f21-86e1-027fc6780726 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:30.317106 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-8704d2f9-84a1-4f21-86e1-027fc6780726 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:30.325575 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-8704d2f9-84a1-4f21-86e1-027fc6780726 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081947 Mar 08 14:59:30.326124 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 636/1257] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:30 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:59:30.368227 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-4b33f84c-79dd-43d8-a455-d452e3a0064a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:30.370743 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b2f651bc-e41d-4b57-bcf0-3d7b0762fa35 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:30.372357 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b2f651bc-e41d-4b57-bcf0-3d7b0762fa35 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:30.376350 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-4b33f84c-79dd-43d8-a455-d452e3a0064a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.155791 Mar 08 14:59:30.376919 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 622/1258] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:30 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:30.378020 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b2f651bc-e41d-4b57-bcf0-3d7b0762fa35 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:30.378532 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b2f651bc-e41d-4b57-bcf0-3d7b0762fa35 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:30.379310 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b2f651bc-e41d-4b57-bcf0-3d7b0762fa35 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:30.379741 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b2f651bc-e41d-4b57-bcf0-3d7b0762fa35 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:30.407645 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b2f651bc-e41d-4b57-bcf0-3d7b0762fa35 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040793 Mar 08 14:59:30.408186 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 637/1259] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:30 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:59:30.736210 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b5081c69-a67d-49da-bb85-b9a23eb9ffdc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:30.737165 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-b5081c69-a67d-49da-bb85-b9a23eb9ffdc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:30.743052 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b5081c69-a67d-49da-bb85-b9a23eb9ffdc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:30.743509 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b5081c69-a67d-49da-bb85-b9a23eb9ffdc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:30.744277 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b5081c69-a67d-49da-bb85-b9a23eb9ffdc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:30.744720 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b5081c69-a67d-49da-bb85-b9a23eb9ffdc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:30.772340 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-b5081c69-a67d-49da-bb85-b9a23eb9ffdc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040106 Mar 08 14:59:30.772882 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 623/1260] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:30 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:59:31.343366 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-93326696-5137-462f-aefa-a033021664fc tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:31.343976 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-93326696-5137-462f-aefa-a033021664fc tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:31.349927 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-93326696-5137-462f-aefa-a033021664fc tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:31.350382 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-93326696-5137-462f-aefa-a033021664fc tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:31.351145 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-93326696-5137-462f-aefa-a033021664fc tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:31.351577 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-93326696-5137-462f-aefa-a033021664fc tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:31.393260 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-de38459a-894f-480d-9ec9-2ed543b30304 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:31.393873 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-de38459a-894f-480d-9ec9-2ed543b30304 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:31.400233 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-de38459a-894f-480d-9ec9-2ed543b30304 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:31.400699 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-de38459a-894f-480d-9ec9-2ed543b30304 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:31.401479 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-de38459a-894f-480d-9ec9-2ed543b30304 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:31.402039 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-de38459a-894f-480d-9ec9-2ed543b30304 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:31.410876 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-93326696-5137-462f-aefa-a033021664fc tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:31.418697 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-93326696-5137-462f-aefa-a033021664fc tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079840 Mar 08 14:59:31.427530 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 638/1261] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:31 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:31.427530 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-bc895f9e-54d6-4a09-b484-d5ba1f9f31ea tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:31.427530 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-bc895f9e-54d6-4a09-b484-d5ba1f9f31ea tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:31.431494 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bc895f9e-54d6-4a09-b484-d5ba1f9f31ea tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:31.431948 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bc895f9e-54d6-4a09-b484-d5ba1f9f31ea tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:31.432719 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bc895f9e-54d6-4a09-b484-d5ba1f9f31ea tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:31.433154 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bc895f9e-54d6-4a09-b484-d5ba1f9f31ea tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:31.461801 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-bc895f9e-54d6-4a09-b484-d5ba1f9f31ea tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041339 Mar 08 14:59:31.462403 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 639/1262] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:31 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:59:31.540353 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-de38459a-894f-480d-9ec9-2ed543b30304 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:31.547826 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-de38459a-894f-480d-9ec9-2ed543b30304 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.158376 Mar 08 14:59:31.548395 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 624/1263] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:31 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:59:31.784568 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-fc9afce9-def3-4f45-84d6-ad8923b09267 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:31.785475 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-fc9afce9-def3-4f45-84d6-ad8923b09267 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:31.791384 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fc9afce9-def3-4f45-84d6-ad8923b09267 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:31.791831 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fc9afce9-def3-4f45-84d6-ad8923b09267 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:31.792599 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fc9afce9-def3-4f45-84d6-ad8923b09267 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:31.793808 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fc9afce9-def3-4f45-84d6-ad8923b09267 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:31.821776 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-fc9afce9-def3-4f45-84d6-ad8923b09267 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041090 Mar 08 14:59:31.822346 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 640/1264] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:31 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:59:32.436950 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-06a32c87-cd12-44fb-95ff-15503fc64e78 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:32.437566 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-06a32c87-cd12-44fb-95ff-15503fc64e78 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:32.443915 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-06a32c87-cd12-44fb-95ff-15503fc64e78 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:32.444375 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-06a32c87-cd12-44fb-95ff-15503fc64e78 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:32.445149 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-06a32c87-cd12-44fb-95ff-15503fc64e78 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:32.445591 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-06a32c87-cd12-44fb-95ff-15503fc64e78 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:32.472619 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-38b946bb-c648-471c-b95f-5d88d6a739b9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:32.473559 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-38b946bb-c648-471c-b95f-5d88d6a739b9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:32.479816 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-38b946bb-c648-471c-b95f-5d88d6a739b9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:32.480271 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-38b946bb-c648-471c-b95f-5d88d6a739b9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:32.481631 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-38b946bb-c648-471c-b95f-5d88d6a739b9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:32.482091 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-38b946bb-c648-471c-b95f-5d88d6a739b9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:32.504920 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-06a32c87-cd12-44fb-95ff-15503fc64e78 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:32.510743 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-38b946bb-c648-471c-b95f-5d88d6a739b9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042034 Mar 08 14:59:32.511299 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 641/1265] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:32 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:59:32.513093 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-06a32c87-cd12-44fb-95ff-15503fc64e78 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080863 Mar 08 14:59:32.513655 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 625/1266] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:32 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:32.564701 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d5121062-1baf-4acf-b74d-9cc063983626 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:32.565307 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d5121062-1baf-4acf-b74d-9cc063983626 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:32.570943 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d5121062-1baf-4acf-b74d-9cc063983626 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:32.571387 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d5121062-1baf-4acf-b74d-9cc063983626 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:32.572145 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d5121062-1baf-4acf-b74d-9cc063983626 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:32.572577 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d5121062-1baf-4acf-b74d-9cc063983626 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:32.710015 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d5121062-1baf-4acf-b74d-9cc063983626 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:32.717391 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d5121062-1baf-4acf-b74d-9cc063983626 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.156307 Mar 08 14:59:32.717970 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 642/1267] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:32 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:32.833511 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-82a565da-a1bf-4052-b72e-a256bb8e4b5c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:32.834457 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-82a565da-a1bf-4052-b72e-a256bb8e4b5c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:32.840869 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-82a565da-a1bf-4052-b72e-a256bb8e4b5c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:32.841328 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-82a565da-a1bf-4052-b72e-a256bb8e4b5c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:32.842130 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-82a565da-a1bf-4052-b72e-a256bb8e4b5c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:32.842576 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-82a565da-a1bf-4052-b72e-a256bb8e4b5c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:32.870036 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-82a565da-a1bf-4052-b72e-a256bb8e4b5c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040518 Mar 08 14:59:32.870575 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 626/1268] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:32 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:59:33.523224 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-fa3e21e9-5121-4738-8c05-10f5fcbf907c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:33.524169 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-fa3e21e9-5121-4738-8c05-10f5fcbf907c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:33.531058 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-61caabdd-4182-45c3-97f7-d8c4818965d8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:33.531670 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fa3e21e9-5121-4738-8c05-10f5fcbf907c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:33.531796 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-61caabdd-4182-45c3-97f7-d8c4818965d8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:33.532130 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fa3e21e9-5121-4738-8c05-10f5fcbf907c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:33.532911 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fa3e21e9-5121-4738-8c05-10f5fcbf907c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:33.533353 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fa3e21e9-5121-4738-8c05-10f5fcbf907c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:33.538053 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-61caabdd-4182-45c3-97f7-d8c4818965d8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:33.538509 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-61caabdd-4182-45c3-97f7-d8c4818965d8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:33.539283 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-61caabdd-4182-45c3-97f7-d8c4818965d8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:33.539720 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-61caabdd-4182-45c3-97f7-d8c4818965d8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:33.563169 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-fa3e21e9-5121-4738-8c05-10f5fcbf907c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043910 Mar 08 14:59:33.563941 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 643/1269] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:33 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:59:33.602486 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-61caabdd-4182-45c3-97f7-d8c4818965d8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:33.609840 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-61caabdd-4182-45c3-97f7-d8c4818965d8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.084014 Mar 08 14:59:33.610424 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 627/1270] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:33 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:33.734362 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-a5c6b6f3-f7b0-4880-9652-447091a8f9ca tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:33.734977 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-a5c6b6f3-f7b0-4880-9652-447091a8f9ca tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:33.740769 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a5c6b6f3-f7b0-4880-9652-447091a8f9ca tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:33.741219 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a5c6b6f3-f7b0-4880-9652-447091a8f9ca tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:33.742024 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a5c6b6f3-f7b0-4880-9652-447091a8f9ca tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:33.742464 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a5c6b6f3-f7b0-4880-9652-447091a8f9ca tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:33.875576 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-a5c6b6f3-f7b0-4880-9652-447091a8f9ca tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:33.882864 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-a75ff41c-cd85-4a7f-8dec-1e0c30ee2aca tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:33.883089 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-a5c6b6f3-f7b0-4880-9652-447091a8f9ca tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.152542 Mar 08 14:59:33.883668 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 644/1271] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:33 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:33.883811 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-a75ff41c-cd85-4a7f-8dec-1e0c30ee2aca tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:33.890326 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a75ff41c-cd85-4a7f-8dec-1e0c30ee2aca tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:33.890773 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a75ff41c-cd85-4a7f-8dec-1e0c30ee2aca tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:33.891537 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a75ff41c-cd85-4a7f-8dec-1e0c30ee2aca tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:33.891972 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a75ff41c-cd85-4a7f-8dec-1e0c30ee2aca tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:33.919156 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-a75ff41c-cd85-4a7f-8dec-1e0c30ee2aca tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040194 Mar 08 14:59:33.919696 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 628/1272] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:33 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:59:34.574699 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3e839076-1473-4e02-9ecb-5596a50332c7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:34.576004 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-3e839076-1473-4e02-9ecb-5596a50332c7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:34.582135 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3e839076-1473-4e02-9ecb-5596a50332c7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:34.582590 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3e839076-1473-4e02-9ecb-5596a50332c7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:34.583368 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3e839076-1473-4e02-9ecb-5596a50332c7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:34.583809 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3e839076-1473-4e02-9ecb-5596a50332c7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:34.612219 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-3e839076-1473-4e02-9ecb-5596a50332c7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041511 Mar 08 14:59:34.612763 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 645/1273] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:34 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:59:34.626771 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-703901a1-7735-4b23-8bd0-90512bd80746 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:34.627382 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-703901a1-7735-4b23-8bd0-90512bd80746 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:34.633539 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-703901a1-7735-4b23-8bd0-90512bd80746 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:34.634021 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-703901a1-7735-4b23-8bd0-90512bd80746 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:34.634781 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-703901a1-7735-4b23-8bd0-90512bd80746 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:34.635214 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-703901a1-7735-4b23-8bd0-90512bd80746 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:34.695338 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-703901a1-7735-4b23-8bd0-90512bd80746 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:34.702642 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-703901a1-7735-4b23-8bd0-90512bd80746 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079802 Mar 08 14:59:34.703203 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 629/1274] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:34 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:34.900460 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-acb8b2e9-db69-441c-b1b4-018292b7f41f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:34.901024 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-acb8b2e9-db69-441c-b1b4-018292b7f41f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:34.907378 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-acb8b2e9-db69-441c-b1b4-018292b7f41f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:34.907824 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-acb8b2e9-db69-441c-b1b4-018292b7f41f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:34.908584 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-acb8b2e9-db69-441c-b1b4-018292b7f41f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:34.909017 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-acb8b2e9-db69-441c-b1b4-018292b7f41f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:34.930848 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-45082f00-7ab4-41e1-89e9-c3027923c325 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:34.931803 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-45082f00-7ab4-41e1-89e9-c3027923c325 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:34.937823 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-45082f00-7ab4-41e1-89e9-c3027923c325 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:34.938311 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-45082f00-7ab4-41e1-89e9-c3027923c325 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:34.939086 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-45082f00-7ab4-41e1-89e9-c3027923c325 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:34.939523 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-45082f00-7ab4-41e1-89e9-c3027923c325 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:34.968475 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-45082f00-7ab4-41e1-89e9-c3027923c325 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041828 Mar 08 14:59:34.969038 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 630/1275] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:34 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:59:35.045916 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-acb8b2e9-db69-441c-b1b4-018292b7f41f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:35.053393 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-acb8b2e9-db69-441c-b1b4-018292b7f41f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.156583 Mar 08 14:59:35.053978 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 646/1276] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:34 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:35.624547 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-fa1c03f7-9770-420e-8ac5-49fc14c85da1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:35.625445 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-fa1c03f7-9770-420e-8ac5-49fc14c85da1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:35.631725 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fa1c03f7-9770-420e-8ac5-49fc14c85da1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:35.632292 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fa1c03f7-9770-420e-8ac5-49fc14c85da1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:35.632926 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fa1c03f7-9770-420e-8ac5-49fc14c85da1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:35.633368 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fa1c03f7-9770-420e-8ac5-49fc14c85da1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:35.660806 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-fa1c03f7-9770-420e-8ac5-49fc14c85da1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040823 Mar 08 14:59:35.661360 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 631/1277] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:35 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:59:35.719199 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-dd55bd72-f0ed-4bfe-8c36-e848f1da426f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:35.719830 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-dd55bd72-f0ed-4bfe-8c36-e848f1da426f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:35.726128 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dd55bd72-f0ed-4bfe-8c36-e848f1da426f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:35.726604 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dd55bd72-f0ed-4bfe-8c36-e848f1da426f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:35.727382 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dd55bd72-f0ed-4bfe-8c36-e848f1da426f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:35.727821 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dd55bd72-f0ed-4bfe-8c36-e848f1da426f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:35.786213 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-dd55bd72-f0ed-4bfe-8c36-e848f1da426f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:35.793941 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-dd55bd72-f0ed-4bfe-8c36-e848f1da426f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078774 Mar 08 14:59:35.794506 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 647/1278] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:35 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:35.979240 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-7087b420-d178-43d0-a171-717cad961bad tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:35.980199 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-7087b420-d178-43d0-a171-717cad961bad tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:35.986250 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7087b420-d178-43d0-a171-717cad961bad tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:35.986709 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7087b420-d178-43d0-a171-717cad961bad tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:35.987490 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7087b420-d178-43d0-a171-717cad961bad tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:35.987938 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7087b420-d178-43d0-a171-717cad961bad tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:36.015578 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-7087b420-d178-43d0-a171-717cad961bad tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040342 Mar 08 14:59:36.016124 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 632/1279] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:35 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:59:36.070438 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-bdc68a3f-5828-4bc8-a4c6-152db4004cac tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:36.070981 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-bdc68a3f-5828-4bc8-a4c6-152db4004cac tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:36.077519 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bdc68a3f-5828-4bc8-a4c6-152db4004cac tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:36.078002 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bdc68a3f-5828-4bc8-a4c6-152db4004cac tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:36.078778 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bdc68a3f-5828-4bc8-a4c6-152db4004cac tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:36.079216 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bdc68a3f-5828-4bc8-a4c6-152db4004cac tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:36.211327 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-bdc68a3f-5828-4bc8-a4c6-152db4004cac tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:36.218635 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-bdc68a3f-5828-4bc8-a4c6-152db4004cac tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.152096 Mar 08 14:59:36.219201 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 648/1280] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:36 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:36.672286 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-519727af-143b-45f8-88e1-6545d39099b6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:36.673184 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-519727af-143b-45f8-88e1-6545d39099b6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:36.679731 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-519727af-143b-45f8-88e1-6545d39099b6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:36.680181 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-519727af-143b-45f8-88e1-6545d39099b6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:36.680941 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-519727af-143b-45f8-88e1-6545d39099b6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:36.681378 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-519727af-143b-45f8-88e1-6545d39099b6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:36.709194 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-519727af-143b-45f8-88e1-6545d39099b6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041372 Mar 08 14:59:36.709961 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 633/1281] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:36 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:59:36.811170 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-0b90622f-78b2-46a1-991a-ab84f430e783 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:36.811787 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-0b90622f-78b2-46a1-991a-ab84f430e783 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:36.817715 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0b90622f-78b2-46a1-991a-ab84f430e783 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:36.818196 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0b90622f-78b2-46a1-991a-ab84f430e783 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:36.818969 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0b90622f-78b2-46a1-991a-ab84f430e783 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:36.819409 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0b90622f-78b2-46a1-991a-ab84f430e783 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:36.881594 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-0b90622f-78b2-46a1-991a-ab84f430e783 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:36.889639 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-0b90622f-78b2-46a1-991a-ab84f430e783 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.083541 Mar 08 14:59:36.890232 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 649/1282] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:36 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:37.027221 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-8cfb7b42-a21c-4da4-b780-4affd0d38b30 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:37.028343 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-8cfb7b42-a21c-4da4-b780-4affd0d38b30 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:37.034359 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8cfb7b42-a21c-4da4-b780-4affd0d38b30 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:37.034811 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8cfb7b42-a21c-4da4-b780-4affd0d38b30 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:37.035583 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8cfb7b42-a21c-4da4-b780-4affd0d38b30 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:37.036023 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8cfb7b42-a21c-4da4-b780-4affd0d38b30 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:37.064115 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-8cfb7b42-a21c-4da4-b780-4affd0d38b30 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040865 Mar 08 14:59:37.064665 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 634/1283] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:37 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:59:37.240946 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-eeea5e78-0f5c-43a4-87ee-9dd13c0dfb95 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:37.241559 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-eeea5e78-0f5c-43a4-87ee-9dd13c0dfb95 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:37.249201 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-eeea5e78-0f5c-43a4-87ee-9dd13c0dfb95 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:37.249651 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-eeea5e78-0f5c-43a4-87ee-9dd13c0dfb95 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:37.250454 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-eeea5e78-0f5c-43a4-87ee-9dd13c0dfb95 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:37.250894 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-eeea5e78-0f5c-43a4-87ee-9dd13c0dfb95 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:37.382684 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-eeea5e78-0f5c-43a4-87ee-9dd13c0dfb95 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:37.391721 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-eeea5e78-0f5c-43a4-87ee-9dd13c0dfb95 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.154694 Mar 08 14:59:37.392308 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 650/1284] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:37 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:37.721319 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-5ec55ca9-7299-4f1d-8cd6-9f158caaabf2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:37.722267 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-5ec55ca9-7299-4f1d-8cd6-9f158caaabf2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:37.728481 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5ec55ca9-7299-4f1d-8cd6-9f158caaabf2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:37.728928 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5ec55ca9-7299-4f1d-8cd6-9f158caaabf2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:37.729691 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5ec55ca9-7299-4f1d-8cd6-9f158caaabf2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:37.730835 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5ec55ca9-7299-4f1d-8cd6-9f158caaabf2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:37.758258 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-5ec55ca9-7299-4f1d-8cd6-9f158caaabf2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040929 Mar 08 14:59:37.758801 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 635/1285] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:37 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:59:37.907708 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-4aa2b886-b046-44e5-a31d-9b34f96cb18b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:37.908259 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-4aa2b886-b046-44e5-a31d-9b34f96cb18b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:37.914115 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4aa2b886-b046-44e5-a31d-9b34f96cb18b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:37.914576 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4aa2b886-b046-44e5-a31d-9b34f96cb18b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:37.915350 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4aa2b886-b046-44e5-a31d-9b34f96cb18b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:37.915798 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4aa2b886-b046-44e5-a31d-9b34f96cb18b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:37.975777 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-4aa2b886-b046-44e5-a31d-9b34f96cb18b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:37.983122 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-4aa2b886-b046-44e5-a31d-9b34f96cb18b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079337 Mar 08 14:59:37.983690 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 651/1286] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:37 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:38.075170 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-83d7979a-abf3-4d0d-888e-501683bbf1f3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:38.076083 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-83d7979a-abf3-4d0d-888e-501683bbf1f3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:38.082718 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-83d7979a-abf3-4d0d-888e-501683bbf1f3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:38.083169 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-83d7979a-abf3-4d0d-888e-501683bbf1f3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:38.084418 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-83d7979a-abf3-4d0d-888e-501683bbf1f3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:38.084857 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-83d7979a-abf3-4d0d-888e-501683bbf1f3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:38.112406 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-83d7979a-abf3-4d0d-888e-501683bbf1f3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041182 Mar 08 14:59:38.112957 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 636/1287] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:38 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:59:38.408530 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-6956363a-6398-4dcc-8952-9dab8451adbd tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:38.409173 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-6956363a-6398-4dcc-8952-9dab8451adbd tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:38.415394 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6956363a-6398-4dcc-8952-9dab8451adbd tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:38.415846 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6956363a-6398-4dcc-8952-9dab8451adbd tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:38.416618 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6956363a-6398-4dcc-8952-9dab8451adbd tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:38.417056 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6956363a-6398-4dcc-8952-9dab8451adbd tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:38.554068 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-6956363a-6398-4dcc-8952-9dab8451adbd tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:38.561832 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-6956363a-6398-4dcc-8952-9dab8451adbd tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.157184 Mar 08 14:59:38.562412 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 652/1288] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:38 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:38.769268 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-4e3778c3-bce4-4680-af6d-e32a21db974c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:38.770213 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-4e3778c3-bce4-4680-af6d-e32a21db974c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:38.776372 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4e3778c3-bce4-4680-af6d-e32a21db974c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:38.776825 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4e3778c3-bce4-4680-af6d-e32a21db974c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:38.778127 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4e3778c3-bce4-4680-af6d-e32a21db974c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:38.778578 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4e3778c3-bce4-4680-af6d-e32a21db974c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:38.806943 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-4e3778c3-bce4-4680-af6d-e32a21db974c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041674 Mar 08 14:59:38.807489 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 637/1289] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:38 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:59:39.000434 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-fc6585c5-cf58-4c23-ad85-872d663869e5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:39.001041 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-fc6585c5-cf58-4c23-ad85-872d663869e5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:39.006857 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fc6585c5-cf58-4c23-ad85-872d663869e5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:39.007302 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fc6585c5-cf58-4c23-ad85-872d663869e5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:39.008063 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fc6585c5-cf58-4c23-ad85-872d663869e5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:39.008498 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fc6585c5-cf58-4c23-ad85-872d663869e5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:39.068280 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-fc6585c5-cf58-4c23-ad85-872d663869e5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:39.076029 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-fc6585c5-cf58-4c23-ad85-872d663869e5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080130 Mar 08 14:59:39.076591 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 653/1290] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:38 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:39.123814 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-f7ae290f-f69a-4d6f-b901-fa214fca25d0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:39.124766 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-f7ae290f-f69a-4d6f-b901-fa214fca25d0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:39.130952 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f7ae290f-f69a-4d6f-b901-fa214fca25d0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:39.131401 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f7ae290f-f69a-4d6f-b901-fa214fca25d0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:39.132182 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f7ae290f-f69a-4d6f-b901-fa214fca25d0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:39.132621 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f7ae290f-f69a-4d6f-b901-fa214fca25d0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:39.164168 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-f7ae290f-f69a-4d6f-b901-fa214fca25d0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044222 Mar 08 14:59:39.164760 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 638/1291] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:39 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:59:39.579492 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-89f0e3b8-49b8-4a1f-9263-45baaa5cc2f3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:39.580098 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-89f0e3b8-49b8-4a1f-9263-45baaa5cc2f3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:39.586515 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-89f0e3b8-49b8-4a1f-9263-45baaa5cc2f3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:39.586962 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-89f0e3b8-49b8-4a1f-9263-45baaa5cc2f3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:39.587726 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-89f0e3b8-49b8-4a1f-9263-45baaa5cc2f3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:39.588163 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-89f0e3b8-49b8-4a1f-9263-45baaa5cc2f3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:39.722525 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-89f0e3b8-49b8-4a1f-9263-45baaa5cc2f3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:39.729777 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-89f0e3b8-49b8-4a1f-9263-45baaa5cc2f3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.154477 Mar 08 14:59:39.730863 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 654/1292] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:39 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:39.819059 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-bfaa4e20-fab4-4b27-96a5-117517f00d01 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:39.819897 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-bfaa4e20-fab4-4b27-96a5-117517f00d01 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:39.826980 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bfaa4e20-fab4-4b27-96a5-117517f00d01 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:39.827433 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bfaa4e20-fab4-4b27-96a5-117517f00d01 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:39.828226 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bfaa4e20-fab4-4b27-96a5-117517f00d01 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:39.828656 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bfaa4e20-fab4-4b27-96a5-117517f00d01 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:39.855627 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-bfaa4e20-fab4-4b27-96a5-117517f00d01 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040545 Mar 08 14:59:39.856164 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 639/1293] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:39 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:59:40.093672 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-fde6bc01-c4b9-4dfd-888b-826f558aa148 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:40.094263 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-fde6bc01-c4b9-4dfd-888b-826f558aa148 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:40.099991 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fde6bc01-c4b9-4dfd-888b-826f558aa148 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:40.100442 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fde6bc01-c4b9-4dfd-888b-826f558aa148 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:40.101262 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fde6bc01-c4b9-4dfd-888b-826f558aa148 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:40.101741 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fde6bc01-c4b9-4dfd-888b-826f558aa148 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:40.161333 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-fde6bc01-c4b9-4dfd-888b-826f558aa148 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:40.168914 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-fde6bc01-c4b9-4dfd-888b-826f558aa148 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079448 Mar 08 14:59:40.169471 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 655/1294] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:40 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:40.176510 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-89c35ff1-6993-458f-a832-b1cba2fa33ea tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:40.177442 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-89c35ff1-6993-458f-a832-b1cba2fa33ea tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:40.184111 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-89c35ff1-6993-458f-a832-b1cba2fa33ea tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:40.184568 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-89c35ff1-6993-458f-a832-b1cba2fa33ea tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:40.185339 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-89c35ff1-6993-458f-a832-b1cba2fa33ea tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:40.185780 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-89c35ff1-6993-458f-a832-b1cba2fa33ea tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:40.213680 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-89c35ff1-6993-458f-a832-b1cba2fa33ea tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041178 Mar 08 14:59:40.214266 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 640/1295] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:40 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:59:40.223803 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 14:59:40.223977 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: Tue Mar 8 14:59:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 14:59:40.746121 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f832f73f-06f0-4af3-b623-7c39163e9126 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:40.746723 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f832f73f-06f0-4af3-b623-7c39163e9126 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:40.752976 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f832f73f-06f0-4af3-b623-7c39163e9126 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:40.753428 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f832f73f-06f0-4af3-b623-7c39163e9126 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:40.754222 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f832f73f-06f0-4af3-b623-7c39163e9126 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:40.754659 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f832f73f-06f0-4af3-b623-7c39163e9126 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:40.867207 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-266c4801-ed92-4a0c-a645-b0f0e63f6be7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:40.868369 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-266c4801-ed92-4a0c-a645-b0f0e63f6be7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:40.874881 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-266c4801-ed92-4a0c-a645-b0f0e63f6be7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:40.875332 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-266c4801-ed92-4a0c-a645-b0f0e63f6be7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:40.876095 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-266c4801-ed92-4a0c-a645-b0f0e63f6be7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:40.876530 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-266c4801-ed92-4a0c-a645-b0f0e63f6be7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:40.893040 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f832f73f-06f0-4af3-b623-7c39163e9126 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:40.900313 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f832f73f-06f0-4af3-b623-7c39163e9126 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.158096 Mar 08 14:59:40.900883 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 656/1296] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:40 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:40.905261 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-266c4801-ed92-4a0c-a645-b0f0e63f6be7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042006 Mar 08 14:59:40.905808 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 641/1297] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:40 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:59:40.921578 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 14:59:40.921737 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: Tue Mar 8 14:59:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 14:59:41.186330 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-bf31512c-bf5b-4f3a-ab91-9bfe5d92cf82 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:41.186953 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-bf31512c-bf5b-4f3a-ab91-9bfe5d92cf82 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:41.192713 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bf31512c-bf5b-4f3a-ab91-9bfe5d92cf82 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:41.193163 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bf31512c-bf5b-4f3a-ab91-9bfe5d92cf82 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:41.193944 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bf31512c-bf5b-4f3a-ab91-9bfe5d92cf82 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:41.194382 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bf31512c-bf5b-4f3a-ab91-9bfe5d92cf82 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:41.224636 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-7a1d8476-e3ed-4030-a6dd-4b1a7b71643e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:41.225584 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-7a1d8476-e3ed-4030-a6dd-4b1a7b71643e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:41.231723 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7a1d8476-e3ed-4030-a6dd-4b1a7b71643e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:41.232187 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7a1d8476-e3ed-4030-a6dd-4b1a7b71643e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:41.232971 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7a1d8476-e3ed-4030-a6dd-4b1a7b71643e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:41.233430 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7a1d8476-e3ed-4030-a6dd-4b1a7b71643e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:41.256087 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-bf31512c-bf5b-4f3a-ab91-9bfe5d92cf82 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:41.261730 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-7a1d8476-e3ed-4030-a6dd-4b1a7b71643e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040450 Mar 08 14:59:41.262248 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 642/1298] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:41 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:59:41.263953 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-bf31512c-bf5b-4f3a-ab91-9bfe5d92cf82 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081717 Mar 08 14:59:41.264511 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 657/1299] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:41 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:41.916843 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-4b12bac2-496f-48b3-b945-7b0282cd1f0a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:41.917036 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-ba302e2f-a113-4666-b4c9-bc74de315744 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:41.918070 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-4b12bac2-496f-48b3-b945-7b0282cd1f0a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:41.918381 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-ba302e2f-a113-4666-b4c9-bc74de315744 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:41.924204 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4b12bac2-496f-48b3-b945-7b0282cd1f0a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:41.924656 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4b12bac2-496f-48b3-b945-7b0282cd1f0a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:41.924774 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ba302e2f-a113-4666-b4c9-bc74de315744 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:41.925172 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ba302e2f-a113-4666-b4c9-bc74de315744 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:41.925431 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4b12bac2-496f-48b3-b945-7b0282cd1f0a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:41.925886 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4b12bac2-496f-48b3-b945-7b0282cd1f0a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:41.926037 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ba302e2f-a113-4666-b4c9-bc74de315744 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:41.926412 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ba302e2f-a113-4666-b4c9-bc74de315744 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:41.958637 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-ba302e2f-a113-4666-b4c9-bc74de315744 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045573 Mar 08 14:59:41.959417 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 643/1300] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:41 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:59:42.063154 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-4b12bac2-496f-48b3-b945-7b0282cd1f0a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:42.070370 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-4b12bac2-496f-48b3-b945-7b0282cd1f0a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.157436 Mar 08 14:59:42.070924 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 658/1301] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:41 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:42.273160 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-59d5d8e5-1c46-4096-9bb9-cd6a569124b2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:42.274102 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-59d5d8e5-1c46-4096-9bb9-cd6a569124b2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:42.280551 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-59d5d8e5-1c46-4096-9bb9-cd6a569124b2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:42.281000 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-59d5d8e5-1c46-4096-9bb9-cd6a569124b2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:42.281109 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-75ef9adb-1ccd-41ad-becb-7ad132e6948a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:42.281639 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-75ef9adb-1ccd-41ad-becb-7ad132e6948a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:42.281814 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-59d5d8e5-1c46-4096-9bb9-cd6a569124b2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:42.282283 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-59d5d8e5-1c46-4096-9bb9-cd6a569124b2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:42.287572 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-75ef9adb-1ccd-41ad-becb-7ad132e6948a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:42.288027 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-75ef9adb-1ccd-41ad-becb-7ad132e6948a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:42.288798 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-75ef9adb-1ccd-41ad-becb-7ad132e6948a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:42.289244 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-75ef9adb-1ccd-41ad-becb-7ad132e6948a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:42.310925 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-59d5d8e5-1c46-4096-9bb9-cd6a569124b2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041605 Mar 08 14:59:42.311890 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 644/1302] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:42 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:59:42.348460 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-75ef9adb-1ccd-41ad-becb-7ad132e6948a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:42.356348 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-75ef9adb-1ccd-41ad-becb-7ad132e6948a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079988 Mar 08 14:59:42.356892 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 659/1303] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:42 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:59:42.970460 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-8193e3e7-0d5c-465a-ab1d-611f6c58213d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:42.971364 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-8193e3e7-0d5c-465a-ab1d-611f6c58213d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:42.977534 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8193e3e7-0d5c-465a-ab1d-611f6c58213d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:42.978023 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8193e3e7-0d5c-465a-ab1d-611f6c58213d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:42.978788 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8193e3e7-0d5c-465a-ab1d-611f6c58213d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:42.979222 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8193e3e7-0d5c-465a-ab1d-611f6c58213d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:43.007068 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-8193e3e7-0d5c-465a-ab1d-611f6c58213d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040597 Mar 08 14:59:43.007599 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 645/1304] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:42 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:59:43.087096 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-1c934698-6b69-42eb-8f86-39fe391eebb2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:43.087704 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-1c934698-6b69-42eb-8f86-39fe391eebb2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:43.094511 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1c934698-6b69-42eb-8f86-39fe391eebb2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:43.095012 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1c934698-6b69-42eb-8f86-39fe391eebb2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:43.095781 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1c934698-6b69-42eb-8f86-39fe391eebb2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:43.096218 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1c934698-6b69-42eb-8f86-39fe391eebb2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:43.229420 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-1c934698-6b69-42eb-8f86-39fe391eebb2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:43.237205 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-1c934698-6b69-42eb-8f86-39fe391eebb2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.153912 Mar 08 14:59:43.237766 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 660/1305] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:43 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:43.322569 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-9cdf1e9b-012f-4b1f-97b4-10e44e50989d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:43.324218 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-9cdf1e9b-012f-4b1f-97b4-10e44e50989d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:43.330106 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9cdf1e9b-012f-4b1f-97b4-10e44e50989d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:43.330558 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9cdf1e9b-012f-4b1f-97b4-10e44e50989d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:43.331316 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9cdf1e9b-012f-4b1f-97b4-10e44e50989d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:43.331755 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9cdf1e9b-012f-4b1f-97b4-10e44e50989d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:43.359092 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-9cdf1e9b-012f-4b1f-97b4-10e44e50989d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040426 Mar 08 14:59:43.359630 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 646/1306] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:43 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:59:43.372983 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-7ebe2ce3-0a1e-44c9-95cd-60afab26b4f9 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:43.373599 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-7ebe2ce3-0a1e-44c9-95cd-60afab26b4f9 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:43.379351 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7ebe2ce3-0a1e-44c9-95cd-60afab26b4f9 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:43.379805 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7ebe2ce3-0a1e-44c9-95cd-60afab26b4f9 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:43.380577 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7ebe2ce3-0a1e-44c9-95cd-60afab26b4f9 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:43.381016 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7ebe2ce3-0a1e-44c9-95cd-60afab26b4f9 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:43.440955 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-7ebe2ce3-0a1e-44c9-95cd-60afab26b4f9 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:43.448122 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-7ebe2ce3-0a1e-44c9-95cd-60afab26b4f9 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079651 Mar 08 14:59:43.448703 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 661/1307] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:43 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:44.018920 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-a62d1aed-dd59-43b4-b52a-d9834e382013 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:44.019829 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-a62d1aed-dd59-43b4-b52a-d9834e382013 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:44.025784 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a62d1aed-dd59-43b4-b52a-d9834e382013 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:44.026275 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a62d1aed-dd59-43b4-b52a-d9834e382013 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:44.028177 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a62d1aed-dd59-43b4-b52a-d9834e382013 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:44.028629 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a62d1aed-dd59-43b4-b52a-d9834e382013 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:44.056475 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-a62d1aed-dd59-43b4-b52a-d9834e382013 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041797 Mar 08 14:59:44.057012 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 647/1308] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:44 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:59:44.254716 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ea0d2af5-4646-460a-b42c-fe9ea1786d56 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:44.255330 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ea0d2af5-4646-460a-b42c-fe9ea1786d56 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:44.263173 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ea0d2af5-4646-460a-b42c-fe9ea1786d56 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:44.263583 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ea0d2af5-4646-460a-b42c-fe9ea1786d56 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:44.264366 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ea0d2af5-4646-460a-b42c-fe9ea1786d56 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:44.264804 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ea0d2af5-4646-460a-b42c-fe9ea1786d56 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:44.371296 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-e2c0ec41-25cf-4a8f-ab85-0e22582b916d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:44.373237 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-e2c0ec41-25cf-4a8f-ab85-0e22582b916d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:44.379855 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e2c0ec41-25cf-4a8f-ab85-0e22582b916d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:44.380449 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e2c0ec41-25cf-4a8f-ab85-0e22582b916d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:44.381307 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e2c0ec41-25cf-4a8f-ab85-0e22582b916d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:44.381878 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e2c0ec41-25cf-4a8f-ab85-0e22582b916d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:44.410025 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ea0d2af5-4646-460a-b42c-fe9ea1786d56 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:44.411037 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-e2c0ec41-25cf-4a8f-ab85-0e22582b916d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044202 Mar 08 14:59:44.411961 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 648/1309] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:44 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:59:44.418941 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ea0d2af5-4646-460a-b42c-fe9ea1786d56 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.167780 Mar 08 14:59:44.428669 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 662/1310] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:44 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:44.464615 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-44fc8f90-ee97-47e2-aeb0-d4329efe03ac tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:44.465411 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-44fc8f90-ee97-47e2-aeb0-d4329efe03ac tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:44.471317 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-44fc8f90-ee97-47e2-aeb0-d4329efe03ac tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:44.471788 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-44fc8f90-ee97-47e2-aeb0-d4329efe03ac tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:44.472539 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-44fc8f90-ee97-47e2-aeb0-d4329efe03ac tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:44.472979 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-44fc8f90-ee97-47e2-aeb0-d4329efe03ac tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:44.531979 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-44fc8f90-ee97-47e2-aeb0-d4329efe03ac tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:44.539273 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-44fc8f90-ee97-47e2-aeb0-d4329efe03ac tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078692 Mar 08 14:59:44.539831 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 649/1311] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:44 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:59:45.068648 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-6f94a800-9b94-40e4-8cb4-aecc7d0ace27 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:45.069589 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-6f94a800-9b94-40e4-8cb4-aecc7d0ace27 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:45.075406 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6f94a800-9b94-40e4-8cb4-aecc7d0ace27 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:45.075855 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6f94a800-9b94-40e4-8cb4-aecc7d0ace27 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:45.076622 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6f94a800-9b94-40e4-8cb4-aecc7d0ace27 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:45.077053 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6f94a800-9b94-40e4-8cb4-aecc7d0ace27 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:45.104499 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-6f94a800-9b94-40e4-8cb4-aecc7d0ace27 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039809 Mar 08 14:59:45.105649 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 663/1312] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:45 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:59:45.423537 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-37867cfc-c43e-422d-9433-23e02c7ff86a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:45.424456 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-37867cfc-c43e-422d-9433-23e02c7ff86a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:45.431242 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-37867cfc-c43e-422d-9433-23e02c7ff86a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:45.431704 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-37867cfc-c43e-422d-9433-23e02c7ff86a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:45.432481 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-37867cfc-c43e-422d-9433-23e02c7ff86a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:45.432938 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-37867cfc-c43e-422d-9433-23e02c7ff86a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:45.435952 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-51d36759-3926-4796-97cc-02ab3fe9622e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:45.436562 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-51d36759-3926-4796-97cc-02ab3fe9622e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:45.442973 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-51d36759-3926-4796-97cc-02ab3fe9622e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:45.443417 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-51d36759-3926-4796-97cc-02ab3fe9622e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:45.444184 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-51d36759-3926-4796-97cc-02ab3fe9622e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:45.444613 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-51d36759-3926-4796-97cc-02ab3fe9622e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:45.463735 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-37867cfc-c43e-422d-9433-23e02c7ff86a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044223 Mar 08 14:59:45.468402 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 650/1313] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:45 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:59:45.560168 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-cfbb24d3-71d6-46f9-990e-9accfb7fe8d0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:45.560782 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-cfbb24d3-71d6-46f9-990e-9accfb7fe8d0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:45.566603 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cfbb24d3-71d6-46f9-990e-9accfb7fe8d0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:45.567059 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cfbb24d3-71d6-46f9-990e-9accfb7fe8d0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:45.567837 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cfbb24d3-71d6-46f9-990e-9accfb7fe8d0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:45.568279 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cfbb24d3-71d6-46f9-990e-9accfb7fe8d0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:45.586187 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-51d36759-3926-4796-97cc-02ab3fe9622e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:45.594534 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-51d36759-3926-4796-97cc-02ab3fe9622e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.162484 Mar 08 14:59:45.595103 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 664/1314] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:45 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:59:45.637217 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-cfbb24d3-71d6-46f9-990e-9accfb7fe8d0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:45.644844 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-cfbb24d3-71d6-46f9-990e-9accfb7fe8d0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.088488 Mar 08 14:59:45.645411 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 651/1315] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:45 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:59:46.116876 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b1b96adf-abcf-4140-ae2e-253a77cd9ce7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:46.117814 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b1b96adf-abcf-4140-ae2e-253a77cd9ce7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:46.124001 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b1b96adf-abcf-4140-ae2e-253a77cd9ce7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:46.124465 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b1b96adf-abcf-4140-ae2e-253a77cd9ce7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:46.125237 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b1b96adf-abcf-4140-ae2e-253a77cd9ce7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:46.125679 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b1b96adf-abcf-4140-ae2e-253a77cd9ce7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:46.153402 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b1b96adf-abcf-4140-ae2e-253a77cd9ce7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040553 Mar 08 14:59:46.153965 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 665/1316] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:46 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:59:46.476322 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-baab242f-3160-4701-9d07-166c5047eaa3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:46.477313 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-baab242f-3160-4701-9d07-166c5047eaa3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:46.484607 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-baab242f-3160-4701-9d07-166c5047eaa3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:46.485066 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-baab242f-3160-4701-9d07-166c5047eaa3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:46.485840 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-baab242f-3160-4701-9d07-166c5047eaa3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:46.486306 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-baab242f-3160-4701-9d07-166c5047eaa3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:46.514504 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-baab242f-3160-4701-9d07-166c5047eaa3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042178 Mar 08 14:59:46.515113 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 652/1317] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:46 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:59:46.611916 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-338e9092-356e-4269-85d2-cf2f6b717ac9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:46.612530 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-338e9092-356e-4269-85d2-cf2f6b717ac9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:46.618826 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-338e9092-356e-4269-85d2-cf2f6b717ac9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:46.619277 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-338e9092-356e-4269-85d2-cf2f6b717ac9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:46.620046 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-338e9092-356e-4269-85d2-cf2f6b717ac9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:46.620482 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-338e9092-356e-4269-85d2-cf2f6b717ac9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:46.662364 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-006dfa57-e2f6-46da-be2b-8f88b02d0a5d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:46.663091 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-006dfa57-e2f6-46da-be2b-8f88b02d0a5d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:46.669557 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-006dfa57-e2f6-46da-be2b-8f88b02d0a5d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:46.670041 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-006dfa57-e2f6-46da-be2b-8f88b02d0a5d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:46.670816 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-006dfa57-e2f6-46da-be2b-8f88b02d0a5d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:46.671255 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-006dfa57-e2f6-46da-be2b-8f88b02d0a5d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:46.731571 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-006dfa57-e2f6-46da-be2b-8f88b02d0a5d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:46.738911 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-006dfa57-e2f6-46da-be2b-8f88b02d0a5d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080385 Mar 08 14:59:46.739778 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 653/1318] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:46 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:59:46.761956 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-338e9092-356e-4269-85d2-cf2f6b717ac9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:46.769199 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-338e9092-356e-4269-85d2-cf2f6b717ac9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.161163 Mar 08 14:59:46.770016 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 666/1319] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:46 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:47.165046 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-4ce80036-d0c4-4a67-8a82-99bc8d897ceb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:47.166079 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-4ce80036-d0c4-4a67-8a82-99bc8d897ceb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:47.172137 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4ce80036-d0c4-4a67-8a82-99bc8d897ceb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:47.172588 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4ce80036-d0c4-4a67-8a82-99bc8d897ceb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:47.173346 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4ce80036-d0c4-4a67-8a82-99bc8d897ceb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:47.173784 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4ce80036-d0c4-4a67-8a82-99bc8d897ceb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:47.201657 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-4ce80036-d0c4-4a67-8a82-99bc8d897ceb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040548 Mar 08 14:59:47.202236 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 654/1320] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:47 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:59:47.526049 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-e3d377de-29a0-4ea2-81fb-1412037b59ef tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:47.527017 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-e3d377de-29a0-4ea2-81fb-1412037b59ef tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:47.533190 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e3d377de-29a0-4ea2-81fb-1412037b59ef tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:47.533640 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e3d377de-29a0-4ea2-81fb-1412037b59ef tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:47.534442 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e3d377de-29a0-4ea2-81fb-1412037b59ef tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:47.534877 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e3d377de-29a0-4ea2-81fb-1412037b59ef tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:47.563442 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-e3d377de-29a0-4ea2-81fb-1412037b59ef tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041393 Mar 08 14:59:47.563986 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 667/1321] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:47 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:59:47.755839 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-2e012c44-1680-4527-bcd8-641a4660219b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:47.756446 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-2e012c44-1680-4527-bcd8-641a4660219b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:47.762888 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2e012c44-1680-4527-bcd8-641a4660219b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:47.763341 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2e012c44-1680-4527-bcd8-641a4660219b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:47.764097 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2e012c44-1680-4527-bcd8-641a4660219b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:47.764529 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2e012c44-1680-4527-bcd8-641a4660219b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:47.787486 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-2f96e681-fc1d-4220-98d0-7476248b6f50 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:47.788031 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-2f96e681-fc1d-4220-98d0-7476248b6f50 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:47.795335 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2f96e681-fc1d-4220-98d0-7476248b6f50 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:47.795794 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2f96e681-fc1d-4220-98d0-7476248b6f50 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:47.796570 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2f96e681-fc1d-4220-98d0-7476248b6f50 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:47.797015 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2f96e681-fc1d-4220-98d0-7476248b6f50 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:47.824081 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-2e012c44-1680-4527-bcd8-641a4660219b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:47.831519 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-2e012c44-1680-4527-bcd8-641a4660219b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079564 Mar 08 14:59:47.832089 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 655/1322] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:47 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:47.935595 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-2f96e681-fc1d-4220-98d0-7476248b6f50 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:47.943137 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-2f96e681-fc1d-4220-98d0-7476248b6f50 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.159548 Mar 08 14:59:47.943705 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 668/1323] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:47 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:59:48.213452 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-225da967-302d-461e-9850-aaedb123bd5c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:48.214422 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-225da967-302d-461e-9850-aaedb123bd5c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:48.220287 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-225da967-302d-461e-9850-aaedb123bd5c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:48.220734 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-225da967-302d-461e-9850-aaedb123bd5c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:48.221491 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-225da967-302d-461e-9850-aaedb123bd5c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:48.221964 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-225da967-302d-461e-9850-aaedb123bd5c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:48.249348 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-225da967-302d-461e-9850-aaedb123bd5c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039957 Mar 08 14:59:48.249913 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 656/1324] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:48 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:59:48.574995 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c5467f3e-d4ca-49cf-a7a6-8cfe29add348 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:48.575907 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-c5467f3e-d4ca-49cf-a7a6-8cfe29add348 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:48.581601 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c5467f3e-d4ca-49cf-a7a6-8cfe29add348 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:48.582085 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c5467f3e-d4ca-49cf-a7a6-8cfe29add348 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:48.582852 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c5467f3e-d4ca-49cf-a7a6-8cfe29add348 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:48.583285 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c5467f3e-d4ca-49cf-a7a6-8cfe29add348 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:48.610971 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-c5467f3e-d4ca-49cf-a7a6-8cfe29add348 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040020 Mar 08 14:59:48.611510 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 669/1325] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:48 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:59:48.848369 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-a540d647-1658-4df0-b1cb-2cc72c43bea1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:48.848925 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-a540d647-1658-4df0-b1cb-2cc72c43bea1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:48.855862 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a540d647-1658-4df0-b1cb-2cc72c43bea1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:48.856386 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a540d647-1658-4df0-b1cb-2cc72c43bea1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:48.857172 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a540d647-1658-4df0-b1cb-2cc72c43bea1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:48.857613 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a540d647-1658-4df0-b1cb-2cc72c43bea1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:48.916522 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-a540d647-1658-4df0-b1cb-2cc72c43bea1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:48.924569 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-a540d647-1658-4df0-b1cb-2cc72c43bea1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080190 Mar 08 14:59:48.925144 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 657/1326] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:48 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:48.960074 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b7232e23-c5d7-4b8b-b457-4640645cbab0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:48.960682 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b7232e23-c5d7-4b8b-b457-4640645cbab0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:48.967675 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b7232e23-c5d7-4b8b-b457-4640645cbab0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:48.968118 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b7232e23-c5d7-4b8b-b457-4640645cbab0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:48.968881 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b7232e23-c5d7-4b8b-b457-4640645cbab0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:48.969316 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b7232e23-c5d7-4b8b-b457-4640645cbab0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:49.107165 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b7232e23-c5d7-4b8b-b457-4640645cbab0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:49.115165 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b7232e23-c5d7-4b8b-b457-4640645cbab0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.159016 Mar 08 14:59:49.115749 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 670/1327] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:48 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:59:49.260693 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-a80bba80-db71-43b7-b5f8-fa090992db1b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:49.261621 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-a80bba80-db71-43b7-b5f8-fa090992db1b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:49.267990 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a80bba80-db71-43b7-b5f8-fa090992db1b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:49.268524 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a80bba80-db71-43b7-b5f8-fa090992db1b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:49.269414 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a80bba80-db71-43b7-b5f8-fa090992db1b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:49.269972 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a80bba80-db71-43b7-b5f8-fa090992db1b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:49.300258 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-a80bba80-db71-43b7-b5f8-fa090992db1b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043423 Mar 08 14:59:49.300906 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 658/1328] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:49 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:59:49.622770 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-7f1e2eaa-22ce-41b7-871a-367b1dcb08b4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:49.623677 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-7f1e2eaa-22ce-41b7-871a-367b1dcb08b4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:49.629483 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7f1e2eaa-22ce-41b7-871a-367b1dcb08b4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:49.629967 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7f1e2eaa-22ce-41b7-871a-367b1dcb08b4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:49.630731 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7f1e2eaa-22ce-41b7-871a-367b1dcb08b4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:49.631165 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7f1e2eaa-22ce-41b7-871a-367b1dcb08b4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:49.658781 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-7f1e2eaa-22ce-41b7-871a-367b1dcb08b4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040163 Mar 08 14:59:49.659322 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 671/1329] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:49 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:59:49.941501 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-438c66b5-ce02-45c3-9d5d-81b3427367cd tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:49.942149 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-438c66b5-ce02-45c3-9d5d-81b3427367cd tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:49.949368 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-438c66b5-ce02-45c3-9d5d-81b3427367cd tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:49.949985 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-438c66b5-ce02-45c3-9d5d-81b3427367cd tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:49.950760 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-438c66b5-ce02-45c3-9d5d-81b3427367cd tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:49.951193 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-438c66b5-ce02-45c3-9d5d-81b3427367cd tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:50.012354 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-438c66b5-ce02-45c3-9d5d-81b3427367cd tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:50.019652 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-438c66b5-ce02-45c3-9d5d-81b3427367cd tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.082031 Mar 08 14:59:50.020213 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 659/1330] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:49 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:50.132664 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-0ee46085-07e9-48fd-880d-4b1cd5761e99 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:50.133302 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-0ee46085-07e9-48fd-880d-4b1cd5761e99 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:50.139964 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0ee46085-07e9-48fd-880d-4b1cd5761e99 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:50.140425 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0ee46085-07e9-48fd-880d-4b1cd5761e99 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:50.141200 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0ee46085-07e9-48fd-880d-4b1cd5761e99 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:50.141645 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0ee46085-07e9-48fd-880d-4b1cd5761e99 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:50.279075 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-0ee46085-07e9-48fd-880d-4b1cd5761e99 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:50.286323 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-0ee46085-07e9-48fd-880d-4b1cd5761e99 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.157538 Mar 08 14:59:50.286908 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 672/1331] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:50 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:50.312312 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-69ca33e9-deb4-49d2-9ee2-2eff655bcc7b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:50.313223 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-69ca33e9-deb4-49d2-9ee2-2eff655bcc7b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:50.319011 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-69ca33e9-deb4-49d2-9ee2-2eff655bcc7b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:50.319464 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-69ca33e9-deb4-49d2-9ee2-2eff655bcc7b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:50.320229 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-69ca33e9-deb4-49d2-9ee2-2eff655bcc7b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:50.320724 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-69ca33e9-deb4-49d2-9ee2-2eff655bcc7b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:50.348671 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-69ca33e9-deb4-49d2-9ee2-2eff655bcc7b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041132 Mar 08 14:59:50.349207 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 660/1332] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:50 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:59:50.671112 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5033c8ab-6ae5-45ad-9122-6da5a250b57d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:50.671948 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5033c8ab-6ae5-45ad-9122-6da5a250b57d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:50.678188 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5033c8ab-6ae5-45ad-9122-6da5a250b57d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:50.678648 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5033c8ab-6ae5-45ad-9122-6da5a250b57d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:50.679427 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5033c8ab-6ae5-45ad-9122-6da5a250b57d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:50.679875 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5033c8ab-6ae5-45ad-9122-6da5a250b57d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:50.707378 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5033c8ab-6ae5-45ad-9122-6da5a250b57d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041184 Mar 08 14:59:50.707929 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 673/1333] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:50 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:59:51.036487 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-d8dd7b46-004c-4b88-b3b8-b3bf73097076 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:51.037096 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-d8dd7b46-004c-4b88-b3b8-b3bf73097076 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:51.043300 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d8dd7b46-004c-4b88-b3b8-b3bf73097076 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:51.043750 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d8dd7b46-004c-4b88-b3b8-b3bf73097076 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:51.044508 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d8dd7b46-004c-4b88-b3b8-b3bf73097076 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:51.044943 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d8dd7b46-004c-4b88-b3b8-b3bf73097076 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:51.103698 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-d8dd7b46-004c-4b88-b3b8-b3bf73097076 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:51.111088 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-d8dd7b46-004c-4b88-b3b8-b3bf73097076 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078460 Mar 08 14:59:51.111641 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 661/1334] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:51 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:51.304223 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-8f012785-db32-402c-81bd-4a6dc22a5bd5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:51.304863 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-8f012785-db32-402c-81bd-4a6dc22a5bd5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:51.311143 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8f012785-db32-402c-81bd-4a6dc22a5bd5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:51.311594 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8f012785-db32-402c-81bd-4a6dc22a5bd5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:51.312362 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8f012785-db32-402c-81bd-4a6dc22a5bd5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:51.312800 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8f012785-db32-402c-81bd-4a6dc22a5bd5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:51.361973 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-afaf45e8-1558-4aa5-abc6-918e86d93ebf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:51.362992 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-afaf45e8-1558-4aa5-abc6-918e86d93ebf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:51.368902 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-afaf45e8-1558-4aa5-abc6-918e86d93ebf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:51.369364 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-afaf45e8-1558-4aa5-abc6-918e86d93ebf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:51.370775 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-afaf45e8-1558-4aa5-abc6-918e86d93ebf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:51.371566 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-afaf45e8-1558-4aa5-abc6-918e86d93ebf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:51.399735 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-afaf45e8-1558-4aa5-abc6-918e86d93ebf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041750 Mar 08 14:59:51.400292 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 662/1335] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:51 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:59:51.449820 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-8f012785-db32-402c-81bd-4a6dc22a5bd5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:51.457102 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-8f012785-db32-402c-81bd-4a6dc22a5bd5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.157054 Mar 08 14:59:51.457668 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 674/1336] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:51 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:51.719451 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-66361a67-bcdc-49cb-8a4c-cc5a56de3c76 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:51.720280 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-66361a67-bcdc-49cb-8a4c-cc5a56de3c76 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:51.726150 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-66361a67-bcdc-49cb-8a4c-cc5a56de3c76 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:51.726602 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-66361a67-bcdc-49cb-8a4c-cc5a56de3c76 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:51.727361 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-66361a67-bcdc-49cb-8a4c-cc5a56de3c76 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:51.727795 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-66361a67-bcdc-49cb-8a4c-cc5a56de3c76 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:51.756104 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-66361a67-bcdc-49cb-8a4c-cc5a56de3c76 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040666 Mar 08 14:59:51.756644 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 663/1337] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:51 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:59:52.128389 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-a91ccf73-e8e4-41db-bde6-3d91a3f39e23 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:52.129024 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-a91ccf73-e8e4-41db-bde6-3d91a3f39e23 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:52.135038 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a91ccf73-e8e4-41db-bde6-3d91a3f39e23 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:52.135491 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a91ccf73-e8e4-41db-bde6-3d91a3f39e23 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:52.136755 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a91ccf73-e8e4-41db-bde6-3d91a3f39e23 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:52.137201 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a91ccf73-e8e4-41db-bde6-3d91a3f39e23 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:52.200450 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-a91ccf73-e8e4-41db-bde6-3d91a3f39e23 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:52.208017 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-a91ccf73-e8e4-41db-bde6-3d91a3f39e23 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.083570 Mar 08 14:59:52.208573 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 675/1338] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:52 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:52.410642 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-f1736f9f-bd05-4573-ae5f-513bf821d1bf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:52.411523 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-f1736f9f-bd05-4573-ae5f-513bf821d1bf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:52.417898 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f1736f9f-bd05-4573-ae5f-513bf821d1bf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:52.418353 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f1736f9f-bd05-4573-ae5f-513bf821d1bf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:52.419118 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f1736f9f-bd05-4573-ae5f-513bf821d1bf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:52.419562 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f1736f9f-bd05-4573-ae5f-513bf821d1bf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:52.447181 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-f1736f9f-bd05-4573-ae5f-513bf821d1bf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040611 Mar 08 14:59:52.447712 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 664/1339] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:52 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:59:52.474382 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-9cca2601-7c3a-41e0-963f-8e62c9d3e383 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:52.474990 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-9cca2601-7c3a-41e0-963f-8e62c9d3e383 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:52.481254 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9cca2601-7c3a-41e0-963f-8e62c9d3e383 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:52.481699 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9cca2601-7c3a-41e0-963f-8e62c9d3e383 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:52.482488 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9cca2601-7c3a-41e0-963f-8e62c9d3e383 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:52.482932 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9cca2601-7c3a-41e0-963f-8e62c9d3e383 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:52.616413 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-9cca2601-7c3a-41e0-963f-8e62c9d3e383 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:52.624040 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-9cca2601-7c3a-41e0-963f-8e62c9d3e383 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.153393 Mar 08 14:59:52.624657 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 676/1340] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:52 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:52.767663 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-447204c7-54e6-44c1-82c7-5ecf95f9179b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:52.768583 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-447204c7-54e6-44c1-82c7-5ecf95f9179b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:52.774587 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-447204c7-54e6-44c1-82c7-5ecf95f9179b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:52.775058 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-447204c7-54e6-44c1-82c7-5ecf95f9179b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:52.775806 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-447204c7-54e6-44c1-82c7-5ecf95f9179b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:52.776242 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-447204c7-54e6-44c1-82c7-5ecf95f9179b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:52.804978 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-447204c7-54e6-44c1-82c7-5ecf95f9179b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041297 Mar 08 14:59:52.805521 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 665/1341] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:52 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:59:53.225601 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3332e249-ebe5-4444-bdc0-75e3c7e83aed tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:53.226188 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-3332e249-ebe5-4444-bdc0-75e3c7e83aed tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:53.232574 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3332e249-ebe5-4444-bdc0-75e3c7e83aed tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:53.233026 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3332e249-ebe5-4444-bdc0-75e3c7e83aed tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:53.233789 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3332e249-ebe5-4444-bdc0-75e3c7e83aed tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:53.234248 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3332e249-ebe5-4444-bdc0-75e3c7e83aed tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:53.291901 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-3332e249-ebe5-4444-bdc0-75e3c7e83aed tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:53.299744 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-3332e249-ebe5-4444-bdc0-75e3c7e83aed tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078068 Mar 08 14:59:53.300294 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 677/1342] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:53 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:59:53.418113 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 14:59:53.418633 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: Tue Mar 8 14:59:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 14:59:53.459070 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-4c676ae7-7610-4172-8fbf-de43a840dc26 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:53.459992 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-4c676ae7-7610-4172-8fbf-de43a840dc26 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:53.466365 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4c676ae7-7610-4172-8fbf-de43a840dc26 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:53.466816 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4c676ae7-7610-4172-8fbf-de43a840dc26 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:53.467582 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4c676ae7-7610-4172-8fbf-de43a840dc26 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:53.468015 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4c676ae7-7610-4172-8fbf-de43a840dc26 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:53.495904 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-4c676ae7-7610-4172-8fbf-de43a840dc26 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040066 Mar 08 14:59:53.496374 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 666/1343] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:53 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:59:53.642199 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ad6054ab-3efb-4dae-b4ff-aac1e72a7e3c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:53.642806 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ad6054ab-3efb-4dae-b4ff-aac1e72a7e3c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:53.649093 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ad6054ab-3efb-4dae-b4ff-aac1e72a7e3c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:53.649542 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ad6054ab-3efb-4dae-b4ff-aac1e72a7e3c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:53.650331 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ad6054ab-3efb-4dae-b4ff-aac1e72a7e3c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:53.650762 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ad6054ab-3efb-4dae-b4ff-aac1e72a7e3c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:53.790366 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ad6054ab-3efb-4dae-b4ff-aac1e72a7e3c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:53.798441 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ad6054ab-3efb-4dae-b4ff-aac1e72a7e3c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.160171 Mar 08 14:59:53.799016 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 678/1344] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:53 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:53.816425 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-f794235f-b9d0-4b07-9025-5a5981cc69a0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:53.817352 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-f794235f-b9d0-4b07-9025-5a5981cc69a0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:53.823138 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f794235f-b9d0-4b07-9025-5a5981cc69a0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:53.823616 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f794235f-b9d0-4b07-9025-5a5981cc69a0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:53.824394 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f794235f-b9d0-4b07-9025-5a5981cc69a0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:53.824839 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f794235f-b9d0-4b07-9025-5a5981cc69a0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:53.851611 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-f794235f-b9d0-4b07-9025-5a5981cc69a0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039079 Mar 08 14:59:53.852147 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 667/1345] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:53 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:59:54.317450 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f5aa43dd-cbb1-4657-adf9-4842c352a6cf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:54.318113 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f5aa43dd-cbb1-4657-adf9-4842c352a6cf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:54.324134 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f5aa43dd-cbb1-4657-adf9-4842c352a6cf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:54.324592 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f5aa43dd-cbb1-4657-adf9-4842c352a6cf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:54.325370 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f5aa43dd-cbb1-4657-adf9-4842c352a6cf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:54.325814 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f5aa43dd-cbb1-4657-adf9-4842c352a6cf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:54.383980 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f5aa43dd-cbb1-4657-adf9-4842c352a6cf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:54.391556 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f5aa43dd-cbb1-4657-adf9-4842c352a6cf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.077832 Mar 08 14:59:54.392115 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 679/1346] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:54 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:54.507334 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-f5596aed-ac5f-4201-882b-12a2194e2093 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:54.508248 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-f5596aed-ac5f-4201-882b-12a2194e2093 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:54.515905 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f5596aed-ac5f-4201-882b-12a2194e2093 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:54.516356 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f5596aed-ac5f-4201-882b-12a2194e2093 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:54.517122 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f5596aed-ac5f-4201-882b-12a2194e2093 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:54.517562 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f5596aed-ac5f-4201-882b-12a2194e2093 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:54.546502 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-f5596aed-ac5f-4201-882b-12a2194e2093 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043208 Mar 08 14:59:54.547039 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 668/1347] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:54 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:59:54.816509 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-26a36b5b-68dc-46e7-aad0-b971509bea6b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:54.817127 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-26a36b5b-68dc-46e7-aad0-b971509bea6b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:54.824697 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-26a36b5b-68dc-46e7-aad0-b971509bea6b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:54.825230 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-26a36b5b-68dc-46e7-aad0-b971509bea6b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:54.826073 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-26a36b5b-68dc-46e7-aad0-b971509bea6b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:54.826581 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-26a36b5b-68dc-46e7-aad0-b971509bea6b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:54.863772 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-734cf15f-3f72-4d66-a9c0-6f284b121c89 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:54.864686 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-734cf15f-3f72-4d66-a9c0-6f284b121c89 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:54.871784 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-734cf15f-3f72-4d66-a9c0-6f284b121c89 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:54.872236 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-734cf15f-3f72-4d66-a9c0-6f284b121c89 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:54.873011 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-734cf15f-3f72-4d66-a9c0-6f284b121c89 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:54.873501 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-734cf15f-3f72-4d66-a9c0-6f284b121c89 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:54.902667 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-734cf15f-3f72-4d66-a9c0-6f284b121c89 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042773 Mar 08 14:59:54.903230 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 669/1348] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:54 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:59:54.964888 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-26a36b5b-68dc-46e7-aad0-b971509bea6b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:54.972350 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-26a36b5b-68dc-46e7-aad0-b971509bea6b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.159683 Mar 08 14:59:54.972916 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 680/1349] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:54 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:55.408508 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-fcd6acbb-347e-4bd8-b76d-4fb97ce3f315 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:55.409174 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-fcd6acbb-347e-4bd8-b76d-4fb97ce3f315 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:55.415309 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fcd6acbb-347e-4bd8-b76d-4fb97ce3f315 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:55.415766 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fcd6acbb-347e-4bd8-b76d-4fb97ce3f315 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:55.416541 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fcd6acbb-347e-4bd8-b76d-4fb97ce3f315 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:55.417526 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fcd6acbb-347e-4bd8-b76d-4fb97ce3f315 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:55.481517 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-fcd6acbb-347e-4bd8-b76d-4fb97ce3f315 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:55.488826 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-fcd6acbb-347e-4bd8-b76d-4fb97ce3f315 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.084360 Mar 08 14:59:55.489376 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 670/1350] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:55 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:55.558937 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-18d71fb2-7e88-4bd2-92ba-8102c0bdf5ac tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:55.559877 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-18d71fb2-7e88-4bd2-92ba-8102c0bdf5ac tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:55.565806 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-18d71fb2-7e88-4bd2-92ba-8102c0bdf5ac tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:55.566293 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-18d71fb2-7e88-4bd2-92ba-8102c0bdf5ac tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:55.567064 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-18d71fb2-7e88-4bd2-92ba-8102c0bdf5ac tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:55.567506 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-18d71fb2-7e88-4bd2-92ba-8102c0bdf5ac tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:55.595093 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-18d71fb2-7e88-4bd2-92ba-8102c0bdf5ac tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040774 Mar 08 14:59:55.595634 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 681/1351] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:55 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:59:55.914011 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-556c05c6-219d-4d34-b274-d1c096e707b2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:55.914959 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-556c05c6-219d-4d34-b274-d1c096e707b2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:55.921955 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-556c05c6-219d-4d34-b274-d1c096e707b2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:55.922411 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-556c05c6-219d-4d34-b274-d1c096e707b2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:55.923180 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-556c05c6-219d-4d34-b274-d1c096e707b2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:55.923624 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-556c05c6-219d-4d34-b274-d1c096e707b2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:55.952636 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-556c05c6-219d-4d34-b274-d1c096e707b2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042568 Mar 08 14:59:55.953197 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 671/1352] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:55 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:59:55.990071 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c51bef34-b88f-43d6-8123-bd7048bff0a2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:55.990716 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-c51bef34-b88f-43d6-8123-bd7048bff0a2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:55.997256 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c51bef34-b88f-43d6-8123-bd7048bff0a2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:55.997714 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c51bef34-b88f-43d6-8123-bd7048bff0a2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:55.998520 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c51bef34-b88f-43d6-8123-bd7048bff0a2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:55.998967 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c51bef34-b88f-43d6-8123-bd7048bff0a2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:56.139057 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-c51bef34-b88f-43d6-8123-bd7048bff0a2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:56.146435 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-c51bef34-b88f-43d6-8123-bd7048bff0a2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.160390 Mar 08 14:59:56.146998 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 682/1353] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:55 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:56.506034 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-89f7dcc5-28c4-4505-a33a-19b309c45110 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:56.506638 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-89f7dcc5-28c4-4505-a33a-19b309c45110 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:56.513205 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-89f7dcc5-28c4-4505-a33a-19b309c45110 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:56.513651 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-89f7dcc5-28c4-4505-a33a-19b309c45110 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:56.514445 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-89f7dcc5-28c4-4505-a33a-19b309c45110 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:56.514882 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-89f7dcc5-28c4-4505-a33a-19b309c45110 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:56.573035 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-89f7dcc5-28c4-4505-a33a-19b309c45110 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:56.580883 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-89f7dcc5-28c4-4505-a33a-19b309c45110 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078752 Mar 08 14:59:56.581440 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 672/1354] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:56 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:56.606919 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b406d456-ef9d-46d4-a24b-3f7e2caa8e4a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:56.607856 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b406d456-ef9d-46d4-a24b-3f7e2caa8e4a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:56.613713 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b406d456-ef9d-46d4-a24b-3f7e2caa8e4a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:56.614196 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b406d456-ef9d-46d4-a24b-3f7e2caa8e4a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:56.614967 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b406d456-ef9d-46d4-a24b-3f7e2caa8e4a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:56.615406 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b406d456-ef9d-46d4-a24b-3f7e2caa8e4a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:56.644823 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b406d456-ef9d-46d4-a24b-3f7e2caa8e4a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042586 Mar 08 14:59:56.645563 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 683/1355] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:56 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:59:56.963863 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-286f4d33-073c-4cef-a134-ed2a69eb84ae tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:56.964770 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-286f4d33-073c-4cef-a134-ed2a69eb84ae tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:56.971066 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-286f4d33-073c-4cef-a134-ed2a69eb84ae tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:56.971513 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-286f4d33-073c-4cef-a134-ed2a69eb84ae tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:56.972268 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-286f4d33-073c-4cef-a134-ed2a69eb84ae tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:56.972702 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-286f4d33-073c-4cef-a134-ed2a69eb84ae tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:57.000852 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-286f4d33-073c-4cef-a134-ed2a69eb84ae tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041016 Mar 08 14:59:57.001399 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 673/1356] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:56 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:59:57.163270 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-93321064-ca9f-4078-9d58-c513a3315a14 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:57.163883 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-93321064-ca9f-4078-9d58-c513a3315a14 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:57.171152 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-93321064-ca9f-4078-9d58-c513a3315a14 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:57.171605 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-93321064-ca9f-4078-9d58-c513a3315a14 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:57.172401 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-93321064-ca9f-4078-9d58-c513a3315a14 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:57.172841 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-93321064-ca9f-4078-9d58-c513a3315a14 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:57.309124 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-93321064-ca9f-4078-9d58-c513a3315a14 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:57.316966 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-93321064-ca9f-4078-9d58-c513a3315a14 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.157537 Mar 08 14:59:57.317730 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 684/1357] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:57 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:57.597460 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-10e7813b-c509-4933-9baf-71b06b621c8f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:57.598106 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-10e7813b-c509-4933-9baf-71b06b621c8f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:57.603932 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-10e7813b-c509-4933-9baf-71b06b621c8f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:57.604558 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-10e7813b-c509-4933-9baf-71b06b621c8f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:57.605323 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-10e7813b-c509-4933-9baf-71b06b621c8f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:57.605754 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-10e7813b-c509-4933-9baf-71b06b621c8f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:57.657356 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-99c7e987-b7a6-4563-b70b-376dfcf81207 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:57.658405 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-99c7e987-b7a6-4563-b70b-376dfcf81207 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:57.664475 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-99c7e987-b7a6-4563-b70b-376dfcf81207 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:57.664989 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-99c7e987-b7a6-4563-b70b-376dfcf81207 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:57.665448 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-10e7813b-c509-4933-9baf-71b06b621c8f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:57.665764 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-99c7e987-b7a6-4563-b70b-376dfcf81207 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:57.666228 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-99c7e987-b7a6-4563-b70b-376dfcf81207 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:57.672901 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-10e7813b-c509-4933-9baf-71b06b621c8f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079254 Mar 08 14:59:57.673459 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 674/1358] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:57 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:57.694637 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-99c7e987-b7a6-4563-b70b-376dfcf81207 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041277 Mar 08 14:59:57.695173 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 685/1359] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:57 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:59:58.012353 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-ef711427-01d9-477c-bae4-104a1382dc0d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:58.013253 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-ef711427-01d9-477c-bae4-104a1382dc0d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:58.019483 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ef711427-01d9-477c-bae4-104a1382dc0d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:58.019933 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ef711427-01d9-477c-bae4-104a1382dc0d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:58.020691 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ef711427-01d9-477c-bae4-104a1382dc0d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:58.021126 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ef711427-01d9-477c-bae4-104a1382dc0d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:58.048387 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-ef711427-01d9-477c-bae4-104a1382dc0d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040665 Mar 08 14:59:58.048949 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 675/1360] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:58 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:59:58.333937 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ec2c71e4-f6e1-428a-97e1-af7c1cdf4320 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:58.334551 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ec2c71e4-f6e1-428a-97e1-af7c1cdf4320 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:58.341238 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ec2c71e4-f6e1-428a-97e1-af7c1cdf4320 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:58.341689 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ec2c71e4-f6e1-428a-97e1-af7c1cdf4320 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:58.342495 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ec2c71e4-f6e1-428a-97e1-af7c1cdf4320 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:58.342931 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ec2c71e4-f6e1-428a-97e1-af7c1cdf4320 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:58.474667 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ec2c71e4-f6e1-428a-97e1-af7c1cdf4320 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:58.482687 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ec2c71e4-f6e1-428a-97e1-af7c1cdf4320 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.152593 Mar 08 14:59:58.483283 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 686/1361] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:58 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:58.689265 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-4cf0c47b-8c1c-4c64-b0a4-faeceef168cb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:58.689800 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-4cf0c47b-8c1c-4c64-b0a4-faeceef168cb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:58.695563 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4cf0c47b-8c1c-4c64-b0a4-faeceef168cb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:58.696020 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4cf0c47b-8c1c-4c64-b0a4-faeceef168cb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:58.696789 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4cf0c47b-8c1c-4c64-b0a4-faeceef168cb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:58.697227 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4cf0c47b-8c1c-4c64-b0a4-faeceef168cb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:58.706755 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-a0e69eb8-fac4-4d17-876b-9464a2c83978 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:58.707656 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-a0e69eb8-fac4-4d17-876b-9464a2c83978 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:58.713368 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a0e69eb8-fac4-4d17-876b-9464a2c83978 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:58.714511 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a0e69eb8-fac4-4d17-876b-9464a2c83978 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:58.715885 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a0e69eb8-fac4-4d17-876b-9464a2c83978 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:58.716332 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a0e69eb8-fac4-4d17-876b-9464a2c83978 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:58.747362 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-a0e69eb8-fac4-4d17-876b-9464a2c83978 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044515 Mar 08 14:59:58.747936 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 687/1362] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:58 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 14:59:58.760179 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-4cf0c47b-8c1c-4c64-b0a4-faeceef168cb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:58.768156 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-4cf0c47b-8c1c-4c64-b0a4-faeceef168cb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.082897 Mar 08 14:59:58.768742 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 676/1363] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:58 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:59.060715 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c0ee31cf-b8d3-40aa-8dbb-8bc8363941e6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:59.061656 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-c0ee31cf-b8d3-40aa-8dbb-8bc8363941e6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:59.067898 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c0ee31cf-b8d3-40aa-8dbb-8bc8363941e6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:59.068346 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c0ee31cf-b8d3-40aa-8dbb-8bc8363941e6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:59.069105 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c0ee31cf-b8d3-40aa-8dbb-8bc8363941e6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:59.069539 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c0ee31cf-b8d3-40aa-8dbb-8bc8363941e6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:59.097294 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-c0ee31cf-b8d3-40aa-8dbb-8bc8363941e6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040598 Mar 08 14:59:59.097836 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 688/1364] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 14:59:59 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:59:59.500199 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-7d1ba311-2447-4b57-8797-d7d45905b0d7 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:59.500840 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-7d1ba311-2447-4b57-8797-d7d45905b0d7 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:59.507194 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7d1ba311-2447-4b57-8797-d7d45905b0d7 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:59.507650 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7d1ba311-2447-4b57-8797-d7d45905b0d7 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:59.508431 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7d1ba311-2447-4b57-8797-d7d45905b0d7 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:59.508874 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7d1ba311-2447-4b57-8797-d7d45905b0d7 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:59.641454 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-7d1ba311-2447-4b57-8797-d7d45905b0d7 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:59.648618 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-7d1ba311-2447-4b57-8797-d7d45905b0d7 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.152507 Mar 08 14:59:59.649180 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 677/1365] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:59 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:59:59.760900 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ffcc392f-5767-4e88-8900-ae4912172ebe tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:59.761732 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ffcc392f-5767-4e88-8900-ae4912172ebe tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:59.767925 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ffcc392f-5767-4e88-8900-ae4912172ebe tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:59.768375 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ffcc392f-5767-4e88-8900-ae4912172ebe tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:59.769131 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ffcc392f-5767-4e88-8900-ae4912172ebe tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:59.769561 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ffcc392f-5767-4e88-8900-ae4912172ebe tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:59.785700 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-339272dc-a974-4b79-8785-4fd9c2c68485 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:59:59.786342 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-339272dc-a974-4b79-8785-4fd9c2c68485 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:59:59.792646 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-339272dc-a974-4b79-8785-4fd9c2c68485 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:59.793102 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-339272dc-a974-4b79-8785-4fd9c2c68485 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:59.793892 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-339272dc-a974-4b79-8785-4fd9c2c68485 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:59:59.794340 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-339272dc-a974-4b79-8785-4fd9c2c68485 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:59:59.797766 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ffcc392f-5767-4e88-8900-ae4912172ebe tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041022 Mar 08 14:59:59.798359 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 689/1366] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 14:59:59 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 14:59:59.858241 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-339272dc-a974-4b79-8785-4fd9c2c68485 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:59:59.865593 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-339272dc-a974-4b79-8785-4fd9c2c68485 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.083720 Mar 08 14:59:59.866178 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 678/1367] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 14:59:59 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:00:00.109569 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-1d2062e9-fccd-42cd-9a28-6e28c71985f8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:00.110439 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-1d2062e9-fccd-42cd-9a28-6e28c71985f8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:00.116262 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1d2062e9-fccd-42cd-9a28-6e28c71985f8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:00.116718 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1d2062e9-fccd-42cd-9a28-6e28c71985f8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:00.117482 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1d2062e9-fccd-42cd-9a28-6e28c71985f8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:00.117945 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1d2062e9-fccd-42cd-9a28-6e28c71985f8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:00.145608 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-1d2062e9-fccd-42cd-9a28-6e28c71985f8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040856 Mar 08 15:00:00.146182 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 690/1368] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:00 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:00:00.665168 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-f61716b7-ca35-47e8-8949-01f5b8effeeb tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:00.665777 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-f61716b7-ca35-47e8-8949-01f5b8effeeb tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:00.672289 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f61716b7-ca35-47e8-8949-01f5b8effeeb tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:00.672743 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f61716b7-ca35-47e8-8949-01f5b8effeeb tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:00.673503 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f61716b7-ca35-47e8-8949-01f5b8effeeb tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:00.673969 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f61716b7-ca35-47e8-8949-01f5b8effeeb tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:00.808188 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-f61716b7-ca35-47e8-8949-01f5b8effeeb tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:00.809940 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ab316166-74ff-4208-abc3-ab0a55e161c6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:00.810859 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ab316166-74ff-4208-abc3-ab0a55e161c6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:00.815688 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-f61716b7-ca35-47e8-8949-01f5b8effeeb tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.154360 Mar 08 15:00:00.816252 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 679/1369] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:00 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:00.817001 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ab316166-74ff-4208-abc3-ab0a55e161c6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:00.817460 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ab316166-74ff-4208-abc3-ab0a55e161c6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:00.818273 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ab316166-74ff-4208-abc3-ab0a55e161c6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:00.818712 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ab316166-74ff-4208-abc3-ab0a55e161c6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:00.846915 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ab316166-74ff-4208-abc3-ab0a55e161c6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041525 Mar 08 15:00:00.847462 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 691/1370] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:00 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 15:00:00.883512 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-5df6fc84-9688-4fd7-a9fb-7678031dd884 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:00.884161 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-5df6fc84-9688-4fd7-a9fb-7678031dd884 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:00.891470 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5df6fc84-9688-4fd7-a9fb-7678031dd884 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:00.891933 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5df6fc84-9688-4fd7-a9fb-7678031dd884 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:00.892773 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5df6fc84-9688-4fd7-a9fb-7678031dd884 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:00.893242 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5df6fc84-9688-4fd7-a9fb-7678031dd884 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:00.954117 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-5df6fc84-9688-4fd7-a9fb-7678031dd884 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:00.961836 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-5df6fc84-9688-4fd7-a9fb-7678031dd884 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.082197 Mar 08 15:00:00.962425 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 680/1371] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:00 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:01.157193 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-2ed8fb37-3e21-494d-9cf3-ef5ccec7beb4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:01.158138 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-2ed8fb37-3e21-494d-9cf3-ef5ccec7beb4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:01.164005 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2ed8fb37-3e21-494d-9cf3-ef5ccec7beb4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:01.164456 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2ed8fb37-3e21-494d-9cf3-ef5ccec7beb4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:01.165223 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2ed8fb37-3e21-494d-9cf3-ef5ccec7beb4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:01.165661 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2ed8fb37-3e21-494d-9cf3-ef5ccec7beb4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:01.194229 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-2ed8fb37-3e21-494d-9cf3-ef5ccec7beb4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040934 Mar 08 15:00:01.194702 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 692/1372] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:01 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:00:01.833771 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-be1451c6-4182-40b6-9b9e-abc371510d54 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:01.834348 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-be1451c6-4182-40b6-9b9e-abc371510d54 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:01.841547 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-be1451c6-4182-40b6-9b9e-abc371510d54 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:01.842028 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-be1451c6-4182-40b6-9b9e-abc371510d54 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:01.842800 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-be1451c6-4182-40b6-9b9e-abc371510d54 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:01.843236 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-be1451c6-4182-40b6-9b9e-abc371510d54 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:01.859940 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-bfdbcba8-1c0d-4b88-8301-c633f246805e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:01.860860 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-bfdbcba8-1c0d-4b88-8301-c633f246805e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:01.867042 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bfdbcba8-1c0d-4b88-8301-c633f246805e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:01.867491 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bfdbcba8-1c0d-4b88-8301-c633f246805e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:01.868262 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bfdbcba8-1c0d-4b88-8301-c633f246805e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:01.868696 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bfdbcba8-1c0d-4b88-8301-c633f246805e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:01.897626 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-bfdbcba8-1c0d-4b88-8301-c633f246805e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043003 Mar 08 15:00:01.898419 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 693/1373] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:01 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 15:00:01.979254 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-9ab6b8e1-0b10-42c7-8cf3-6b001803ad1d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:01.979853 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-9ab6b8e1-0b10-42c7-8cf3-6b001803ad1d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:01.985651 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9ab6b8e1-0b10-42c7-8cf3-6b001803ad1d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:01.985918 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-be1451c6-4182-40b6-9b9e-abc371510d54 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:01.986135 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9ab6b8e1-0b10-42c7-8cf3-6b001803ad1d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:01.986902 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9ab6b8e1-0b10-42c7-8cf3-6b001803ad1d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:01.987338 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9ab6b8e1-0b10-42c7-8cf3-6b001803ad1d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:01.993179 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-be1451c6-4182-40b6-9b9e-abc371510d54 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.163292 Mar 08 15:00:01.993734 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 681/1374] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:01 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:02.050260 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-9ab6b8e1-0b10-42c7-8cf3-6b001803ad1d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:02.058682 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-9ab6b8e1-0b10-42c7-8cf3-6b001803ad1d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.083346 Mar 08 15:00:02.059311 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 694/1375] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:01 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:00:02.205681 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-492489db-6387-4cd5-94db-ab1d186fd619 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:02.206576 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-492489db-6387-4cd5-94db-ab1d186fd619 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:02.212443 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-492489db-6387-4cd5-94db-ab1d186fd619 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:02.212907 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-492489db-6387-4cd5-94db-ab1d186fd619 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:02.213708 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-492489db-6387-4cd5-94db-ab1d186fd619 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:02.214274 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-492489db-6387-4cd5-94db-ab1d186fd619 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:02.241819 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-492489db-6387-4cd5-94db-ab1d186fd619 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040239 Mar 08 15:00:02.242393 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 682/1376] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:02 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:00:02.910027 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-505423cf-d527-44b7-9ccb-6e1386ba6ba2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:02.910964 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-505423cf-d527-44b7-9ccb-6e1386ba6ba2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:02.917507 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-505423cf-d527-44b7-9ccb-6e1386ba6ba2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:02.917984 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-505423cf-d527-44b7-9ccb-6e1386ba6ba2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:02.918760 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-505423cf-d527-44b7-9ccb-6e1386ba6ba2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:02.919206 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-505423cf-d527-44b7-9ccb-6e1386ba6ba2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:02.947749 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-505423cf-d527-44b7-9ccb-6e1386ba6ba2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041743 Mar 08 15:00:02.948814 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 695/1377] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:02 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:00:03.010079 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-62143c14-e4e7-4f1e-999d-9cf7759e8777 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:03.011193 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-62143c14-e4e7-4f1e-999d-9cf7759e8777 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:03.017479 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-62143c14-e4e7-4f1e-999d-9cf7759e8777 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:03.017963 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-62143c14-e4e7-4f1e-999d-9cf7759e8777 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:03.018727 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-62143c14-e4e7-4f1e-999d-9cf7759e8777 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:03.019167 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-62143c14-e4e7-4f1e-999d-9cf7759e8777 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:03.076383 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-9cf73eb1-9831-4760-b37b-03ef8b324ea5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:03.077119 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-9cf73eb1-9831-4760-b37b-03ef8b324ea5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:03.083261 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9cf73eb1-9831-4760-b37b-03ef8b324ea5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:03.083837 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9cf73eb1-9831-4760-b37b-03ef8b324ea5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:03.084691 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9cf73eb1-9831-4760-b37b-03ef8b324ea5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:03.085139 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9cf73eb1-9831-4760-b37b-03ef8b324ea5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:03.145441 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-9cf73eb1-9831-4760-b37b-03ef8b324ea5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:03.153330 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-9cf73eb1-9831-4760-b37b-03ef8b324ea5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081505 Mar 08 15:00:03.153970 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 696/1378] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:03 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:00:03.155127 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-62143c14-e4e7-4f1e-999d-9cf7759e8777 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:03.162621 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-62143c14-e4e7-4f1e-999d-9cf7759e8777 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.156357 Mar 08 15:00:03.163146 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 683/1379] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:03 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:03.254337 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d50380a6-2a2c-4250-9e33-c64726b922c6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:03.255296 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d50380a6-2a2c-4250-9e33-c64726b922c6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:03.262662 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d50380a6-2a2c-4250-9e33-c64726b922c6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:03.263222 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d50380a6-2a2c-4250-9e33-c64726b922c6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:03.264021 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d50380a6-2a2c-4250-9e33-c64726b922c6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:03.264493 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d50380a6-2a2c-4250-9e33-c64726b922c6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:03.294165 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d50380a6-2a2c-4250-9e33-c64726b922c6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043861 Mar 08 15:00:03.294737 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 697/1380] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:03 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:00:03.960439 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-42b45a42-24d4-4848-9180-72f491e275c1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:03.961361 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-42b45a42-24d4-4848-9180-72f491e275c1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:03.967947 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-42b45a42-24d4-4848-9180-72f491e275c1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:03.968407 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-42b45a42-24d4-4848-9180-72f491e275c1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:03.969181 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-42b45a42-24d4-4848-9180-72f491e275c1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:03.969628 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-42b45a42-24d4-4848-9180-72f491e275c1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:03.997479 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-42b45a42-24d4-4848-9180-72f491e275c1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041087 Mar 08 15:00:03.998057 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 684/1381] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:03 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:00:04.170329 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f63d240e-e3a8-4d8c-ad19-c5006fe2283b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:04.170940 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f63d240e-e3a8-4d8c-ad19-c5006fe2283b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:04.177579 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f63d240e-e3a8-4d8c-ad19-c5006fe2283b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:04.178061 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f63d240e-e3a8-4d8c-ad19-c5006fe2283b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:04.178824 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f63d240e-e3a8-4d8c-ad19-c5006fe2283b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:04.179259 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f63d240e-e3a8-4d8c-ad19-c5006fe2283b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:04.179963 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-e6d410b7-c7eb-4243-9817-b1c8e93e0637 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:04.180576 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-e6d410b7-c7eb-4243-9817-b1c8e93e0637 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:04.186866 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e6d410b7-c7eb-4243-9817-b1c8e93e0637 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:04.187326 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e6d410b7-c7eb-4243-9817-b1c8e93e0637 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:04.188101 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e6d410b7-c7eb-4243-9817-b1c8e93e0637 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:04.188550 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e6d410b7-c7eb-4243-9817-b1c8e93e0637 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:04.242724 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f63d240e-e3a8-4d8c-ad19-c5006fe2283b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:04.250200 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f63d240e-e3a8-4d8c-ad19-c5006fe2283b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.084571 Mar 08 15:00:04.250786 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 698/1382] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:04 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:04.306181 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-027c1f7b-5b82-4a7f-834a-6215313c7c5c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:04.307214 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-027c1f7b-5b82-4a7f-834a-6215313c7c5c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:04.313224 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-027c1f7b-5b82-4a7f-834a-6215313c7c5c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:04.313673 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-027c1f7b-5b82-4a7f-834a-6215313c7c5c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:04.314481 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-027c1f7b-5b82-4a7f-834a-6215313c7c5c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:04.314961 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-027c1f7b-5b82-4a7f-834a-6215313c7c5c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:04.329419 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-e6d410b7-c7eb-4243-9817-b1c8e93e0637 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:04.336774 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-e6d410b7-c7eb-4243-9817-b1c8e93e0637 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.160854 Mar 08 15:00:04.337365 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 685/1383] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:04 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:00:04.343902 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-027c1f7b-5b82-4a7f-834a-6215313c7c5c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041904 Mar 08 15:00:04.344457 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 699/1384] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:04 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:00:05.008648 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-c0dbc6a9-36af-4934-8939-58b416202893 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:05.009559 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-c0dbc6a9-36af-4934-8939-58b416202893 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:05.016091 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c0dbc6a9-36af-4934-8939-58b416202893 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:05.016548 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c0dbc6a9-36af-4934-8939-58b416202893 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:05.017315 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c0dbc6a9-36af-4934-8939-58b416202893 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:05.017759 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c0dbc6a9-36af-4934-8939-58b416202893 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:05.045340 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-c0dbc6a9-36af-4934-8939-58b416202893 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040702 Mar 08 15:00:05.045903 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 686/1385] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:05 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:00:05.267631 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-9661fe52-7758-4795-a19e-ed78c3acd139 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:05.268252 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-9661fe52-7758-4795-a19e-ed78c3acd139 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:05.274622 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9661fe52-7758-4795-a19e-ed78c3acd139 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:05.275075 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9661fe52-7758-4795-a19e-ed78c3acd139 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:05.275847 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9661fe52-7758-4795-a19e-ed78c3acd139 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:05.276973 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9661fe52-7758-4795-a19e-ed78c3acd139 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:05.337138 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-9661fe52-7758-4795-a19e-ed78c3acd139 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:05.344996 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-9661fe52-7758-4795-a19e-ed78c3acd139 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081271 Mar 08 15:00:05.345554 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 700/1386] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:05 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:05.355430 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-3032cfb0-59f5-4e0a-b96f-80af1f7d5648 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:05.355948 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ad9d994e-1602-4e07-b547-bdab770e22c2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:05.356062 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-3032cfb0-59f5-4e0a-b96f-80af1f7d5648 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:05.356594 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ad9d994e-1602-4e07-b547-bdab770e22c2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:05.362432 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3032cfb0-59f5-4e0a-b96f-80af1f7d5648 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:05.362887 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3032cfb0-59f5-4e0a-b96f-80af1f7d5648 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:05.363686 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3032cfb0-59f5-4e0a-b96f-80af1f7d5648 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:05.363790 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ad9d994e-1602-4e07-b547-bdab770e22c2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:05.364112 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3032cfb0-59f5-4e0a-b96f-80af1f7d5648 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:05.364224 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ad9d994e-1602-4e07-b547-bdab770e22c2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:05.365031 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ad9d994e-1602-4e07-b547-bdab770e22c2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:05.365464 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ad9d994e-1602-4e07-b547-bdab770e22c2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:05.392996 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ad9d994e-1602-4e07-b547-bdab770e22c2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041603 Mar 08 15:00:05.393553 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 701/1387] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:05 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 15:00:05.497566 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-3032cfb0-59f5-4e0a-b96f-80af1f7d5648 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:05.504867 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-3032cfb0-59f5-4e0a-b96f-80af1f7d5648 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.154494 Mar 08 15:00:05.505428 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 687/1388] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:05 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:06.057776 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-2945fe06-b308-4d29-8bb4-5de6cdc7ff83 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:06.058713 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-2945fe06-b308-4d29-8bb4-5de6cdc7ff83 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:06.064571 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2945fe06-b308-4d29-8bb4-5de6cdc7ff83 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:06.065021 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2945fe06-b308-4d29-8bb4-5de6cdc7ff83 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:06.065785 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2945fe06-b308-4d29-8bb4-5de6cdc7ff83 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:06.066243 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2945fe06-b308-4d29-8bb4-5de6cdc7ff83 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:06.097125 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-2945fe06-b308-4d29-8bb4-5de6cdc7ff83 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043785 Mar 08 15:00:06.097676 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 702/1389] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:06 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:00:06.362216 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-952a6c11-63e1-442d-aede-b95515ad96c5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:06.362829 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-952a6c11-63e1-442d-aede-b95515ad96c5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:06.369060 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-952a6c11-63e1-442d-aede-b95515ad96c5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:06.369517 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-952a6c11-63e1-442d-aede-b95515ad96c5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:06.370941 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-952a6c11-63e1-442d-aede-b95515ad96c5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:06.371406 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-952a6c11-63e1-442d-aede-b95515ad96c5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:06.404655 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-dc9adcff-4d9e-490e-9a25-5319de026aed tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:06.405687 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-dc9adcff-4d9e-490e-9a25-5319de026aed tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:06.411612 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dc9adcff-4d9e-490e-9a25-5319de026aed tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:06.412061 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dc9adcff-4d9e-490e-9a25-5319de026aed tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:06.412835 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dc9adcff-4d9e-490e-9a25-5319de026aed tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:06.413266 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dc9adcff-4d9e-490e-9a25-5319de026aed tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:06.430558 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-952a6c11-63e1-442d-aede-b95515ad96c5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:06.439027 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-952a6c11-63e1-442d-aede-b95515ad96c5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080638 Mar 08 15:00:06.439798 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 688/1390] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:06 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:06.441929 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-dc9adcff-4d9e-490e-9a25-5319de026aed tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041366 Mar 08 15:00:06.442472 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 703/1391] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:06 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 15:00:06.521066 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-c721783b-0c96-4bfc-9a66-7fef7468ca4c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:06.521683 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-c721783b-0c96-4bfc-9a66-7fef7468ca4c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:06.527655 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c721783b-0c96-4bfc-9a66-7fef7468ca4c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:06.528111 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c721783b-0c96-4bfc-9a66-7fef7468ca4c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:06.528885 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c721783b-0c96-4bfc-9a66-7fef7468ca4c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:06.529427 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c721783b-0c96-4bfc-9a66-7fef7468ca4c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:06.664287 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-c721783b-0c96-4bfc-9a66-7fef7468ca4c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:06.672276 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-c721783b-0c96-4bfc-9a66-7fef7468ca4c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.155022 Mar 08 15:00:06.672842 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 689/1392] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:06 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:00:07.109728 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-53eb2bac-b100-40ed-91fa-6551c1fce38a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:07.110701 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-53eb2bac-b100-40ed-91fa-6551c1fce38a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:07.116654 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-53eb2bac-b100-40ed-91fa-6551c1fce38a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:07.117115 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-53eb2bac-b100-40ed-91fa-6551c1fce38a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:07.117920 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-53eb2bac-b100-40ed-91fa-6551c1fce38a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:07.118368 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-53eb2bac-b100-40ed-91fa-6551c1fce38a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:07.146269 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-53eb2bac-b100-40ed-91fa-6551c1fce38a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040664 Mar 08 15:00:07.146827 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 704/1393] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:07 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:00:07.452974 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-97433070-e852-4d3b-8d44-4862944153c7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:07.453929 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-97433070-e852-4d3b-8d44-4862944153c7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:07.455428 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-e6cd33c6-3fe3-4fc9-9da6-c345d923679a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:07.456052 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-e6cd33c6-3fe3-4fc9-9da6-c345d923679a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:07.460900 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-97433070-e852-4d3b-8d44-4862944153c7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:07.461364 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-97433070-e852-4d3b-8d44-4862944153c7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:07.462160 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-97433070-e852-4d3b-8d44-4862944153c7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:07.462597 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e6cd33c6-3fe3-4fc9-9da6-c345d923679a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:07.462705 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-97433070-e852-4d3b-8d44-4862944153c7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:07.463056 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e6cd33c6-3fe3-4fc9-9da6-c345d923679a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:07.464134 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e6cd33c6-3fe3-4fc9-9da6-c345d923679a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:07.464525 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e6cd33c6-3fe3-4fc9-9da6-c345d923679a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:07.494472 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-97433070-e852-4d3b-8d44-4862944153c7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045594 Mar 08 15:00:07.495700 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 690/1394] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:07 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:00:07.542355 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-e6cd33c6-3fe3-4fc9-9da6-c345d923679a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:07.549685 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-e6cd33c6-3fe3-4fc9-9da6-c345d923679a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.098220 Mar 08 15:00:07.550284 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 705/1395] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:07 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:00:07.690257 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-123163f7-e912-4558-87f8-6e60dbef2edc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:07.690865 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-123163f7-e912-4558-87f8-6e60dbef2edc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:07.697316 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-123163f7-e912-4558-87f8-6e60dbef2edc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:07.697792 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-123163f7-e912-4558-87f8-6e60dbef2edc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:07.699118 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-123163f7-e912-4558-87f8-6e60dbef2edc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:07.699563 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-123163f7-e912-4558-87f8-6e60dbef2edc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:07.864757 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-123163f7-e912-4558-87f8-6e60dbef2edc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:07.872581 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-123163f7-e912-4558-87f8-6e60dbef2edc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.186760 Mar 08 15:00:07.873151 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 691/1396] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:07 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:08.158587 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c17c278a-7ad1-4db1-bc27-43c19ffaebdc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:08.159446 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-c17c278a-7ad1-4db1-bc27-43c19ffaebdc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:08.165227 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c17c278a-7ad1-4db1-bc27-43c19ffaebdc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:08.165697 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c17c278a-7ad1-4db1-bc27-43c19ffaebdc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:08.166718 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c17c278a-7ad1-4db1-bc27-43c19ffaebdc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:08.167141 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c17c278a-7ad1-4db1-bc27-43c19ffaebdc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:08.194383 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-c17c278a-7ad1-4db1-bc27-43c19ffaebdc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039920 Mar 08 15:00:08.195165 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 706/1397] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:08 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:00:08.509325 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-bed05937-800e-4bda-acce-686748ee62ea tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:08.510936 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-bed05937-800e-4bda-acce-686748ee62ea tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:08.517336 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bed05937-800e-4bda-acce-686748ee62ea tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:08.517800 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bed05937-800e-4bda-acce-686748ee62ea tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:08.522865 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bed05937-800e-4bda-acce-686748ee62ea tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:08.523326 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bed05937-800e-4bda-acce-686748ee62ea tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:08.551668 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-bed05937-800e-4bda-acce-686748ee62ea tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046288 Mar 08 15:00:08.552495 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 692/1398] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:08 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:00:08.568137 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-4fea9b1f-f9e4-48c4-be7a-ef8259eb93cc tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:08.568775 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-4fea9b1f-f9e4-48c4-be7a-ef8259eb93cc tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:08.575647 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4fea9b1f-f9e4-48c4-be7a-ef8259eb93cc tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:08.576098 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4fea9b1f-f9e4-48c4-be7a-ef8259eb93cc tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:08.576861 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4fea9b1f-f9e4-48c4-be7a-ef8259eb93cc tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:08.577294 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4fea9b1f-f9e4-48c4-be7a-ef8259eb93cc tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:08.637162 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-4fea9b1f-f9e4-48c4-be7a-ef8259eb93cc tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:08.644740 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-4fea9b1f-f9e4-48c4-be7a-ef8259eb93cc tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080352 Mar 08 15:00:08.645301 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 707/1399] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:08 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:08.889596 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-658c5603-7229-46c2-89bf-214ef3a531e6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:08.890144 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-658c5603-7229-46c2-89bf-214ef3a531e6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:08.895992 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-658c5603-7229-46c2-89bf-214ef3a531e6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:08.896442 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-658c5603-7229-46c2-89bf-214ef3a531e6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:08.897201 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-658c5603-7229-46c2-89bf-214ef3a531e6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:08.897639 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-658c5603-7229-46c2-89bf-214ef3a531e6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:09.034048 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-658c5603-7229-46c2-89bf-214ef3a531e6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:09.042074 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-658c5603-7229-46c2-89bf-214ef3a531e6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.156069 Mar 08 15:00:09.042532 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 693/1400] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:08 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:09.206127 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f62dbf22-8976-48a1-a7c4-05b270b3f70a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:09.206989 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f62dbf22-8976-48a1-a7c4-05b270b3f70a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:09.212786 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f62dbf22-8976-48a1-a7c4-05b270b3f70a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:09.214068 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f62dbf22-8976-48a1-a7c4-05b270b3f70a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:09.215554 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f62dbf22-8976-48a1-a7c4-05b270b3f70a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:09.215554 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f62dbf22-8976-48a1-a7c4-05b270b3f70a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:09.242643 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f62dbf22-8976-48a1-a7c4-05b270b3f70a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040610 Mar 08 15:00:09.243188 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 708/1401] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:09 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:00:09.563527 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-c7b0a9d1-bb25-4e76-b365-ccccd968eb76 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:09.564437 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-c7b0a9d1-bb25-4e76-b365-ccccd968eb76 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:09.570706 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c7b0a9d1-bb25-4e76-b365-ccccd968eb76 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:09.571163 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c7b0a9d1-bb25-4e76-b365-ccccd968eb76 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:09.571935 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c7b0a9d1-bb25-4e76-b365-ccccd968eb76 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:09.572374 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c7b0a9d1-bb25-4e76-b365-ccccd968eb76 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:09.600786 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-c7b0a9d1-bb25-4e76-b365-ccccd968eb76 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041323 Mar 08 15:00:09.601354 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 694/1402] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:09 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:00:09.661902 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-6cecddcd-33ba-42b3-ab59-1618bbbf4901 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:09.662518 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-6cecddcd-33ba-42b3-ab59-1618bbbf4901 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:09.668782 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6cecddcd-33ba-42b3-ab59-1618bbbf4901 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:09.669231 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6cecddcd-33ba-42b3-ab59-1618bbbf4901 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:09.670022 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6cecddcd-33ba-42b3-ab59-1618bbbf4901 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:09.670461 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6cecddcd-33ba-42b3-ab59-1618bbbf4901 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:09.732609 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-6cecddcd-33ba-42b3-ab59-1618bbbf4901 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:09.739924 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-6cecddcd-33ba-42b3-ab59-1618bbbf4901 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081928 Mar 08 15:00:09.740486 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 709/1403] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:09 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:10.059569 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-9728ea2c-d315-4fea-b8cd-41a99bc1a1d1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:10.060303 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-9728ea2c-d315-4fea-b8cd-41a99bc1a1d1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:10.066135 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9728ea2c-d315-4fea-b8cd-41a99bc1a1d1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:10.066678 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9728ea2c-d315-4fea-b8cd-41a99bc1a1d1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:10.067462 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9728ea2c-d315-4fea-b8cd-41a99bc1a1d1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:10.067909 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9728ea2c-d315-4fea-b8cd-41a99bc1a1d1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:10.254284 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b053ca3f-fc21-4d46-a514-3b5db492bafd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:10.255193 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b053ca3f-fc21-4d46-a514-3b5db492bafd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:10.261402 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b053ca3f-fc21-4d46-a514-3b5db492bafd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:10.261874 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b053ca3f-fc21-4d46-a514-3b5db492bafd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:10.262653 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b053ca3f-fc21-4d46-a514-3b5db492bafd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:10.263088 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b053ca3f-fc21-4d46-a514-3b5db492bafd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:10.291157 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b053ca3f-fc21-4d46-a514-3b5db492bafd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041034 Mar 08 15:00:10.292243 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 710/1404] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:10 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 15:00:10.295623 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-9728ea2c-d315-4fea-b8cd-41a99bc1a1d1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:10.303289 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-9728ea2c-d315-4fea-b8cd-41a99bc1a1d1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.248313 Mar 08 15:00:10.303854 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 695/1405] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:10 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:10.612682 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-9e2487c1-21cc-43ea-985f-92c7b2b5eb20 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:10.613634 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-9e2487c1-21cc-43ea-985f-92c7b2b5eb20 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:10.620984 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9e2487c1-21cc-43ea-985f-92c7b2b5eb20 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:10.621459 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9e2487c1-21cc-43ea-985f-92c7b2b5eb20 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:10.622276 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9e2487c1-21cc-43ea-985f-92c7b2b5eb20 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:10.622733 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9e2487c1-21cc-43ea-985f-92c7b2b5eb20 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:10.652865 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-9e2487c1-21cc-43ea-985f-92c7b2b5eb20 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044359 Mar 08 15:00:10.653423 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 711/1406] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:10 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:00:10.757277 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-2e6b4c8e-4738-4c5d-bf39-4885bd6792e2 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:10.757904 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-2e6b4c8e-4738-4c5d-bf39-4885bd6792e2 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:10.764210 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2e6b4c8e-4738-4c5d-bf39-4885bd6792e2 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:10.764664 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2e6b4c8e-4738-4c5d-bf39-4885bd6792e2 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:10.765432 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2e6b4c8e-4738-4c5d-bf39-4885bd6792e2 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:10.765885 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2e6b4c8e-4738-4c5d-bf39-4885bd6792e2 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:10.824591 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-2e6b4c8e-4738-4c5d-bf39-4885bd6792e2 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:10.831963 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-2e6b4c8e-4738-4c5d-bf39-4885bd6792e2 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078499 Mar 08 15:00:10.832521 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 696/1407] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:10 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:11.304185 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ea52954c-7c98-4797-aa40-9b30fc8fe4ae tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:11.305107 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ea52954c-7c98-4797-aa40-9b30fc8fe4ae tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:11.311855 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ea52954c-7c98-4797-aa40-9b30fc8fe4ae tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:11.312328 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ea52954c-7c98-4797-aa40-9b30fc8fe4ae tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:11.313091 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ea52954c-7c98-4797-aa40-9b30fc8fe4ae tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:11.313521 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ea52954c-7c98-4797-aa40-9b30fc8fe4ae tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:11.320389 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-d1956517-a1f1-4536-a7c9-5b780c402d13 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:11.321089 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-d1956517-a1f1-4536-a7c9-5b780c402d13 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:11.327541 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d1956517-a1f1-4536-a7c9-5b780c402d13 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:11.327994 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d1956517-a1f1-4536-a7c9-5b780c402d13 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:11.328771 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d1956517-a1f1-4536-a7c9-5b780c402d13 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:11.329214 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d1956517-a1f1-4536-a7c9-5b780c402d13 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:11.341873 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ea52954c-7c98-4797-aa40-9b30fc8fe4ae tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041898 Mar 08 15:00:11.342435 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 712/1408] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:11 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:00:11.468306 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-d1956517-a1f1-4536-a7c9-5b780c402d13 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:11.475477 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-d1956517-a1f1-4536-a7c9-5b780c402d13 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.158930 Mar 08 15:00:11.476038 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 697/1409] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:11 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:00:11.664827 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-bdcb2b83-247d-4ffd-9827-91743212d72e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:11.665677 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-bdcb2b83-247d-4ffd-9827-91743212d72e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:11.672084 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bdcb2b83-247d-4ffd-9827-91743212d72e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:11.672529 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bdcb2b83-247d-4ffd-9827-91743212d72e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:11.673291 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bdcb2b83-247d-4ffd-9827-91743212d72e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:11.673725 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bdcb2b83-247d-4ffd-9827-91743212d72e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:11.701925 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-bdcb2b83-247d-4ffd-9827-91743212d72e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041075 Mar 08 15:00:11.702464 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 713/1410] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:11 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:00:11.849411 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-c92883e2-207f-4c5b-bd05-9dc8446933a7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:11.850091 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-c92883e2-207f-4c5b-bd05-9dc8446933a7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:11.857375 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c92883e2-207f-4c5b-bd05-9dc8446933a7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:11.857822 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c92883e2-207f-4c5b-bd05-9dc8446933a7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:11.858613 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c92883e2-207f-4c5b-bd05-9dc8446933a7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:11.859047 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c92883e2-207f-4c5b-bd05-9dc8446933a7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:11.917932 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-c92883e2-207f-4c5b-bd05-9dc8446933a7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:11.925025 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-c92883e2-207f-4c5b-bd05-9dc8446933a7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079427 Mar 08 15:00:11.925580 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 698/1411] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:11 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:12.353534 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ddb32da8-a57a-4068-b183-879f37494539 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:12.355083 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ddb32da8-a57a-4068-b183-879f37494539 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:12.361388 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ddb32da8-a57a-4068-b183-879f37494539 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:12.361841 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ddb32da8-a57a-4068-b183-879f37494539 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:12.362649 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ddb32da8-a57a-4068-b183-879f37494539 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:12.363088 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ddb32da8-a57a-4068-b183-879f37494539 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:12.390451 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ddb32da8-a57a-4068-b183-879f37494539 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040934 Mar 08 15:00:12.390993 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 714/1412] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:12 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 15:00:12.492393 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-846f2a68-dc74-43d3-9cf9-b01ce4cbcd8d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:12.493007 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-846f2a68-dc74-43d3-9cf9-b01ce4cbcd8d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:12.498952 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-846f2a68-dc74-43d3-9cf9-b01ce4cbcd8d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:12.499398 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-846f2a68-dc74-43d3-9cf9-b01ce4cbcd8d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:12.500156 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-846f2a68-dc74-43d3-9cf9-b01ce4cbcd8d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:12.500590 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-846f2a68-dc74-43d3-9cf9-b01ce4cbcd8d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:12.632101 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-846f2a68-dc74-43d3-9cf9-b01ce4cbcd8d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:12.640284 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-846f2a68-dc74-43d3-9cf9-b01ce4cbcd8d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.151810 Mar 08 15:00:12.640843 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 699/1413] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:12 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:12.713872 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d1264ce0-f1a3-481d-af1b-175a98418584 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:12.714792 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d1264ce0-f1a3-481d-af1b-175a98418584 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:12.720593 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d1264ce0-f1a3-481d-af1b-175a98418584 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:12.721050 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d1264ce0-f1a3-481d-af1b-175a98418584 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:12.721817 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d1264ce0-f1a3-481d-af1b-175a98418584 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:12.722281 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d1264ce0-f1a3-481d-af1b-175a98418584 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:12.749819 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d1264ce0-f1a3-481d-af1b-175a98418584 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040598 Mar 08 15:00:12.750393 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 715/1414] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:12 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:00:12.942716 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-934602a2-4493-4689-a6ff-2f01b805813d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:12.943334 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-934602a2-4493-4689-a6ff-2f01b805813d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:12.950449 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-934602a2-4493-4689-a6ff-2f01b805813d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:12.950906 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-934602a2-4493-4689-a6ff-2f01b805813d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:12.951697 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-934602a2-4493-4689-a6ff-2f01b805813d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:12.952141 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-934602a2-4493-4689-a6ff-2f01b805813d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:13.015394 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-934602a2-4493-4689-a6ff-2f01b805813d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:13.022874 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-934602a2-4493-4689-a6ff-2f01b805813d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.084078 Mar 08 15:00:13.023439 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 700/1415] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:12 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:13.402638 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-e531a11b-d145-4543-a015-4b7cdbd61d84 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:13.403543 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-e531a11b-d145-4543-a015-4b7cdbd61d84 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:13.409808 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e531a11b-d145-4543-a015-4b7cdbd61d84 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:13.410285 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e531a11b-d145-4543-a015-4b7cdbd61d84 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:13.411049 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e531a11b-d145-4543-a015-4b7cdbd61d84 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:13.411491 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e531a11b-d145-4543-a015-4b7cdbd61d84 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:13.440525 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-e531a11b-d145-4543-a015-4b7cdbd61d84 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041926 Mar 08 15:00:13.441083 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 716/1416] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:13 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:00:13.657757 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-75330bfa-0269-4f6d-9229-964f1c69c4ea tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:13.658333 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-75330bfa-0269-4f6d-9229-964f1c69c4ea tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:13.664151 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-75330bfa-0269-4f6d-9229-964f1c69c4ea tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:13.664605 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-75330bfa-0269-4f6d-9229-964f1c69c4ea tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:13.665374 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-75330bfa-0269-4f6d-9229-964f1c69c4ea tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:13.665811 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-75330bfa-0269-4f6d-9229-964f1c69c4ea tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:13.761177 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-66398090-d23b-48df-bf4f-aa9f2751e7f3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:13.762167 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-66398090-d23b-48df-bf4f-aa9f2751e7f3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:13.767902 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-66398090-d23b-48df-bf4f-aa9f2751e7f3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:13.768363 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-66398090-d23b-48df-bf4f-aa9f2751e7f3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:13.769138 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-66398090-d23b-48df-bf4f-aa9f2751e7f3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:13.769573 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-66398090-d23b-48df-bf4f-aa9f2751e7f3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:13.799109 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-66398090-d23b-48df-bf4f-aa9f2751e7f3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042436 Mar 08 15:00:13.799551 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-75330bfa-0269-4f6d-9229-964f1c69c4ea tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:13.799681 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 717/1417] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:13 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 15:00:13.807757 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-75330bfa-0269-4f6d-9229-964f1c69c4ea tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.154050 Mar 08 15:00:13.808310 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 701/1418] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:13 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:14.039916 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-355df712-81b7-4019-a408-20441fe40b7e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:14.040530 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-355df712-81b7-4019-a408-20441fe40b7e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:14.046515 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-355df712-81b7-4019-a408-20441fe40b7e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:14.046973 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-355df712-81b7-4019-a408-20441fe40b7e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:14.047738 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-355df712-81b7-4019-a408-20441fe40b7e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:14.048178 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-355df712-81b7-4019-a408-20441fe40b7e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:14.108505 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-355df712-81b7-4019-a408-20441fe40b7e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:14.115786 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-355df712-81b7-4019-a408-20441fe40b7e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079727 Mar 08 15:00:14.116349 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 718/1419] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:14 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:14.453083 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-3efc33d5-e5ab-4a4c-ac07-427f2bc15586 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:14.454022 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-3efc33d5-e5ab-4a4c-ac07-427f2bc15586 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:14.459854 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3efc33d5-e5ab-4a4c-ac07-427f2bc15586 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:14.460307 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3efc33d5-e5ab-4a4c-ac07-427f2bc15586 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:14.461065 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3efc33d5-e5ab-4a4c-ac07-427f2bc15586 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:14.461499 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3efc33d5-e5ab-4a4c-ac07-427f2bc15586 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:14.488695 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-3efc33d5-e5ab-4a4c-ac07-427f2bc15586 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039624 Mar 08 15:00:14.489241 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 702/1420] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:14 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:00:14.811729 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-6d7986f7-5aa6-465d-bfd0-79cf908e85b0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:14.812682 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-6d7986f7-5aa6-465d-bfd0-79cf908e85b0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:14.819225 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6d7986f7-5aa6-465d-bfd0-79cf908e85b0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:14.819669 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6d7986f7-5aa6-465d-bfd0-79cf908e85b0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:14.820447 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6d7986f7-5aa6-465d-bfd0-79cf908e85b0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:14.820892 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6d7986f7-5aa6-465d-bfd0-79cf908e85b0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:14.824813 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-577eb275-3cec-4d0a-8940-e3a96ae9be67 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:14.825424 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-577eb275-3cec-4d0a-8940-e3a96ae9be67 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:14.831870 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-577eb275-3cec-4d0a-8940-e3a96ae9be67 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:14.832317 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-577eb275-3cec-4d0a-8940-e3a96ae9be67 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:14.833086 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-577eb275-3cec-4d0a-8940-e3a96ae9be67 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:14.833521 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-577eb275-3cec-4d0a-8940-e3a96ae9be67 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:14.849134 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-6d7986f7-5aa6-465d-bfd0-79cf908e85b0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042131 Mar 08 15:00:14.849706 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 719/1421] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:14 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:00:14.967171 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-577eb275-3cec-4d0a-8940-e3a96ae9be67 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:14.974499 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-577eb275-3cec-4d0a-8940-e3a96ae9be67 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.153961 Mar 08 15:00:14.975060 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 703/1422] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:14 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:15.133625 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-0ab3fa34-ace9-4861-aef4-9604548dc632 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:15.134184 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-0ab3fa34-ace9-4861-aef4-9604548dc632 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:15.140176 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0ab3fa34-ace9-4861-aef4-9604548dc632 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:15.140625 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0ab3fa34-ace9-4861-aef4-9604548dc632 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:15.141384 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0ab3fa34-ace9-4861-aef4-9604548dc632 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:15.141822 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0ab3fa34-ace9-4861-aef4-9604548dc632 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:15.200271 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-0ab3fa34-ace9-4861-aef4-9604548dc632 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:15.207515 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-0ab3fa34-ace9-4861-aef4-9604548dc632 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.077822 Mar 08 15:00:15.208066 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 720/1423] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:15 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:15.500307 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-59e000a7-5aeb-46db-a6a7-a7337602c54e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:15.501242 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-59e000a7-5aeb-46db-a6a7-a7337602c54e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:15.507157 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-59e000a7-5aeb-46db-a6a7-a7337602c54e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:15.507609 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-59e000a7-5aeb-46db-a6a7-a7337602c54e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:15.508373 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-59e000a7-5aeb-46db-a6a7-a7337602c54e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:15.508810 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-59e000a7-5aeb-46db-a6a7-a7337602c54e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:15.536813 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-59e000a7-5aeb-46db-a6a7-a7337602c54e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040495 Mar 08 15:00:15.537348 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 704/1424] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:15 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:00:15.860675 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-43eb0cbb-420b-4696-b769-dbc20ea4d1cd tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:15.861549 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-43eb0cbb-420b-4696-b769-dbc20ea4d1cd tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:15.867812 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-43eb0cbb-420b-4696-b769-dbc20ea4d1cd tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:15.868265 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-43eb0cbb-420b-4696-b769-dbc20ea4d1cd tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:15.869038 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-43eb0cbb-420b-4696-b769-dbc20ea4d1cd tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:15.870044 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-43eb0cbb-420b-4696-b769-dbc20ea4d1cd tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:15.897552 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-43eb0cbb-420b-4696-b769-dbc20ea4d1cd tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040906 Mar 08 15:00:15.898124 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 721/1425] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:15 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:00:15.991932 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-8b559428-0adc-4f5d-80ea-77d2a9e05a34 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:15.992538 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-8b559428-0adc-4f5d-80ea-77d2a9e05a34 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:15.999481 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8b559428-0adc-4f5d-80ea-77d2a9e05a34 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:15.999939 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8b559428-0adc-4f5d-80ea-77d2a9e05a34 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:16.000711 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8b559428-0adc-4f5d-80ea-77d2a9e05a34 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:16.001155 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8b559428-0adc-4f5d-80ea-77d2a9e05a34 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:16.139609 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-8b559428-0adc-4f5d-80ea-77d2a9e05a34 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:16.146909 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-8b559428-0adc-4f5d-80ea-77d2a9e05a34 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.158804 Mar 08 15:00:16.147483 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 705/1426] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:15 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:16.225005 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-6ef9bb55-19eb-4810-8fc6-5a427e04a33a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:16.225624 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-6ef9bb55-19eb-4810-8fc6-5a427e04a33a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:16.232128 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6ef9bb55-19eb-4810-8fc6-5a427e04a33a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:16.232585 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6ef9bb55-19eb-4810-8fc6-5a427e04a33a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:16.233363 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6ef9bb55-19eb-4810-8fc6-5a427e04a33a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:16.233810 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6ef9bb55-19eb-4810-8fc6-5a427e04a33a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:16.300903 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-6ef9bb55-19eb-4810-8fc6-5a427e04a33a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:16.313502 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-6ef9bb55-19eb-4810-8fc6-5a427e04a33a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.092332 Mar 08 15:00:16.314113 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 722/1427] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:16 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:16.548645 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-70b7ea23-1ecc-4dac-8a58-cab64eaa7f3e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:16.549564 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-70b7ea23-1ecc-4dac-8a58-cab64eaa7f3e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:16.555857 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-70b7ea23-1ecc-4dac-8a58-cab64eaa7f3e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:16.556311 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-70b7ea23-1ecc-4dac-8a58-cab64eaa7f3e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:16.558311 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-70b7ea23-1ecc-4dac-8a58-cab64eaa7f3e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:16.558783 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-70b7ea23-1ecc-4dac-8a58-cab64eaa7f3e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:16.586440 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-70b7ea23-1ecc-4dac-8a58-cab64eaa7f3e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041880 Mar 08 15:00:16.586983 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 706/1428] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:16 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:00:16.909215 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-6e620a2e-cc92-459e-a9bb-1753a9f71781 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:16.910090 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-6e620a2e-cc92-459e-a9bb-1753a9f71781 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:16.916938 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6e620a2e-cc92-459e-a9bb-1753a9f71781 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:16.917391 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6e620a2e-cc92-459e-a9bb-1753a9f71781 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:16.918203 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6e620a2e-cc92-459e-a9bb-1753a9f71781 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:16.918648 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6e620a2e-cc92-459e-a9bb-1753a9f71781 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:16.946608 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-6e620a2e-cc92-459e-a9bb-1753a9f71781 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041398 Mar 08 15:00:16.947161 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 723/1429] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:16 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:00:17.163831 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-a1421577-a497-4087-b42a-b30d9fd70561 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:17.164359 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-a1421577-a497-4087-b42a-b30d9fd70561 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:17.170700 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a1421577-a497-4087-b42a-b30d9fd70561 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:17.171151 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a1421577-a497-4087-b42a-b30d9fd70561 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:17.171907 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a1421577-a497-4087-b42a-b30d9fd70561 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:17.172342 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a1421577-a497-4087-b42a-b30d9fd70561 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:17.305495 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-a1421577-a497-4087-b42a-b30d9fd70561 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:17.313536 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-a1421577-a497-4087-b42a-b30d9fd70561 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.153601 Mar 08 15:00:17.314166 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 707/1430] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:17 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:17.336729 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-0d7baab7-5b3c-40fd-a079-14dae59d2760 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:17.337345 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-0d7baab7-5b3c-40fd-a079-14dae59d2760 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:17.343780 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0d7baab7-5b3c-40fd-a079-14dae59d2760 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:17.344235 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0d7baab7-5b3c-40fd-a079-14dae59d2760 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:17.345002 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0d7baab7-5b3c-40fd-a079-14dae59d2760 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:17.345445 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0d7baab7-5b3c-40fd-a079-14dae59d2760 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:17.404104 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-0d7baab7-5b3c-40fd-a079-14dae59d2760 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:17.411272 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-0d7baab7-5b3c-40fd-a079-14dae59d2760 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078310 Mar 08 15:00:17.411829 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 724/1431] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:17 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:17.599048 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-d9522702-bbbe-4915-bde8-018197a58ffa tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:17.599952 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-d9522702-bbbe-4915-bde8-018197a58ffa tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:17.605967 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d9522702-bbbe-4915-bde8-018197a58ffa tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:17.606425 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d9522702-bbbe-4915-bde8-018197a58ffa tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:17.607183 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d9522702-bbbe-4915-bde8-018197a58ffa tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:17.607621 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d9522702-bbbe-4915-bde8-018197a58ffa tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:17.636137 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-d9522702-bbbe-4915-bde8-018197a58ffa tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040999 Mar 08 15:00:17.636676 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 708/1432] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:17 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:00:17.957871 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-6b2fc51f-9507-4a51-982d-2413e09592b6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:17.958816 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-6b2fc51f-9507-4a51-982d-2413e09592b6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:17.965170 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6b2fc51f-9507-4a51-982d-2413e09592b6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:17.965625 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6b2fc51f-9507-4a51-982d-2413e09592b6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:17.966423 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6b2fc51f-9507-4a51-982d-2413e09592b6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:17.966863 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6b2fc51f-9507-4a51-982d-2413e09592b6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:17.994219 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-6b2fc51f-9507-4a51-982d-2413e09592b6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040253 Mar 08 15:00:17.995371 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 725/1433] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:17 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:00:18.330160 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-1f034ae7-658c-4f55-8151-76e3439545d1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:18.330768 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-1f034ae7-658c-4f55-8151-76e3439545d1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:18.337064 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1f034ae7-658c-4f55-8151-76e3439545d1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:18.337516 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1f034ae7-658c-4f55-8151-76e3439545d1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:18.338779 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1f034ae7-658c-4f55-8151-76e3439545d1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:18.339220 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1f034ae7-658c-4f55-8151-76e3439545d1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:18.428653 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-8721b78d-f4ee-4006-976b-9919a08ce060 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:18.429379 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-8721b78d-f4ee-4006-976b-9919a08ce060 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:18.436535 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8721b78d-f4ee-4006-976b-9919a08ce060 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:18.437071 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8721b78d-f4ee-4006-976b-9919a08ce060 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:18.437989 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8721b78d-f4ee-4006-976b-9919a08ce060 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:18.438436 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8721b78d-f4ee-4006-976b-9919a08ce060 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:18.477264 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-1f034ae7-658c-4f55-8151-76e3439545d1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:18.485292 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-1f034ae7-658c-4f55-8151-76e3439545d1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.159069 Mar 08 15:00:18.485899 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 709/1434] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:18 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:18.498769 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-8721b78d-f4ee-4006-976b-9919a08ce060 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:18.506030 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-8721b78d-f4ee-4006-976b-9919a08ce060 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081412 Mar 08 15:00:18.506576 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 726/1435] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:18 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:00:18.647801 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-02759925-beeb-4a50-86bf-4d591f5cac16 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:18.648628 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-02759925-beeb-4a50-86bf-4d591f5cac16 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:18.654973 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-02759925-beeb-4a50-86bf-4d591f5cac16 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:18.655426 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-02759925-beeb-4a50-86bf-4d591f5cac16 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:18.656186 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-02759925-beeb-4a50-86bf-4d591f5cac16 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:18.656619 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-02759925-beeb-4a50-86bf-4d591f5cac16 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:18.685360 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-02759925-beeb-4a50-86bf-4d591f5cac16 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041639 Mar 08 15:00:18.685924 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 710/1436] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:18 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:00:19.006348 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-64cdfeb6-8033-4428-be18-d78d69020340 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:19.007260 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-64cdfeb6-8033-4428-be18-d78d69020340 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:19.014178 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-64cdfeb6-8033-4428-be18-d78d69020340 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:19.014628 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-64cdfeb6-8033-4428-be18-d78d69020340 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:19.015419 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-64cdfeb6-8033-4428-be18-d78d69020340 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:19.015850 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-64cdfeb6-8033-4428-be18-d78d69020340 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:19.050568 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-64cdfeb6-8033-4428-be18-d78d69020340 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048157 Mar 08 15:00:19.051135 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 727/1437] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:19 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:00:19.502902 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-518ed7cd-dd50-4daf-9c67-607b3e44e0b2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:19.503517 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-518ed7cd-dd50-4daf-9c67-607b3e44e0b2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:19.510409 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-518ed7cd-dd50-4daf-9c67-607b3e44e0b2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:19.511018 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-518ed7cd-dd50-4daf-9c67-607b3e44e0b2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:19.511799 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-518ed7cd-dd50-4daf-9c67-607b3e44e0b2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:19.512243 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-518ed7cd-dd50-4daf-9c67-607b3e44e0b2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:19.522745 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-20b4bca5-1b6d-4f82-a003-8d8d4f60efc4 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:19.523593 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-20b4bca5-1b6d-4f82-a003-8d8d4f60efc4 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:19.530086 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-20b4bca5-1b6d-4f82-a003-8d8d4f60efc4 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:19.530538 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-20b4bca5-1b6d-4f82-a003-8d8d4f60efc4 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:19.531301 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-20b4bca5-1b6d-4f82-a003-8d8d4f60efc4 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:19.531736 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-20b4bca5-1b6d-4f82-a003-8d8d4f60efc4 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:19.594879 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-20b4bca5-1b6d-4f82-a003-8d8d4f60efc4 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:19.602212 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-20b4bca5-1b6d-4f82-a003-8d8d4f60efc4 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.083210 Mar 08 15:00:19.602969 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 728/1438] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:19 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:19.648449 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-518ed7cd-dd50-4daf-9c67-607b3e44e0b2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:19.655788 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-518ed7cd-dd50-4daf-9c67-607b3e44e0b2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.156743 Mar 08 15:00:19.656346 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 711/1439] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:19 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:00:19.696686 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-33ae5e4d-4145-4cb7-a84e-27ad6d4fcbb6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:19.698280 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-33ae5e4d-4145-4cb7-a84e-27ad6d4fcbb6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:19.704054 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-33ae5e4d-4145-4cb7-a84e-27ad6d4fcbb6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:19.704504 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-33ae5e4d-4145-4cb7-a84e-27ad6d4fcbb6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:19.705263 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-33ae5e4d-4145-4cb7-a84e-27ad6d4fcbb6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:19.705695 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-33ae5e4d-4145-4cb7-a84e-27ad6d4fcbb6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:19.733533 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-33ae5e4d-4145-4cb7-a84e-27ad6d4fcbb6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040750 Mar 08 15:00:19.734099 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 729/1440] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:19 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:00:20.061521 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-7f0846fe-3afc-4a9d-8c10-cf0d09d61f92 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:20.062463 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-7f0846fe-3afc-4a9d-8c10-cf0d09d61f92 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:20.068479 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7f0846fe-3afc-4a9d-8c10-cf0d09d61f92 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:20.068938 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7f0846fe-3afc-4a9d-8c10-cf0d09d61f92 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:20.069715 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7f0846fe-3afc-4a9d-8c10-cf0d09d61f92 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:20.070188 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7f0846fe-3afc-4a9d-8c10-cf0d09d61f92 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:20.099547 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-7f0846fe-3afc-4a9d-8c10-cf0d09d61f92 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041952 Mar 08 15:00:20.100115 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 712/1441] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:20 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:00:20.619541 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-e1262f35-1f75-4a8b-9181-374625a6aa26 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:20.620286 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-e1262f35-1f75-4a8b-9181-374625a6aa26 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:20.626359 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e1262f35-1f75-4a8b-9181-374625a6aa26 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:20.626811 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e1262f35-1f75-4a8b-9181-374625a6aa26 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:20.627570 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e1262f35-1f75-4a8b-9181-374625a6aa26 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:20.628004 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e1262f35-1f75-4a8b-9181-374625a6aa26 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:20.673185 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-2d802f3b-a6c2-4022-ba34-6d6518d567e0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:20.673751 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-2d802f3b-a6c2-4022-ba34-6d6518d567e0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:20.680244 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2d802f3b-a6c2-4022-ba34-6d6518d567e0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:20.680704 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2d802f3b-a6c2-4022-ba34-6d6518d567e0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:20.682046 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2d802f3b-a6c2-4022-ba34-6d6518d567e0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:20.682463 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2d802f3b-a6c2-4022-ba34-6d6518d567e0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:20.687311 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-e1262f35-1f75-4a8b-9181-374625a6aa26 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:20.694475 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-e1262f35-1f75-4a8b-9181-374625a6aa26 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079355 Mar 08 15:00:20.695223 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 730/1442] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:20 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:20.745156 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-068232b9-df95-456c-9dbb-d97a4423ed3b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:20.746109 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-068232b9-df95-456c-9dbb-d97a4423ed3b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:20.751803 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-068232b9-df95-456c-9dbb-d97a4423ed3b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:20.752275 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-068232b9-df95-456c-9dbb-d97a4423ed3b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:20.753021 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-068232b9-df95-456c-9dbb-d97a4423ed3b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:20.753457 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-068232b9-df95-456c-9dbb-d97a4423ed3b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:20.782724 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-068232b9-df95-456c-9dbb-d97a4423ed3b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041566 Mar 08 15:00:20.783286 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 731/1443] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:20 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 15:00:20.818873 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-2d802f3b-a6c2-4022-ba34-6d6518d567e0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:20.827051 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-2d802f3b-a6c2-4022-ba34-6d6518d567e0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.158243 Mar 08 15:00:20.827625 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 713/1444] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:20 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:00:21.110337 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-7dcdb66c-70ca-435e-81e5-095897663802 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:21.111257 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-7dcdb66c-70ca-435e-81e5-095897663802 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:21.117303 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7dcdb66c-70ca-435e-81e5-095897663802 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:21.117805 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7dcdb66c-70ca-435e-81e5-095897663802 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:21.118609 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7dcdb66c-70ca-435e-81e5-095897663802 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:21.119726 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7dcdb66c-70ca-435e-81e5-095897663802 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:21.147815 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-7dcdb66c-70ca-435e-81e5-095897663802 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041481 Mar 08 15:00:21.148373 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 732/1445] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:21 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:00:21.711997 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-4a2a884f-6e7e-433e-aa40-b4b20bd0b361 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:21.712614 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-4a2a884f-6e7e-433e-aa40-b4b20bd0b361 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:21.719296 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4a2a884f-6e7e-433e-aa40-b4b20bd0b361 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:21.719753 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4a2a884f-6e7e-433e-aa40-b4b20bd0b361 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:21.720556 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4a2a884f-6e7e-433e-aa40-b4b20bd0b361 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:21.720996 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4a2a884f-6e7e-433e-aa40-b4b20bd0b361 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:21.783636 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-4a2a884f-6e7e-433e-aa40-b4b20bd0b361 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:21.791850 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-4a2a884f-6e7e-433e-aa40-b4b20bd0b361 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.082986 Mar 08 15:00:21.792423 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 714/1446] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:21 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:21.795501 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-24f0d98e-d196-4cfb-bdf9-91a1a5ae1078 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:21.796366 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-24f0d98e-d196-4cfb-bdf9-91a1a5ae1078 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:21.802881 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-24f0d98e-d196-4cfb-bdf9-91a1a5ae1078 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:21.803338 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-24f0d98e-d196-4cfb-bdf9-91a1a5ae1078 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:21.804102 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-24f0d98e-d196-4cfb-bdf9-91a1a5ae1078 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:21.804539 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-24f0d98e-d196-4cfb-bdf9-91a1a5ae1078 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:21.833284 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-24f0d98e-d196-4cfb-bdf9-91a1a5ae1078 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043034 Mar 08 15:00:21.833831 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 733/1447] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:21 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 15:00:21.845105 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-617090a4-029c-4496-8f56-ef2886065a1b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:21.845716 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-617090a4-029c-4496-8f56-ef2886065a1b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:21.851514 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-617090a4-029c-4496-8f56-ef2886065a1b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:21.851972 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-617090a4-029c-4496-8f56-ef2886065a1b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:21.852742 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-617090a4-029c-4496-8f56-ef2886065a1b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:21.853185 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-617090a4-029c-4496-8f56-ef2886065a1b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:21.987937 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-617090a4-029c-4496-8f56-ef2886065a1b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:21.995544 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-617090a4-029c-4496-8f56-ef2886065a1b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.154279 Mar 08 15:00:21.996104 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 715/1448] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:21 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:22.159546 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-8b94a785-43fa-46b2-bae9-16c9c4aa33d7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:22.160414 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-8b94a785-43fa-46b2-bae9-16c9c4aa33d7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:22.166867 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8b94a785-43fa-46b2-bae9-16c9c4aa33d7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:22.167317 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8b94a785-43fa-46b2-bae9-16c9c4aa33d7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:22.168075 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8b94a785-43fa-46b2-bae9-16c9c4aa33d7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:22.168506 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8b94a785-43fa-46b2-bae9-16c9c4aa33d7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:22.196114 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-8b94a785-43fa-46b2-bae9-16c9c4aa33d7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040596 Mar 08 15:00:22.196655 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 734/1449] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:22 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:00:22.808685 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-71af56ec-dc8d-49f6-b0bd-2c98b54c3e97 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:22.809288 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-71af56ec-dc8d-49f6-b0bd-2c98b54c3e97 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:22.815530 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-71af56ec-dc8d-49f6-b0bd-2c98b54c3e97 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:22.815978 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-71af56ec-dc8d-49f6-b0bd-2c98b54c3e97 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:22.816735 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-71af56ec-dc8d-49f6-b0bd-2c98b54c3e97 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:22.817171 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-71af56ec-dc8d-49f6-b0bd-2c98b54c3e97 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:22.845073 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-aef2b2fb-f89a-4d30-aeb7-404530e077d5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:22.846044 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-aef2b2fb-f89a-4d30-aeb7-404530e077d5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:22.852331 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-aef2b2fb-f89a-4d30-aeb7-404530e077d5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:22.852785 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-aef2b2fb-f89a-4d30-aeb7-404530e077d5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:22.854194 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-aef2b2fb-f89a-4d30-aeb7-404530e077d5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:22.854610 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-aef2b2fb-f89a-4d30-aeb7-404530e077d5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:22.877373 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-71af56ec-dc8d-49f6-b0bd-2c98b54c3e97 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:22.882465 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-aef2b2fb-f89a-4d30-aeb7-404530e077d5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041388 Mar 08 15:00:22.883033 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 735/1450] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:22 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 15:00:22.884431 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-71af56ec-dc8d-49f6-b0bd-2c98b54c3e97 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079654 Mar 08 15:00:22.885063 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 716/1451] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:22 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:23.013696 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-76845b26-c201-4c6a-9585-dc57f360616b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:23.014341 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-76845b26-c201-4c6a-9585-dc57f360616b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:23.020392 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-76845b26-c201-4c6a-9585-dc57f360616b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:23.020845 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-76845b26-c201-4c6a-9585-dc57f360616b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:23.021611 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-76845b26-c201-4c6a-9585-dc57f360616b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:23.022085 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-76845b26-c201-4c6a-9585-dc57f360616b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:23.157078 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-76845b26-c201-4c6a-9585-dc57f360616b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:23.164319 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-76845b26-c201-4c6a-9585-dc57f360616b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.155927 Mar 08 15:00:23.164910 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 736/1452] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:23 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:23.208268 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-683f28cb-5eb7-46ab-82af-35fe2e220589 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:23.209207 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-683f28cb-5eb7-46ab-82af-35fe2e220589 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:23.216037 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-683f28cb-5eb7-46ab-82af-35fe2e220589 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:23.216485 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-683f28cb-5eb7-46ab-82af-35fe2e220589 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:23.217245 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-683f28cb-5eb7-46ab-82af-35fe2e220589 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:23.217678 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-683f28cb-5eb7-46ab-82af-35fe2e220589 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:23.245675 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-683f28cb-5eb7-46ab-82af-35fe2e220589 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041303 Mar 08 15:00:23.246256 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 717/1453] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:23 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:00:23.895169 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-cd7a7a8c-47d6-43c5-9e91-58d2881f7fc1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:23.896020 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-cd7a7a8c-47d6-43c5-9e91-58d2881f7fc1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:23.901312 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-3c6f4db3-cc4a-4e8d-afc9-2427e93b5132 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:23.901948 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-3c6f4db3-cc4a-4e8d-afc9-2427e93b5132 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:23.902726 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cd7a7a8c-47d6-43c5-9e91-58d2881f7fc1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:23.903182 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cd7a7a8c-47d6-43c5-9e91-58d2881f7fc1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:23.903994 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cd7a7a8c-47d6-43c5-9e91-58d2881f7fc1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:23.904428 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cd7a7a8c-47d6-43c5-9e91-58d2881f7fc1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:23.908139 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3c6f4db3-cc4a-4e8d-afc9-2427e93b5132 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:23.908597 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3c6f4db3-cc4a-4e8d-afc9-2427e93b5132 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:23.909374 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3c6f4db3-cc4a-4e8d-afc9-2427e93b5132 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:23.909817 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3c6f4db3-cc4a-4e8d-afc9-2427e93b5132 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:23.934146 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-cd7a7a8c-47d6-43c5-9e91-58d2881f7fc1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043064 Mar 08 15:00:23.937955 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 737/1454] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:23 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:00:23.973954 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-3c6f4db3-cc4a-4e8d-afc9-2427e93b5132 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:23.982418 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-3c6f4db3-cc4a-4e8d-afc9-2427e93b5132 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.085461 Mar 08 15:00:23.982986 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 718/1455] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:23 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:24.180766 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-2af25e4e-976f-47c3-a718-c2f888ab3f75 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:24.181309 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-2af25e4e-976f-47c3-a718-c2f888ab3f75 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:24.187807 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2af25e4e-976f-47c3-a718-c2f888ab3f75 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:24.188258 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2af25e4e-976f-47c3-a718-c2f888ab3f75 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:24.189030 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2af25e4e-976f-47c3-a718-c2f888ab3f75 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:24.189474 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2af25e4e-976f-47c3-a718-c2f888ab3f75 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:24.256804 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-4f12077b-8210-49f5-89ba-bdc5bb94584d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:24.257757 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-4f12077b-8210-49f5-89ba-bdc5bb94584d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:24.264954 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4f12077b-8210-49f5-89ba-bdc5bb94584d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:24.265418 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4f12077b-8210-49f5-89ba-bdc5bb94584d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:24.266294 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4f12077b-8210-49f5-89ba-bdc5bb94584d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:24.266735 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4f12077b-8210-49f5-89ba-bdc5bb94584d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:24.295562 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-4f12077b-8210-49f5-89ba-bdc5bb94584d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042744 Mar 08 15:00:24.296130 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 719/1456] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:24 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 15:00:24.329985 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-2af25e4e-976f-47c3-a718-c2f888ab3f75 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:24.337281 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-2af25e4e-976f-47c3-a718-c2f888ab3f75 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.160758 Mar 08 15:00:24.338033 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 738/1457] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:24 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:24.945051 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-01e18a55-c1e8-43d2-83a0-5d7465938e39 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:24.945990 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-01e18a55-c1e8-43d2-83a0-5d7465938e39 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:24.952541 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-01e18a55-c1e8-43d2-83a0-5d7465938e39 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:24.952998 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-01e18a55-c1e8-43d2-83a0-5d7465938e39 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:24.953762 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-01e18a55-c1e8-43d2-83a0-5d7465938e39 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:24.954224 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-01e18a55-c1e8-43d2-83a0-5d7465938e39 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:24.985839 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-01e18a55-c1e8-43d2-83a0-5d7465938e39 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044764 Mar 08 15:00:24.986429 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 720/1458] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:24 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:00:24.999256 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c69954df-5a81-4285-96ae-da776e498d22 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:24.999877 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-c69954df-5a81-4285-96ae-da776e498d22 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:25.006236 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c69954df-5a81-4285-96ae-da776e498d22 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:25.006700 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c69954df-5a81-4285-96ae-da776e498d22 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:25.007477 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c69954df-5a81-4285-96ae-da776e498d22 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:25.007924 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c69954df-5a81-4285-96ae-da776e498d22 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:25.067609 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-c69954df-5a81-4285-96ae-da776e498d22 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:25.075158 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-c69954df-5a81-4285-96ae-da776e498d22 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079828 Mar 08 15:00:25.075724 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 739/1459] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:24 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:25.307553 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-9a365a53-ee7c-4712-9f61-ff2d17dd72e2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:25.308486 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-9a365a53-ee7c-4712-9f61-ff2d17dd72e2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:25.314363 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9a365a53-ee7c-4712-9f61-ff2d17dd72e2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:25.314812 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9a365a53-ee7c-4712-9f61-ff2d17dd72e2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:25.315578 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9a365a53-ee7c-4712-9f61-ff2d17dd72e2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:25.316014 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9a365a53-ee7c-4712-9f61-ff2d17dd72e2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:25.344609 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-9a365a53-ee7c-4712-9f61-ff2d17dd72e2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041082 Mar 08 15:00:25.345162 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 721/1460] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:25 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:00:25.354337 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-56bc9c71-e31b-43d0-b0f6-f1904cba8971 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:25.354973 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-56bc9c71-e31b-43d0-b0f6-f1904cba8971 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:25.360682 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-56bc9c71-e31b-43d0-b0f6-f1904cba8971 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:25.361127 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-56bc9c71-e31b-43d0-b0f6-f1904cba8971 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:25.361914 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-56bc9c71-e31b-43d0-b0f6-f1904cba8971 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:25.362352 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-56bc9c71-e31b-43d0-b0f6-f1904cba8971 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:25.493373 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-56bc9c71-e31b-43d0-b0f6-f1904cba8971 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:25.501228 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-56bc9c71-e31b-43d0-b0f6-f1904cba8971 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.151009 Mar 08 15:00:25.501786 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 740/1461] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:25 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:25.996898 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-e70a72c9-e3a7-4efa-9b0d-7430144bc171 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:25.997739 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-e70a72c9-e3a7-4efa-9b0d-7430144bc171 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:26.003995 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e70a72c9-e3a7-4efa-9b0d-7430144bc171 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:26.004444 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e70a72c9-e3a7-4efa-9b0d-7430144bc171 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:26.005208 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e70a72c9-e3a7-4efa-9b0d-7430144bc171 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:26.005647 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e70a72c9-e3a7-4efa-9b0d-7430144bc171 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:26.034477 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-e70a72c9-e3a7-4efa-9b0d-7430144bc171 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041836 Mar 08 15:00:26.035015 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 722/1462] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:25 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:00:26.092828 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-2fe39c89-f3b8-4ded-b883-fc85bf75587f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:26.093426 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-2fe39c89-f3b8-4ded-b883-fc85bf75587f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:26.099777 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2fe39c89-f3b8-4ded-b883-fc85bf75587f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:26.100230 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2fe39c89-f3b8-4ded-b883-fc85bf75587f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:26.100988 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2fe39c89-f3b8-4ded-b883-fc85bf75587f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:26.101428 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2fe39c89-f3b8-4ded-b883-fc85bf75587f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:26.160395 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-2fe39c89-f3b8-4ded-b883-fc85bf75587f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:26.167752 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-2fe39c89-f3b8-4ded-b883-fc85bf75587f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078800 Mar 08 15:00:26.168302 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 741/1463] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:26 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:26.356429 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b415f41c-3dcb-4245-a770-45fd692fe08e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:26.357255 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-b415f41c-3dcb-4245-a770-45fd692fe08e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:26.363085 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b415f41c-3dcb-4245-a770-45fd692fe08e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:26.363538 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b415f41c-3dcb-4245-a770-45fd692fe08e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:26.364299 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b415f41c-3dcb-4245-a770-45fd692fe08e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:26.364732 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b415f41c-3dcb-4245-a770-45fd692fe08e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:26.393290 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-b415f41c-3dcb-4245-a770-45fd692fe08e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041049 Mar 08 15:00:26.393842 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 723/1464] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:26 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:00:26.519041 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-7ea9726c-1c2f-4d12-b7b0-d7904cb1d0ab tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:26.519649 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-7ea9726c-1c2f-4d12-b7b0-d7904cb1d0ab tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:26.525641 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7ea9726c-1c2f-4d12-b7b0-d7904cb1d0ab tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:26.526124 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7ea9726c-1c2f-4d12-b7b0-d7904cb1d0ab tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:26.526891 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7ea9726c-1c2f-4d12-b7b0-d7904cb1d0ab tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:26.527324 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7ea9726c-1c2f-4d12-b7b0-d7904cb1d0ab tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:26.664548 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-7ea9726c-1c2f-4d12-b7b0-d7904cb1d0ab tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:26.671956 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-7ea9726c-1c2f-4d12-b7b0-d7904cb1d0ab tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.156758 Mar 08 15:00:26.672518 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 742/1465] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:26 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:27.047075 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-bc3facfa-a628-4cd1-8ace-0f65bccb5aa3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:27.048032 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-bc3facfa-a628-4cd1-8ace-0f65bccb5aa3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:27.054595 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bc3facfa-a628-4cd1-8ace-0f65bccb5aa3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:27.055060 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bc3facfa-a628-4cd1-8ace-0f65bccb5aa3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:27.055845 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bc3facfa-a628-4cd1-8ace-0f65bccb5aa3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:27.056331 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bc3facfa-a628-4cd1-8ace-0f65bccb5aa3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:27.086096 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-bc3facfa-a628-4cd1-8ace-0f65bccb5aa3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042969 Mar 08 15:00:27.086666 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 724/1466] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:27 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:00:27.184524 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3564d982-545b-4cac-a468-fe0e65ee4f08 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:27.185113 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-3564d982-545b-4cac-a468-fe0e65ee4f08 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:27.191448 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3564d982-545b-4cac-a468-fe0e65ee4f08 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:27.191839 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3564d982-545b-4cac-a468-fe0e65ee4f08 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:27.192611 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3564d982-545b-4cac-a468-fe0e65ee4f08 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:27.193043 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3564d982-545b-4cac-a468-fe0e65ee4f08 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:27.252901 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-3564d982-545b-4cac-a468-fe0e65ee4f08 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:27.260093 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-3564d982-545b-4cac-a468-fe0e65ee4f08 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079395 Mar 08 15:00:27.260597 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 743/1467] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:27 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:27.405209 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-1b5e7db6-07d5-49d6-b587-cacc9a6b4195 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:27.406175 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-1b5e7db6-07d5-49d6-b587-cacc9a6b4195 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:27.412003 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1b5e7db6-07d5-49d6-b587-cacc9a6b4195 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:27.412453 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1b5e7db6-07d5-49d6-b587-cacc9a6b4195 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:27.413215 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1b5e7db6-07d5-49d6-b587-cacc9a6b4195 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:27.413652 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1b5e7db6-07d5-49d6-b587-cacc9a6b4195 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:27.442854 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-1b5e7db6-07d5-49d6-b587-cacc9a6b4195 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041497 Mar 08 15:00:27.443323 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 725/1468] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:27 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:00:27.689615 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-9ebfc26a-589d-4fd5-a323-c933dc83e828 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:27.690255 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-9ebfc26a-589d-4fd5-a323-c933dc83e828 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:27.696105 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9ebfc26a-589d-4fd5-a323-c933dc83e828 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:27.696498 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9ebfc26a-589d-4fd5-a323-c933dc83e828 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:27.697890 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9ebfc26a-589d-4fd5-a323-c933dc83e828 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:27.698289 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9ebfc26a-589d-4fd5-a323-c933dc83e828 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:27.834474 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-9ebfc26a-589d-4fd5-a323-c933dc83e828 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:27.842660 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-9ebfc26a-589d-4fd5-a323-c933dc83e828 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.156829 Mar 08 15:00:27.843232 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 744/1469] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:27 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:28.098627 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-065ea7a7-ba77-4567-84be-85b92a448c0d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:28.099545 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-065ea7a7-ba77-4567-84be-85b92a448c0d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:28.107081 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-065ea7a7-ba77-4567-84be-85b92a448c0d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:28.107539 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-065ea7a7-ba77-4567-84be-85b92a448c0d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:28.108310 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-065ea7a7-ba77-4567-84be-85b92a448c0d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:28.108746 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-065ea7a7-ba77-4567-84be-85b92a448c0d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:28.137118 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-065ea7a7-ba77-4567-84be-85b92a448c0d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041996 Mar 08 15:00:28.137666 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 726/1470] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:28 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:00:28.277157 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-60b7962e-5afb-413a-9ca8-90fe17a3d12e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:28.277769 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-60b7962e-5afb-413a-9ca8-90fe17a3d12e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:28.284078 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-60b7962e-5afb-413a-9ca8-90fe17a3d12e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:28.284532 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-60b7962e-5afb-413a-9ca8-90fe17a3d12e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:28.285335 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-60b7962e-5afb-413a-9ca8-90fe17a3d12e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:28.285777 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-60b7962e-5afb-413a-9ca8-90fe17a3d12e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:28.346039 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-60b7962e-5afb-413a-9ca8-90fe17a3d12e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:28.353500 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-60b7962e-5afb-413a-9ca8-90fe17a3d12e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080863 Mar 08 15:00:28.354025 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 745/1471] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:28 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:28.454197 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-77c6a291-da4a-4b9d-84fd-51c6adf76af1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:28.455110 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-77c6a291-da4a-4b9d-84fd-51c6adf76af1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:28.460957 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-77c6a291-da4a-4b9d-84fd-51c6adf76af1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:28.461401 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-77c6a291-da4a-4b9d-84fd-51c6adf76af1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:28.462223 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-77c6a291-da4a-4b9d-84fd-51c6adf76af1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:28.463501 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-77c6a291-da4a-4b9d-84fd-51c6adf76af1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:28.490565 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-77c6a291-da4a-4b9d-84fd-51c6adf76af1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040390 Mar 08 15:00:28.491100 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 727/1472] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:28 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:00:28.859150 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-77c1b33a-c1cf-4496-a09f-d4bc4bdaf887 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:28.859769 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-77c1b33a-c1cf-4496-a09f-d4bc4bdaf887 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:28.865531 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-77c1b33a-c1cf-4496-a09f-d4bc4bdaf887 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:28.866001 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-77c1b33a-c1cf-4496-a09f-d4bc4bdaf887 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:28.866782 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-77c1b33a-c1cf-4496-a09f-d4bc4bdaf887 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:28.867218 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-77c1b33a-c1cf-4496-a09f-d4bc4bdaf887 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:29.002089 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-77c1b33a-c1cf-4496-a09f-d4bc4bdaf887 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:29.009498 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-77c1b33a-c1cf-4496-a09f-d4bc4bdaf887 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.154202 Mar 08 15:00:29.010137 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 746/1473] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:28 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:29.148809 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-e6a01adc-bb78-4cd0-af4c-52c2348e5c7e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:29.149633 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-e6a01adc-bb78-4cd0-af4c-52c2348e5c7e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:29.156070 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e6a01adc-bb78-4cd0-af4c-52c2348e5c7e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:29.156517 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e6a01adc-bb78-4cd0-af4c-52c2348e5c7e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:29.157280 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e6a01adc-bb78-4cd0-af4c-52c2348e5c7e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:29.157719 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e6a01adc-bb78-4cd0-af4c-52c2348e5c7e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:29.189706 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-e6a01adc-bb78-4cd0-af4c-52c2348e5c7e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045014 Mar 08 15:00:29.190283 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 728/1474] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:29 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:00:29.369724 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-4794c2f1-2214-4987-aca5-7f45118e5ec7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:29.370355 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-4794c2f1-2214-4987-aca5-7f45118e5ec7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:29.376605 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4794c2f1-2214-4987-aca5-7f45118e5ec7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:29.377054 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4794c2f1-2214-4987-aca5-7f45118e5ec7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:29.377821 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4794c2f1-2214-4987-aca5-7f45118e5ec7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:29.378281 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4794c2f1-2214-4987-aca5-7f45118e5ec7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:29.437622 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-4794c2f1-2214-4987-aca5-7f45118e5ec7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:29.445044 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-4794c2f1-2214-4987-aca5-7f45118e5ec7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079346 Mar 08 15:00:29.445603 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 747/1475] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:29 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:29.502102 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-fe57234f-ba7e-4c85-9aa5-105d3307b078 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:29.503014 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-fe57234f-ba7e-4c85-9aa5-105d3307b078 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:29.509529 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fe57234f-ba7e-4c85-9aa5-105d3307b078 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:29.510181 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fe57234f-ba7e-4c85-9aa5-105d3307b078 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:29.510972 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fe57234f-ba7e-4c85-9aa5-105d3307b078 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:29.511414 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fe57234f-ba7e-4c85-9aa5-105d3307b078 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:29.539851 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-fe57234f-ba7e-4c85-9aa5-105d3307b078 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041723 Mar 08 15:00:29.540403 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 729/1476] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:29 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:00:30.027308 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-90c0455b-f1f7-4489-8320-69e87ed62cb2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:30.027919 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-90c0455b-f1f7-4489-8320-69e87ed62cb2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:30.033792 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-90c0455b-f1f7-4489-8320-69e87ed62cb2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:30.034269 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-90c0455b-f1f7-4489-8320-69e87ed62cb2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:30.035037 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-90c0455b-f1f7-4489-8320-69e87ed62cb2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:30.035473 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-90c0455b-f1f7-4489-8320-69e87ed62cb2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:30.173067 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-90c0455b-f1f7-4489-8320-69e87ed62cb2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:30.180829 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-90c0455b-f1f7-4489-8320-69e87ed62cb2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.157687 Mar 08 15:00:30.182622 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 748/1477] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:30 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:30.201088 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-70febe88-ddb7-4a44-a6c0-fd555f3825a4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:30.201966 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-70febe88-ddb7-4a44-a6c0-fd555f3825a4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:30.208254 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-70febe88-ddb7-4a44-a6c0-fd555f3825a4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:30.208718 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-70febe88-ddb7-4a44-a6c0-fd555f3825a4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:30.209509 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-70febe88-ddb7-4a44-a6c0-fd555f3825a4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:30.209975 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-70febe88-ddb7-4a44-a6c0-fd555f3825a4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:30.238489 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-70febe88-ddb7-4a44-a6c0-fd555f3825a4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041860 Mar 08 15:00:30.239036 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 730/1478] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:30 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 15:00:30.462311 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-be345b74-648e-4cf6-8b36-11d7225c3757 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:30.463427 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-be345b74-648e-4cf6-8b36-11d7225c3757 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:30.469673 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-be345b74-648e-4cf6-8b36-11d7225c3757 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:30.470171 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-be345b74-648e-4cf6-8b36-11d7225c3757 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:30.470951 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-be345b74-648e-4cf6-8b36-11d7225c3757 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:30.471396 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-be345b74-648e-4cf6-8b36-11d7225c3757 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:30.530384 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-be345b74-648e-4cf6-8b36-11d7225c3757 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:30.537545 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-be345b74-648e-4cf6-8b36-11d7225c3757 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079136 Mar 08 15:00:30.538148 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 749/1479] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:30 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:30.552550 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-6701562a-60e9-4ddc-ab97-e88ac80d6c30 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:30.553461 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-6701562a-60e9-4ddc-ab97-e88ac80d6c30 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:30.559322 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6701562a-60e9-4ddc-ab97-e88ac80d6c30 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:30.559777 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6701562a-60e9-4ddc-ab97-e88ac80d6c30 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:30.560546 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6701562a-60e9-4ddc-ab97-e88ac80d6c30 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:30.561010 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6701562a-60e9-4ddc-ab97-e88ac80d6c30 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:30.588481 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-6701562a-60e9-4ddc-ab97-e88ac80d6c30 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040071 Mar 08 15:00:30.589026 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 731/1480] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:30 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:00:31.198758 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-679fb698-351a-46d5-ac29-e39d950d1f1d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:31.199303 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-679fb698-351a-46d5-ac29-e39d950d1f1d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:31.205178 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-679fb698-351a-46d5-ac29-e39d950d1f1d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:31.205626 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-679fb698-351a-46d5-ac29-e39d950d1f1d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:31.206429 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-679fb698-351a-46d5-ac29-e39d950d1f1d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:31.206866 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-679fb698-351a-46d5-ac29-e39d950d1f1d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:31.250171 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-70b91df2-ab39-4e5f-b2bc-9a54b18ca7a8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:31.251080 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-70b91df2-ab39-4e5f-b2bc-9a54b18ca7a8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:31.259780 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-70b91df2-ab39-4e5f-b2bc-9a54b18ca7a8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:31.260309 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-70b91df2-ab39-4e5f-b2bc-9a54b18ca7a8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:31.261090 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-70b91df2-ab39-4e5f-b2bc-9a54b18ca7a8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:31.261532 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-70b91df2-ab39-4e5f-b2bc-9a54b18ca7a8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:31.291685 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-70b91df2-ab39-4e5f-b2bc-9a54b18ca7a8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044697 Mar 08 15:00:31.292267 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 732/1481] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:31 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 15:00:31.339944 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-679fb698-351a-46d5-ac29-e39d950d1f1d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:31.347245 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-679fb698-351a-46d5-ac29-e39d950d1f1d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.152641 Mar 08 15:00:31.347784 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 750/1482] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:31 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:31.554891 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-ce9a3b55-00dd-4295-9ccb-0cbb880b06d7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:31.555508 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-ce9a3b55-00dd-4295-9ccb-0cbb880b06d7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:31.561579 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ce9a3b55-00dd-4295-9ccb-0cbb880b06d7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:31.562144 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ce9a3b55-00dd-4295-9ccb-0cbb880b06d7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:31.562916 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ce9a3b55-00dd-4295-9ccb-0cbb880b06d7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:31.563357 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ce9a3b55-00dd-4295-9ccb-0cbb880b06d7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:31.599892 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-a42c4a68-c933-4448-8624-6a034fb97e68 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:31.600808 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-a42c4a68-c933-4448-8624-6a034fb97e68 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:31.607636 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a42c4a68-c933-4448-8624-6a034fb97e68 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:31.608083 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a42c4a68-c933-4448-8624-6a034fb97e68 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:31.608857 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a42c4a68-c933-4448-8624-6a034fb97e68 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:31.609291 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a42c4a68-c933-4448-8624-6a034fb97e68 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:31.623215 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-ce9a3b55-00dd-4295-9ccb-0cbb880b06d7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:31.630582 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-ce9a3b55-00dd-4295-9ccb-0cbb880b06d7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079667 Mar 08 15:00:31.631147 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 733/1483] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:31 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:31.639810 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-a42c4a68-c933-4448-8624-6a034fb97e68 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043851 Mar 08 15:00:31.640347 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 751/1484] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:31 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 15:00:32.304485 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-a800723d-3287-4598-a895-83b81363e5c6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:32.305501 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-a800723d-3287-4598-a895-83b81363e5c6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:32.312450 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a800723d-3287-4598-a895-83b81363e5c6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:32.312905 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a800723d-3287-4598-a895-83b81363e5c6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:32.313713 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a800723d-3287-4598-a895-83b81363e5c6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:32.314206 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a800723d-3287-4598-a895-83b81363e5c6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:32.342577 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-a800723d-3287-4598-a895-83b81363e5c6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042355 Mar 08 15:00:32.343135 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 734/1485] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:32 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:00:32.364252 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-6ee28312-18cc-4ccf-a3c6-3607880e7193 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:32.364856 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-6ee28312-18cc-4ccf-a3c6-3607880e7193 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:32.371325 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6ee28312-18cc-4ccf-a3c6-3607880e7193 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:32.371768 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6ee28312-18cc-4ccf-a3c6-3607880e7193 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:32.372552 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6ee28312-18cc-4ccf-a3c6-3607880e7193 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:32.372985 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6ee28312-18cc-4ccf-a3c6-3607880e7193 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:32.507199 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-6ee28312-18cc-4ccf-a3c6-3607880e7193 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:32.514514 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-6ee28312-18cc-4ccf-a3c6-3607880e7193 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.154056 Mar 08 15:00:32.515088 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 752/1486] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:32 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:00:32.648426 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-abbfaa57-50aa-4cd0-a415-1bbd917f7d93 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:32.648960 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-abbfaa57-50aa-4cd0-a415-1bbd917f7d93 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:32.650962 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-6ba14349-473f-4f7f-9394-ea036a772c19 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:32.651875 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-6ba14349-473f-4f7f-9394-ea036a772c19 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:32.656225 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-abbfaa57-50aa-4cd0-a415-1bbd917f7d93 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:32.656862 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-abbfaa57-50aa-4cd0-a415-1bbd917f7d93 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:32.657945 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-abbfaa57-50aa-4cd0-a415-1bbd917f7d93 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:32.658053 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6ba14349-473f-4f7f-9394-ea036a772c19 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:32.658396 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-abbfaa57-50aa-4cd0-a415-1bbd917f7d93 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:32.658516 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6ba14349-473f-4f7f-9394-ea036a772c19 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:32.659262 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6ba14349-473f-4f7f-9394-ea036a772c19 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:32.659703 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6ba14349-473f-4f7f-9394-ea036a772c19 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:32.689474 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-6ba14349-473f-4f7f-9394-ea036a772c19 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042375 Mar 08 15:00:32.690068 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 753/1487] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:32 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 15:00:32.719651 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-abbfaa57-50aa-4cd0-a415-1bbd917f7d93 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:32.726914 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-abbfaa57-50aa-4cd0-a415-1bbd917f7d93 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.082607 Mar 08 15:00:32.727475 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 735/1488] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:32 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:33.354862 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-7aeed393-f37b-4fb0-96d6-132b2b03dc6c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:33.355786 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-7aeed393-f37b-4fb0-96d6-132b2b03dc6c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:33.361690 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7aeed393-f37b-4fb0-96d6-132b2b03dc6c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:33.362180 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7aeed393-f37b-4fb0-96d6-132b2b03dc6c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:33.362990 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7aeed393-f37b-4fb0-96d6-132b2b03dc6c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:33.363433 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7aeed393-f37b-4fb0-96d6-132b2b03dc6c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:33.391747 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-7aeed393-f37b-4fb0-96d6-132b2b03dc6c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041524 Mar 08 15:00:33.392301 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 754/1489] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:33 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:00:33.531850 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-dc918f19-5326-4c6d-8aee-4f4637b64761 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:33.532463 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-dc918f19-5326-4c6d-8aee-4f4637b64761 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:33.538722 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-dc918f19-5326-4c6d-8aee-4f4637b64761 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:33.539173 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-dc918f19-5326-4c6d-8aee-4f4637b64761 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:33.539937 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-dc918f19-5326-4c6d-8aee-4f4637b64761 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:33.540477 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-dc918f19-5326-4c6d-8aee-4f4637b64761 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:33.673225 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-dc918f19-5326-4c6d-8aee-4f4637b64761 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:33.680732 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-dc918f19-5326-4c6d-8aee-4f4637b64761 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.152784 Mar 08 15:00:33.682158 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 736/1490] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:33 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:33.701050 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-2d5bea82-5d2b-494b-be66-b40ad0e654ae tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:33.702001 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-2d5bea82-5d2b-494b-be66-b40ad0e654ae tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:33.708105 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2d5bea82-5d2b-494b-be66-b40ad0e654ae tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:33.708554 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2d5bea82-5d2b-494b-be66-b40ad0e654ae tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:33.709318 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2d5bea82-5d2b-494b-be66-b40ad0e654ae tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:33.709755 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2d5bea82-5d2b-494b-be66-b40ad0e654ae tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:33.736670 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-2d5bea82-5d2b-494b-be66-b40ad0e654ae tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040096 Mar 08 15:00:33.737207 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 755/1491] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:33 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:00:33.745217 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-d26e45b6-ce98-4ff8-9bbd-6f192794c813 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:33.745875 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-d26e45b6-ce98-4ff8-9bbd-6f192794c813 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:33.751658 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d26e45b6-ce98-4ff8-9bbd-6f192794c813 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:33.752113 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d26e45b6-ce98-4ff8-9bbd-6f192794c813 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:33.752881 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d26e45b6-ce98-4ff8-9bbd-6f192794c813 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:33.753323 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d26e45b6-ce98-4ff8-9bbd-6f192794c813 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:33.815288 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-d26e45b6-ce98-4ff8-9bbd-6f192794c813 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:33.823087 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-d26e45b6-ce98-4ff8-9bbd-6f192794c813 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.082627 Mar 08 15:00:33.823653 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 737/1492] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:33 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:34.403435 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-a0f5727f-e18c-4ed9-a2d5-8c8896708f0f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:34.404346 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-a0f5727f-e18c-4ed9-a2d5-8c8896708f0f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:34.410272 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a0f5727f-e18c-4ed9-a2d5-8c8896708f0f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:34.410717 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a0f5727f-e18c-4ed9-a2d5-8c8896708f0f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:34.411479 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a0f5727f-e18c-4ed9-a2d5-8c8896708f0f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:34.411914 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a0f5727f-e18c-4ed9-a2d5-8c8896708f0f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:34.441781 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-a0f5727f-e18c-4ed9-a2d5-8c8896708f0f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043056 Mar 08 15:00:34.442358 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 756/1493] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:34 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:00:34.699124 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-12e5a069-8d04-4fc1-9766-2f77bf67c2de tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:34.699670 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-12e5a069-8d04-4fc1-9766-2f77bf67c2de tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:34.705934 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-12e5a069-8d04-4fc1-9766-2f77bf67c2de tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:34.706389 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-12e5a069-8d04-4fc1-9766-2f77bf67c2de tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:34.707152 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-12e5a069-8d04-4fc1-9766-2f77bf67c2de tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:34.707588 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-12e5a069-8d04-4fc1-9766-2f77bf67c2de tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:34.748498 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-e2ede4de-0881-4b34-b6c9-9c39baf4288c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:34.749524 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-e2ede4de-0881-4b34-b6c9-9c39baf4288c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:34.755851 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e2ede4de-0881-4b34-b6c9-9c39baf4288c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:34.756311 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e2ede4de-0881-4b34-b6c9-9c39baf4288c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:34.757094 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e2ede4de-0881-4b34-b6c9-9c39baf4288c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:34.757537 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e2ede4de-0881-4b34-b6c9-9c39baf4288c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:34.786836 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-e2ede4de-0881-4b34-b6c9-9c39baf4288c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042356 Mar 08 15:00:34.787377 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 757/1494] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:34 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 15:00:34.840951 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-75e5bbf2-3d40-42f9-ab1b-781583d0c795 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:34.841573 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-75e5bbf2-3d40-42f9-ab1b-781583d0c795 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:34.842270 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-12e5a069-8d04-4fc1-9766-2f77bf67c2de tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:34.847433 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-75e5bbf2-3d40-42f9-ab1b-781583d0c795 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:34.847889 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-75e5bbf2-3d40-42f9-ab1b-781583d0c795 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:34.848662 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-75e5bbf2-3d40-42f9-ab1b-781583d0c795 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:34.849109 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-75e5bbf2-3d40-42f9-ab1b-781583d0c795 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:34.849517 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-12e5a069-8d04-4fc1-9766-2f77bf67c2de tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.155156 Mar 08 15:00:34.850125 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 738/1495] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:34 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:34.908732 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-75e5bbf2-3d40-42f9-ab1b-781583d0c795 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:34.916539 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-75e5bbf2-3d40-42f9-ab1b-781583d0c795 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080623 Mar 08 15:00:34.917108 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 758/1496] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:34 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:00:35.454092 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-1e3ed868-af23-465b-a8f4-f49f987addcf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:35.455598 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-1e3ed868-af23-465b-a8f4-f49f987addcf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:35.462935 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1e3ed868-af23-465b-a8f4-f49f987addcf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:35.463386 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1e3ed868-af23-465b-a8f4-f49f987addcf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:35.464152 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1e3ed868-af23-465b-a8f4-f49f987addcf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:35.464619 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1e3ed868-af23-465b-a8f4-f49f987addcf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:35.492070 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-1e3ed868-af23-465b-a8f4-f49f987addcf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042103 Mar 08 15:00:35.492609 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 739/1497] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:35 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:00:35.797593 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-4787b1ab-33c5-4767-a1b2-fb5aa3d0bc94 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:35.798548 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-4787b1ab-33c5-4767-a1b2-fb5aa3d0bc94 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:35.805015 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4787b1ab-33c5-4767-a1b2-fb5aa3d0bc94 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:35.805468 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4787b1ab-33c5-4767-a1b2-fb5aa3d0bc94 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:35.806751 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4787b1ab-33c5-4767-a1b2-fb5aa3d0bc94 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:35.807194 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4787b1ab-33c5-4767-a1b2-fb5aa3d0bc94 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:35.834501 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-4787b1ab-33c5-4767-a1b2-fb5aa3d0bc94 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040861 Mar 08 15:00:35.835046 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 759/1498] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:35 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:00:35.866435 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-e3b0d368-5e3d-45a9-8f52-59394a9fed71 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:35.867049 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-e3b0d368-5e3d-45a9-8f52-59394a9fed71 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:35.873462 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e3b0d368-5e3d-45a9-8f52-59394a9fed71 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:35.873946 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e3b0d368-5e3d-45a9-8f52-59394a9fed71 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:35.874723 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e3b0d368-5e3d-45a9-8f52-59394a9fed71 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:35.875167 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e3b0d368-5e3d-45a9-8f52-59394a9fed71 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:35.933428 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5ad8169b-86e6-4d57-9bab-0efabc004863 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:35.934071 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5ad8169b-86e6-4d57-9bab-0efabc004863 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:35.939977 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5ad8169b-86e6-4d57-9bab-0efabc004863 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:35.940673 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5ad8169b-86e6-4d57-9bab-0efabc004863 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:35.941185 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5ad8169b-86e6-4d57-9bab-0efabc004863 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:35.941621 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5ad8169b-86e6-4d57-9bab-0efabc004863 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:36.000832 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-5ad8169b-86e6-4d57-9bab-0efabc004863 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:36.008063 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5ad8169b-86e6-4d57-9bab-0efabc004863 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078675 Mar 08 15:00:36.008624 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 760/1499] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:35 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:00:36.011640 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-e3b0d368-5e3d-45a9-8f52-59394a9fed71 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:36.019103 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-e3b0d368-5e3d-45a9-8f52-59394a9fed71 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.156463 Mar 08 15:00:36.019740 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 740/1500] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:35 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:36.504843 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-8786bcba-2cd9-447f-99be-0f964c016b05 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:36.505760 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-8786bcba-2cd9-447f-99be-0f964c016b05 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:36.512387 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8786bcba-2cd9-447f-99be-0f964c016b05 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:36.512847 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8786bcba-2cd9-447f-99be-0f964c016b05 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:36.513657 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8786bcba-2cd9-447f-99be-0f964c016b05 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:36.514135 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8786bcba-2cd9-447f-99be-0f964c016b05 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:36.541385 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-8786bcba-2cd9-447f-99be-0f964c016b05 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040891 Mar 08 15:00:36.541953 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 761/1501] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:36 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:00:36.846787 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-4abb881f-6149-4987-bf1c-52b810392b76 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:36.847618 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-4abb881f-6149-4987-bf1c-52b810392b76 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:36.854128 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4abb881f-6149-4987-bf1c-52b810392b76 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:36.854581 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4abb881f-6149-4987-bf1c-52b810392b76 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:36.855343 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4abb881f-6149-4987-bf1c-52b810392b76 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:36.855779 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4abb881f-6149-4987-bf1c-52b810392b76 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:36.883585 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-4abb881f-6149-4987-bf1c-52b810392b76 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040876 Mar 08 15:00:36.884245 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 741/1502] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:36 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:00:37.024425 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-186f75a6-9f07-4a00-9e29-8e520f8f8e90 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:37.025227 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-186f75a6-9f07-4a00-9e29-8e520f8f8e90 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:37.031315 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-186f75a6-9f07-4a00-9e29-8e520f8f8e90 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:37.031775 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-186f75a6-9f07-4a00-9e29-8e520f8f8e90 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:37.032551 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-186f75a6-9f07-4a00-9e29-8e520f8f8e90 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:37.032990 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-186f75a6-9f07-4a00-9e29-8e520f8f8e90 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:37.036319 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-e8b4b27b-6828-44aa-8f6a-90dff746ce7f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:37.036939 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-e8b4b27b-6828-44aa-8f6a-90dff746ce7f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:37.043258 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e8b4b27b-6828-44aa-8f6a-90dff746ce7f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:37.043712 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e8b4b27b-6828-44aa-8f6a-90dff746ce7f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:37.044476 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e8b4b27b-6828-44aa-8f6a-90dff746ce7f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:37.044911 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e8b4b27b-6828-44aa-8f6a-90dff746ce7f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:37.095653 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-186f75a6-9f07-4a00-9e29-8e520f8f8e90 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:37.103610 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-186f75a6-9f07-4a00-9e29-8e520f8f8e90 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.082419 Mar 08 15:00:37.104118 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 762/1503] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:37 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:37.183354 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-e8b4b27b-6828-44aa-8f6a-90dff746ce7f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:37.190741 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-e8b4b27b-6828-44aa-8f6a-90dff746ce7f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.158202 Mar 08 15:00:37.191304 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 742/1504] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:37 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:00:37.553662 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-2c0d5901-c8ac-4186-94cd-4f8f15213ec3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:37.554108 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-2c0d5901-c8ac-4186-94cd-4f8f15213ec3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:37.561026 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2c0d5901-c8ac-4186-94cd-4f8f15213ec3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:37.561488 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2c0d5901-c8ac-4186-94cd-4f8f15213ec3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:37.562335 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2c0d5901-c8ac-4186-94cd-4f8f15213ec3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:37.562773 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2c0d5901-c8ac-4186-94cd-4f8f15213ec3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:37.593137 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-2c0d5901-c8ac-4186-94cd-4f8f15213ec3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044354 Mar 08 15:00:37.593685 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 763/1505] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:37 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:00:37.895110 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-50abb44c-61cf-4a92-8422-ac116a4ac615 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:37.895978 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-50abb44c-61cf-4a92-8422-ac116a4ac615 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:37.903068 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-50abb44c-61cf-4a92-8422-ac116a4ac615 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:37.903526 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-50abb44c-61cf-4a92-8422-ac116a4ac615 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:37.904296 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-50abb44c-61cf-4a92-8422-ac116a4ac615 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:37.904738 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-50abb44c-61cf-4a92-8422-ac116a4ac615 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:37.932198 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-50abb44c-61cf-4a92-8422-ac116a4ac615 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041149 Mar 08 15:00:37.932748 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 743/1506] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:37 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 15:00:38.120454 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-04345af4-eb56-47a3-bc73-031954fc088e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:38.121094 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-04345af4-eb56-47a3-bc73-031954fc088e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:38.126909 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-04345af4-eb56-47a3-bc73-031954fc088e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:38.127360 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-04345af4-eb56-47a3-bc73-031954fc088e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:38.128123 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-04345af4-eb56-47a3-bc73-031954fc088e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:38.128558 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-04345af4-eb56-47a3-bc73-031954fc088e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:38.187037 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-04345af4-eb56-47a3-bc73-031954fc088e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:38.194175 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-04345af4-eb56-47a3-bc73-031954fc088e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078162 Mar 08 15:00:38.194728 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 764/1507] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:38 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:38.207703 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-15fc4a95-b0e8-482d-ba57-77ee59447b31 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:38.208351 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-15fc4a95-b0e8-482d-ba57-77ee59447b31 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:38.214526 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-15fc4a95-b0e8-482d-ba57-77ee59447b31 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:38.214976 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-15fc4a95-b0e8-482d-ba57-77ee59447b31 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:38.215742 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-15fc4a95-b0e8-482d-ba57-77ee59447b31 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:38.216177 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-15fc4a95-b0e8-482d-ba57-77ee59447b31 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:38.347466 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-15fc4a95-b0e8-482d-ba57-77ee59447b31 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:38.355187 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-15fc4a95-b0e8-482d-ba57-77ee59447b31 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.151302 Mar 08 15:00:38.355758 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 744/1508] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:38 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:38.604728 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-cdaa5fd6-1a51-4433-86df-669fc27c9af7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:38.605636 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-cdaa5fd6-1a51-4433-86df-669fc27c9af7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:38.612013 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cdaa5fd6-1a51-4433-86df-669fc27c9af7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:38.612460 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cdaa5fd6-1a51-4433-86df-669fc27c9af7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:38.613218 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cdaa5fd6-1a51-4433-86df-669fc27c9af7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:38.613651 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cdaa5fd6-1a51-4433-86df-669fc27c9af7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:38.642117 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-cdaa5fd6-1a51-4433-86df-669fc27c9af7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041358 Mar 08 15:00:38.642680 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 765/1509] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:38 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:00:38.943819 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b5ea0a96-ca67-4017-8991-6d13a97c5d73 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:38.944728 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-b5ea0a96-ca67-4017-8991-6d13a97c5d73 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:38.951800 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b5ea0a96-ca67-4017-8991-6d13a97c5d73 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:38.952247 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b5ea0a96-ca67-4017-8991-6d13a97c5d73 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:38.953013 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b5ea0a96-ca67-4017-8991-6d13a97c5d73 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:38.953452 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b5ea0a96-ca67-4017-8991-6d13a97c5d73 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:38.981647 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-b5ea0a96-ca67-4017-8991-6d13a97c5d73 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041774 Mar 08 15:00:38.982224 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 745/1510] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:38 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:00:39.211975 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-8d516f96-0ec5-4358-9f54-5807b20f323a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:39.212723 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-8d516f96-0ec5-4358-9f54-5807b20f323a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:39.218636 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8d516f96-0ec5-4358-9f54-5807b20f323a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:39.219084 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8d516f96-0ec5-4358-9f54-5807b20f323a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:39.219843 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8d516f96-0ec5-4358-9f54-5807b20f323a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:39.220281 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8d516f96-0ec5-4358-9f54-5807b20f323a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:39.281407 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-8d516f96-0ec5-4358-9f54-5807b20f323a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:39.288800 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-8d516f96-0ec5-4358-9f54-5807b20f323a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080820 Mar 08 15:00:39.289354 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 766/1511] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:39 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:39.373220 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-e98b774f-e0f1-4c46-a71b-b3aa8a45482f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:39.373830 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-e98b774f-e0f1-4c46-a71b-b3aa8a45482f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:39.379615 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e98b774f-e0f1-4c46-a71b-b3aa8a45482f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:39.380060 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e98b774f-e0f1-4c46-a71b-b3aa8a45482f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:39.380821 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e98b774f-e0f1-4c46-a71b-b3aa8a45482f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:39.381261 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e98b774f-e0f1-4c46-a71b-b3aa8a45482f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:39.516377 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-e98b774f-e0f1-4c46-a71b-b3aa8a45482f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:39.523583 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-e98b774f-e0f1-4c46-a71b-b3aa8a45482f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.155172 Mar 08 15:00:39.524141 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 746/1512] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:39 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:39.654784 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b93c7db5-a4e6-40c4-9366-2935c7fc27a1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:39.655696 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b93c7db5-a4e6-40c4-9366-2935c7fc27a1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:39.661868 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b93c7db5-a4e6-40c4-9366-2935c7fc27a1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:39.662326 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b93c7db5-a4e6-40c4-9366-2935c7fc27a1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:39.663087 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b93c7db5-a4e6-40c4-9366-2935c7fc27a1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:39.663521 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b93c7db5-a4e6-40c4-9366-2935c7fc27a1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:39.692041 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b93c7db5-a4e6-40c4-9366-2935c7fc27a1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041391 Mar 08 15:00:39.692608 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 767/1513] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:39 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:00:39.993056 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-6c7bc335-ef82-459b-9b66-a8231d6231d4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:39.994228 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-6c7bc335-ef82-459b-9b66-a8231d6231d4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:40.000436 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6c7bc335-ef82-459b-9b66-a8231d6231d4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:40.000882 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6c7bc335-ef82-459b-9b66-a8231d6231d4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:40.001640 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6c7bc335-ef82-459b-9b66-a8231d6231d4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:40.002097 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6c7bc335-ef82-459b-9b66-a8231d6231d4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:40.029920 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-6c7bc335-ef82-459b-9b66-a8231d6231d4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040778 Mar 08 15:00:40.030467 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 747/1514] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:39 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:00:40.307714 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ebb33972-0944-49ba-953a-bfff2407099c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:40.308353 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ebb33972-0944-49ba-953a-bfff2407099c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:40.314151 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ebb33972-0944-49ba-953a-bfff2407099c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:40.314598 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ebb33972-0944-49ba-953a-bfff2407099c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:40.315352 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ebb33972-0944-49ba-953a-bfff2407099c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:40.315785 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ebb33972-0944-49ba-953a-bfff2407099c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:40.375961 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ebb33972-0944-49ba-953a-bfff2407099c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:40.383297 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ebb33972-0944-49ba-953a-bfff2407099c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080122 Mar 08 15:00:40.383856 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 768/1515] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:40 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:40.541207 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b619dd3f-331b-4cf4-8b0f-7a8d470ad100 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:40.541833 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-b619dd3f-331b-4cf4-8b0f-7a8d470ad100 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:40.547616 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b619dd3f-331b-4cf4-8b0f-7a8d470ad100 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:40.548064 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b619dd3f-331b-4cf4-8b0f-7a8d470ad100 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:40.548823 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b619dd3f-331b-4cf4-8b0f-7a8d470ad100 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:40.549254 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b619dd3f-331b-4cf4-8b0f-7a8d470ad100 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:40.684552 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-b619dd3f-331b-4cf4-8b0f-7a8d470ad100 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:40.691820 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-b619dd3f-331b-4cf4-8b0f-7a8d470ad100 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.154874 Mar 08 15:00:40.692391 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 748/1516] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:40 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:00:40.703452 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-909b0679-4409-4336-a71b-9087b6e65c67 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:40.704368 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-909b0679-4409-4336-a71b-9087b6e65c67 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:40.710674 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-909b0679-4409-4336-a71b-9087b6e65c67 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:40.711137 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-909b0679-4409-4336-a71b-9087b6e65c67 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:40.711913 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-909b0679-4409-4336-a71b-9087b6e65c67 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:40.712682 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-909b0679-4409-4336-a71b-9087b6e65c67 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:40.740810 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-909b0679-4409-4336-a71b-9087b6e65c67 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041286 Mar 08 15:00:40.741353 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 769/1517] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:40 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:00:41.040730 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-bbc73d26-7729-4b06-a5ea-5351a90ce60b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:41.041635 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-bbc73d26-7729-4b06-a5ea-5351a90ce60b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:41.047829 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bbc73d26-7729-4b06-a5ea-5351a90ce60b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:41.048281 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bbc73d26-7729-4b06-a5ea-5351a90ce60b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:41.049051 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bbc73d26-7729-4b06-a5ea-5351a90ce60b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:41.049487 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bbc73d26-7729-4b06-a5ea-5351a90ce60b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:41.077782 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-bbc73d26-7729-4b06-a5ea-5351a90ce60b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041018 Mar 08 15:00:41.078366 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 749/1518] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:41 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:00:41.400263 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5ff03730-4ade-4cfd-83f7-3c19f8163a93 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:41.400872 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5ff03730-4ade-4cfd-83f7-3c19f8163a93 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:41.406767 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5ff03730-4ade-4cfd-83f7-3c19f8163a93 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:41.407215 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5ff03730-4ade-4cfd-83f7-3c19f8163a93 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:41.407978 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5ff03730-4ade-4cfd-83f7-3c19f8163a93 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:41.408413 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5ff03730-4ade-4cfd-83f7-3c19f8163a93 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:41.466044 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-5ff03730-4ade-4cfd-83f7-3c19f8163a93 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:41.473152 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5ff03730-4ade-4cfd-83f7-3c19f8163a93 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.076854 Mar 08 15:00:41.473704 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 770/1519] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:41 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:41.708462 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-2ea4e7b8-18cd-4651-a0e9-9d7a49f94969 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:41.708994 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-2ea4e7b8-18cd-4651-a0e9-9d7a49f94969 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:41.715373 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2ea4e7b8-18cd-4651-a0e9-9d7a49f94969 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:41.715822 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2ea4e7b8-18cd-4651-a0e9-9d7a49f94969 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:41.716583 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2ea4e7b8-18cd-4651-a0e9-9d7a49f94969 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:41.717018 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2ea4e7b8-18cd-4651-a0e9-9d7a49f94969 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:41.752679 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-761d545c-9bf6-45df-b470-50262f008bef tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:41.753631 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-761d545c-9bf6-45df-b470-50262f008bef tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:41.760143 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-761d545c-9bf6-45df-b470-50262f008bef tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:41.760594 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-761d545c-9bf6-45df-b470-50262f008bef tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:41.761374 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-761d545c-9bf6-45df-b470-50262f008bef tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:41.761809 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-761d545c-9bf6-45df-b470-50262f008bef tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:41.790948 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-761d545c-9bf6-45df-b470-50262f008bef tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041486 Mar 08 15:00:41.791524 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 771/1520] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:41 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 15:00:41.855381 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-2ea4e7b8-18cd-4651-a0e9-9d7a49f94969 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:41.862681 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-2ea4e7b8-18cd-4651-a0e9-9d7a49f94969 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.158132 Mar 08 15:00:41.863242 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 750/1521] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:41 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:42.090122 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-1eaae864-c191-4116-83fd-751002e2c2c3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:42.091043 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-1eaae864-c191-4116-83fd-751002e2c2c3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:42.096909 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1eaae864-c191-4116-83fd-751002e2c2c3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:42.097360 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1eaae864-c191-4116-83fd-751002e2c2c3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:42.098165 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1eaae864-c191-4116-83fd-751002e2c2c3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:42.098607 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1eaae864-c191-4116-83fd-751002e2c2c3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:42.125607 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-1eaae864-c191-4116-83fd-751002e2c2c3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040219 Mar 08 15:00:42.126257 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 772/1522] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:42 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:00:42.490631 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-45393504-af76-409e-8e0d-43c99cf4605a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:42.491255 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-45393504-af76-409e-8e0d-43c99cf4605a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:42.498536 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-45393504-af76-409e-8e0d-43c99cf4605a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:42.498991 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-45393504-af76-409e-8e0d-43c99cf4605a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:42.499761 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-45393504-af76-409e-8e0d-43c99cf4605a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:42.500239 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-45393504-af76-409e-8e0d-43c99cf4605a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:42.560406 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-45393504-af76-409e-8e0d-43c99cf4605a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:42.567617 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-45393504-af76-409e-8e0d-43c99cf4605a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080830 Mar 08 15:00:42.568173 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 751/1523] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:42 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:42.802467 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-e9108063-1971-455c-ab19-c48b05679d0e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:42.803299 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-e9108063-1971-455c-ab19-c48b05679d0e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:42.810515 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e9108063-1971-455c-ab19-c48b05679d0e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:42.810966 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e9108063-1971-455c-ab19-c48b05679d0e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:42.811729 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e9108063-1971-455c-ab19-c48b05679d0e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:42.812162 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e9108063-1971-455c-ab19-c48b05679d0e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:42.839736 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-e9108063-1971-455c-ab19-c48b05679d0e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041594 Mar 08 15:00:42.840267 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 773/1524] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:42 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:00:42.878740 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-4b8b31ab-5fb3-4c1f-b8bc-ddf800d99f5d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:42.879376 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-4b8b31ab-5fb3-4c1f-b8bc-ddf800d99f5d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:42.885375 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4b8b31ab-5fb3-4c1f-b8bc-ddf800d99f5d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:42.885824 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4b8b31ab-5fb3-4c1f-b8bc-ddf800d99f5d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:42.886644 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4b8b31ab-5fb3-4c1f-b8bc-ddf800d99f5d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:42.887093 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4b8b31ab-5fb3-4c1f-b8bc-ddf800d99f5d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:43.018122 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-4b8b31ab-5fb3-4c1f-b8bc-ddf800d99f5d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:43.025439 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-4b8b31ab-5fb3-4c1f-b8bc-ddf800d99f5d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.150488 Mar 08 15:00:43.026022 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 752/1525] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:42 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:43.136720 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-8015116c-7db9-4aca-acf1-a194aa24423a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:43.137636 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-8015116c-7db9-4aca-acf1-a194aa24423a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:43.143353 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8015116c-7db9-4aca-acf1-a194aa24423a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:43.143799 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8015116c-7db9-4aca-acf1-a194aa24423a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:43.144562 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8015116c-7db9-4aca-acf1-a194aa24423a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:43.144995 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8015116c-7db9-4aca-acf1-a194aa24423a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:43.172087 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-8015116c-7db9-4aca-acf1-a194aa24423a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039420 Mar 08 15:00:43.172627 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 774/1526] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:43 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:00:43.587351 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b0099719-b5ae-4162-800a-a11f3df2bc00 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:43.588020 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-b0099719-b5ae-4162-800a-a11f3df2bc00 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:43.595006 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b0099719-b5ae-4162-800a-a11f3df2bc00 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:43.595487 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b0099719-b5ae-4162-800a-a11f3df2bc00 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:43.596263 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b0099719-b5ae-4162-800a-a11f3df2bc00 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:43.596712 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b0099719-b5ae-4162-800a-a11f3df2bc00 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:43.655724 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-b0099719-b5ae-4162-800a-a11f3df2bc00 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:43.663033 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-b0099719-b5ae-4162-800a-a11f3df2bc00 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079765 Mar 08 15:00:43.663596 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 753/1527] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:43 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:43.851439 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-7b212927-e704-424b-92ea-72f7286f53e7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:43.852277 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-7b212927-e704-424b-92ea-72f7286f53e7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:43.859200 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7b212927-e704-424b-92ea-72f7286f53e7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:43.859656 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7b212927-e704-424b-92ea-72f7286f53e7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:43.860428 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7b212927-e704-424b-92ea-72f7286f53e7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:43.860871 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7b212927-e704-424b-92ea-72f7286f53e7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:43.889758 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-7b212927-e704-424b-92ea-72f7286f53e7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042456 Mar 08 15:00:43.890323 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 775/1528] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:43 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:00:44.042356 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-61fd4567-679f-4def-a5e0-395a3384a2d9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:44.042970 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-61fd4567-679f-4def-a5e0-395a3384a2d9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:44.048793 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-61fd4567-679f-4def-a5e0-395a3384a2d9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:44.049249 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-61fd4567-679f-4def-a5e0-395a3384a2d9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:44.050046 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-61fd4567-679f-4def-a5e0-395a3384a2d9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:44.050491 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-61fd4567-679f-4def-a5e0-395a3384a2d9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:44.184135 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b37cf2e7-dd7d-47f9-aabf-04576c1552be tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:44.185062 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b37cf2e7-dd7d-47f9-aabf-04576c1552be tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:44.189014 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-61fd4567-679f-4def-a5e0-395a3384a2d9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:44.190847 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b37cf2e7-dd7d-47f9-aabf-04576c1552be tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:44.191297 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b37cf2e7-dd7d-47f9-aabf-04576c1552be tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:44.192088 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b37cf2e7-dd7d-47f9-aabf-04576c1552be tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:44.192516 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b37cf2e7-dd7d-47f9-aabf-04576c1552be tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:44.197018 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-61fd4567-679f-4def-a5e0-395a3384a2d9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.158168 Mar 08 15:00:44.198009 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 754/1529] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:44 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:44.221989 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b37cf2e7-dd7d-47f9-aabf-04576c1552be tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042604 Mar 08 15:00:44.222547 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 776/1530] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:44 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 15:00:44.679938 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-fa1c4548-e13d-4365-9e2c-14a99195ab55 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:44.680567 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-fa1c4548-e13d-4365-9e2c-14a99195ab55 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:44.687025 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fa1c4548-e13d-4365-9e2c-14a99195ab55 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:44.687488 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fa1c4548-e13d-4365-9e2c-14a99195ab55 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:44.688269 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fa1c4548-e13d-4365-9e2c-14a99195ab55 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:44.688715 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fa1c4548-e13d-4365-9e2c-14a99195ab55 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:44.748714 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-fa1c4548-e13d-4365-9e2c-14a99195ab55 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:44.756034 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-fa1c4548-e13d-4365-9e2c-14a99195ab55 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080258 Mar 08 15:00:44.756615 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 755/1531] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:44 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:44.901705 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5b4a97a5-528d-48ea-b4c3-d75e79cee74c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:44.902699 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5b4a97a5-528d-48ea-b4c3-d75e79cee74c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:44.909259 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5b4a97a5-528d-48ea-b4c3-d75e79cee74c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:44.909714 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5b4a97a5-528d-48ea-b4c3-d75e79cee74c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:44.910556 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5b4a97a5-528d-48ea-b4c3-d75e79cee74c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:44.911022 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5b4a97a5-528d-48ea-b4c3-d75e79cee74c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:44.939977 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5b4a97a5-528d-48ea-b4c3-d75e79cee74c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042595 Mar 08 15:00:44.940743 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 777/1532] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:44 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:00:45.216856 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-15a1f2e7-b436-4c9b-9e9e-0b9b4afddeef tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:45.217386 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-15a1f2e7-b436-4c9b-9e9e-0b9b4afddeef tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:45.223405 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-15a1f2e7-b436-4c9b-9e9e-0b9b4afddeef tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:45.223864 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-15a1f2e7-b436-4c9b-9e9e-0b9b4afddeef tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:45.224635 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-15a1f2e7-b436-4c9b-9e9e-0b9b4afddeef tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:45.225078 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-15a1f2e7-b436-4c9b-9e9e-0b9b4afddeef tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:45.233690 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-a06ea9eb-938f-43f4-819d-dc39eca1d6a3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:45.234636 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-a06ea9eb-938f-43f4-819d-dc39eca1d6a3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:45.240403 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a06ea9eb-938f-43f4-819d-dc39eca1d6a3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:45.240865 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a06ea9eb-938f-43f4-819d-dc39eca1d6a3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:45.241644 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a06ea9eb-938f-43f4-819d-dc39eca1d6a3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:45.242121 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a06ea9eb-938f-43f4-819d-dc39eca1d6a3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:45.272088 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-a06ea9eb-938f-43f4-819d-dc39eca1d6a3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042529 Mar 08 15:00:45.272671 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 778/1533] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:45 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 15:00:45.361264 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-15a1f2e7-b436-4c9b-9e9e-0b9b4afddeef tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:45.369225 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-15a1f2e7-b436-4c9b-9e9e-0b9b4afddeef tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.155787 Mar 08 15:00:45.369787 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 756/1534] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:45 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:45.777447 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ca270fdb-a26d-4480-b4b7-e8494cc2338c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:45.778091 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ca270fdb-a26d-4480-b4b7-e8494cc2338c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:45.783938 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ca270fdb-a26d-4480-b4b7-e8494cc2338c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:45.784385 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ca270fdb-a26d-4480-b4b7-e8494cc2338c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:45.785152 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ca270fdb-a26d-4480-b4b7-e8494cc2338c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:45.785585 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ca270fdb-a26d-4480-b4b7-e8494cc2338c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:45.844519 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ca270fdb-a26d-4480-b4b7-e8494cc2338c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:45.851664 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ca270fdb-a26d-4480-b4b7-e8494cc2338c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.083165 Mar 08 15:00:45.852222 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 779/1535] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:45 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:45.951681 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-03b92201-a445-4b3c-af43-fd3b2c79cb4b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:45.952608 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-03b92201-a445-4b3c-af43-fd3b2c79cb4b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:45.958933 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-03b92201-a445-4b3c-af43-fd3b2c79cb4b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:45.959393 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-03b92201-a445-4b3c-af43-fd3b2c79cb4b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:45.960161 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-03b92201-a445-4b3c-af43-fd3b2c79cb4b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:45.960611 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-03b92201-a445-4b3c-af43-fd3b2c79cb4b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:45.988433 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-03b92201-a445-4b3c-af43-fd3b2c79cb4b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040921 Mar 08 15:00:45.988974 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 757/1536] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:45 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:00:46.283749 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-4854b5fa-d1f5-4899-8ca6-5961530f73c9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:46.284664 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-4854b5fa-d1f5-4899-8ca6-5961530f73c9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:46.291635 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4854b5fa-d1f5-4899-8ca6-5961530f73c9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:46.292085 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4854b5fa-d1f5-4899-8ca6-5961530f73c9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:46.292846 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4854b5fa-d1f5-4899-8ca6-5961530f73c9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:46.293279 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4854b5fa-d1f5-4899-8ca6-5961530f73c9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:46.320231 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-4854b5fa-d1f5-4899-8ca6-5961530f73c9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040449 Mar 08 15:00:46.320770 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 780/1537] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:46 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:00:46.386600 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b47f443d-1546-42da-9c4c-12b2582f83f5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:46.387208 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-b47f443d-1546-42da-9c4c-12b2582f83f5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:46.393036 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b47f443d-1546-42da-9c4c-12b2582f83f5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:46.393491 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b47f443d-1546-42da-9c4c-12b2582f83f5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:46.394296 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b47f443d-1546-42da-9c4c-12b2582f83f5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:46.394740 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b47f443d-1546-42da-9c4c-12b2582f83f5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:46.530650 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-b47f443d-1546-42da-9c4c-12b2582f83f5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:46.538134 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-b47f443d-1546-42da-9c4c-12b2582f83f5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.155900 Mar 08 15:00:46.538642 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 758/1538] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:46 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:46.868485 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-413ed61a-e9a7-496b-8ef8-24e726c69562 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:46.869065 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-413ed61a-e9a7-496b-8ef8-24e726c69562 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:46.874920 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-413ed61a-e9a7-496b-8ef8-24e726c69562 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:46.875369 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-413ed61a-e9a7-496b-8ef8-24e726c69562 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:46.876128 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-413ed61a-e9a7-496b-8ef8-24e726c69562 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:46.876562 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-413ed61a-e9a7-496b-8ef8-24e726c69562 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:46.938932 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-413ed61a-e9a7-496b-8ef8-24e726c69562 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:46.946838 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-413ed61a-e9a7-496b-8ef8-24e726c69562 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081711 Mar 08 15:00:46.947506 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 781/1539] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:46 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:47.000526 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-cfb14c37-4814-4e98-8935-e575b1cb9436 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:47.001433 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-cfb14c37-4814-4e98-8935-e575b1cb9436 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:47.008088 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cfb14c37-4814-4e98-8935-e575b1cb9436 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:47.008548 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cfb14c37-4814-4e98-8935-e575b1cb9436 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:47.010145 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cfb14c37-4814-4e98-8935-e575b1cb9436 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:47.010590 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cfb14c37-4814-4e98-8935-e575b1cb9436 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:47.038019 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-cfb14c37-4814-4e98-8935-e575b1cb9436 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041424 Mar 08 15:00:47.038563 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 759/1540] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:46 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:00:47.332024 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-7d489767-8038-42a4-983f-6a440342a32b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:47.332950 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-7d489767-8038-42a4-983f-6a440342a32b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:47.340186 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7d489767-8038-42a4-983f-6a440342a32b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:47.340641 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7d489767-8038-42a4-983f-6a440342a32b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:47.341419 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7d489767-8038-42a4-983f-6a440342a32b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:47.341910 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7d489767-8038-42a4-983f-6a440342a32b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:47.371146 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-7d489767-8038-42a4-983f-6a440342a32b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043217 Mar 08 15:00:47.371704 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 782/1541] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:47 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:00:47.556002 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-8f317ca0-b576-4467-a2dc-b7cea38a605c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:47.556747 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-8f317ca0-b576-4467-a2dc-b7cea38a605c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:47.563539 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8f317ca0-b576-4467-a2dc-b7cea38a605c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:47.563991 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8f317ca0-b576-4467-a2dc-b7cea38a605c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:47.564756 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8f317ca0-b576-4467-a2dc-b7cea38a605c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:47.565193 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8f317ca0-b576-4467-a2dc-b7cea38a605c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:47.698518 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-8f317ca0-b576-4467-a2dc-b7cea38a605c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:47.705768 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-8f317ca0-b576-4467-a2dc-b7cea38a605c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.154114 Mar 08 15:00:47.706364 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 760/1542] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:47 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:47.964463 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-70e2438c-5d32-4f72-95fa-afaf883d3902 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:47.965102 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-70e2438c-5d32-4f72-95fa-afaf883d3902 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:47.970968 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-70e2438c-5d32-4f72-95fa-afaf883d3902 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:47.971422 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-70e2438c-5d32-4f72-95fa-afaf883d3902 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:47.972184 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-70e2438c-5d32-4f72-95fa-afaf883d3902 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:47.972624 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-70e2438c-5d32-4f72-95fa-afaf883d3902 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:48.030805 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-70e2438c-5d32-4f72-95fa-afaf883d3902 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:48.038073 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-70e2438c-5d32-4f72-95fa-afaf883d3902 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078037 Mar 08 15:00:48.038634 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 783/1543] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:47 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:48.049082 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-47903ba6-6601-40aa-9980-b1987c902631 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:48.050030 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-47903ba6-6601-40aa-9980-b1987c902631 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:48.056829 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-47903ba6-6601-40aa-9980-b1987c902631 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:48.057281 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-47903ba6-6601-40aa-9980-b1987c902631 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:48.058092 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-47903ba6-6601-40aa-9980-b1987c902631 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:48.058528 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-47903ba6-6601-40aa-9980-b1987c902631 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:48.086401 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-47903ba6-6601-40aa-9980-b1987c902631 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041220 Mar 08 15:00:48.087636 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 761/1544] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:48 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:00:48.382883 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-9752b7cf-2fda-451c-b54b-42dc50e25a8d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:48.384396 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-9752b7cf-2fda-451c-b54b-42dc50e25a8d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:48.390669 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9752b7cf-2fda-451c-b54b-42dc50e25a8d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:48.391121 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9752b7cf-2fda-451c-b54b-42dc50e25a8d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:48.391880 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9752b7cf-2fda-451c-b54b-42dc50e25a8d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:48.392320 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9752b7cf-2fda-451c-b54b-42dc50e25a8d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:48.419866 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-9752b7cf-2fda-451c-b54b-42dc50e25a8d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041112 Mar 08 15:00:48.420413 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 784/1545] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:48 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:00:48.723152 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-80880e77-7d15-4abd-8b74-68b31b4fe036 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:48.723682 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-80880e77-7d15-4abd-8b74-68b31b4fe036 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:48.730700 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-80880e77-7d15-4abd-8b74-68b31b4fe036 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:48.731196 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-80880e77-7d15-4abd-8b74-68b31b4fe036 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:48.731962 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-80880e77-7d15-4abd-8b74-68b31b4fe036 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:48.732395 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-80880e77-7d15-4abd-8b74-68b31b4fe036 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:48.869027 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-80880e77-7d15-4abd-8b74-68b31b4fe036 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:48.876320 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-80880e77-7d15-4abd-8b74-68b31b4fe036 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.157156 Mar 08 15:00:48.876876 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 762/1546] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:48 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:49.056419 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-18c7470a-3619-44c0-91e3-22beaa8e40cb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:49.057095 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-18c7470a-3619-44c0-91e3-22beaa8e40cb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:49.062957 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-18c7470a-3619-44c0-91e3-22beaa8e40cb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:49.063417 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-18c7470a-3619-44c0-91e3-22beaa8e40cb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:49.064189 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-18c7470a-3619-44c0-91e3-22beaa8e40cb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:49.064658 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-18c7470a-3619-44c0-91e3-22beaa8e40cb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:49.098886 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-ccdeda24-c0d7-4349-b8b0-3b893c84838e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:49.099903 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-ccdeda24-c0d7-4349-b8b0-3b893c84838e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:49.108531 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ccdeda24-c0d7-4349-b8b0-3b893c84838e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:49.108768 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ccdeda24-c0d7-4349-b8b0-3b893c84838e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:49.109655 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ccdeda24-c0d7-4349-b8b0-3b893c84838e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:49.110187 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ccdeda24-c0d7-4349-b8b0-3b893c84838e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:49.124787 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-18c7470a-3619-44c0-91e3-22beaa8e40cb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:49.132100 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-18c7470a-3619-44c0-91e3-22beaa8e40cb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080393 Mar 08 15:00:49.132664 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 785/1547] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:49 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:49.142832 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-ccdeda24-c0d7-4349-b8b0-3b893c84838e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047915 Mar 08 15:00:49.143389 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 763/1548] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:49 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 15:00:49.431795 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-61c9edef-331d-4a1b-a526-37879c29a6e5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:49.432631 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-61c9edef-331d-4a1b-a526-37879c29a6e5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:49.438955 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-61c9edef-331d-4a1b-a526-37879c29a6e5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:49.439415 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-61c9edef-331d-4a1b-a526-37879c29a6e5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:49.440190 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-61c9edef-331d-4a1b-a526-37879c29a6e5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:49.440646 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-61c9edef-331d-4a1b-a526-37879c29a6e5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:49.468454 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-61c9edef-331d-4a1b-a526-37879c29a6e5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040762 Mar 08 15:00:49.469000 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 786/1549] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:49 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:00:49.893027 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-fef2cced-d119-4d54-a90e-78d8da04f767 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:49.893646 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-fef2cced-d119-4d54-a90e-78d8da04f767 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:49.900717 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fef2cced-d119-4d54-a90e-78d8da04f767 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:49.901180 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fef2cced-d119-4d54-a90e-78d8da04f767 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:49.901982 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fef2cced-d119-4d54-a90e-78d8da04f767 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:49.902424 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fef2cced-d119-4d54-a90e-78d8da04f767 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:50.038279 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-fef2cced-d119-4d54-a90e-78d8da04f767 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:50.045904 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-fef2cced-d119-4d54-a90e-78d8da04f767 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.156806 Mar 08 15:00:50.046473 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 764/1550] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:49 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:50.148527 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-737db2bf-b3f1-4ffe-be3a-73e823a514ac tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:50.149057 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-737db2bf-b3f1-4ffe-be3a-73e823a514ac tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:50.154366 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-50cfa262-137e-4db6-9889-f227a6b19c3f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:50.155116 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-737db2bf-b3f1-4ffe-be3a-73e823a514ac tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:50.155273 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-50cfa262-137e-4db6-9889-f227a6b19c3f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:50.155573 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-737db2bf-b3f1-4ffe-be3a-73e823a514ac tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:50.156345 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-737db2bf-b3f1-4ffe-be3a-73e823a514ac tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:50.156781 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-737db2bf-b3f1-4ffe-be3a-73e823a514ac tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:50.161566 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-50cfa262-137e-4db6-9889-f227a6b19c3f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:50.162056 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-50cfa262-137e-4db6-9889-f227a6b19c3f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:50.162834 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-50cfa262-137e-4db6-9889-f227a6b19c3f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:50.163305 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-50cfa262-137e-4db6-9889-f227a6b19c3f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:50.193505 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-50cfa262-137e-4db6-9889-f227a6b19c3f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042974 Mar 08 15:00:50.194445 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 765/1551] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:50 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:00:50.216978 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-737db2bf-b3f1-4ffe-be3a-73e823a514ac tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:50.224237 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-737db2bf-b3f1-4ffe-be3a-73e823a514ac tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079696 Mar 08 15:00:50.224793 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 787/1552] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:50 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:50.480508 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b0b880fb-81cb-43ba-800a-8c69c059b73e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:50.481418 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-b0b880fb-81cb-43ba-800a-8c69c059b73e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:50.487498 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b0b880fb-81cb-43ba-800a-8c69c059b73e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:50.487953 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b0b880fb-81cb-43ba-800a-8c69c059b73e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:50.488716 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b0b880fb-81cb-43ba-800a-8c69c059b73e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:50.489155 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b0b880fb-81cb-43ba-800a-8c69c059b73e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:50.516538 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-b0b880fb-81cb-43ba-800a-8c69c059b73e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040578 Mar 08 15:00:50.517082 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 766/1553] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:50 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:00:51.062940 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-636602cc-d09c-41d3-b2fc-0341fed320de tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:51.063555 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-636602cc-d09c-41d3-b2fc-0341fed320de tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:51.069871 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-636602cc-d09c-41d3-b2fc-0341fed320de tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:51.070336 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-636602cc-d09c-41d3-b2fc-0341fed320de tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:51.071105 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-636602cc-d09c-41d3-b2fc-0341fed320de tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:51.072234 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-636602cc-d09c-41d3-b2fc-0341fed320de tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:51.204755 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-636602cc-d09c-41d3-b2fc-0341fed320de tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:51.205399 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-83ebdf32-0562-4d69-9061-1ecc4c81173a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:51.206334 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-83ebdf32-0562-4d69-9061-1ecc4c81173a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:51.212259 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-636602cc-d09c-41d3-b2fc-0341fed320de tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.153113 Mar 08 15:00:51.212642 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-83ebdf32-0562-4d69-9061-1ecc4c81173a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:51.212816 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 788/1554] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:51 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:51.213401 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-83ebdf32-0562-4d69-9061-1ecc4c81173a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:51.214200 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-83ebdf32-0562-4d69-9061-1ecc4c81173a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:51.214638 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-83ebdf32-0562-4d69-9061-1ecc4c81173a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:51.240267 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-73a99697-10cb-45d3-8b60-9c1af5267d93 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:51.240875 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-73a99697-10cb-45d3-8b60-9c1af5267d93 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:51.243042 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-83ebdf32-0562-4d69-9061-1ecc4c81173a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041618 Mar 08 15:00:51.244410 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 767/1555] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:51 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 15:00:51.247792 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-73a99697-10cb-45d3-8b60-9c1af5267d93 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:51.248244 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-73a99697-10cb-45d3-8b60-9c1af5267d93 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:51.249015 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-73a99697-10cb-45d3-8b60-9c1af5267d93 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:51.249453 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-73a99697-10cb-45d3-8b60-9c1af5267d93 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:51.311104 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-73a99697-10cb-45d3-8b60-9c1af5267d93 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:51.318323 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-73a99697-10cb-45d3-8b60-9c1af5267d93 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081804 Mar 08 15:00:51.318876 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 789/1556] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:51 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:00:51.528527 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b683f28b-da48-4d24-9e96-e4b736f4fd8a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:51.529474 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-b683f28b-da48-4d24-9e96-e4b736f4fd8a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:51.535343 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b683f28b-da48-4d24-9e96-e4b736f4fd8a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:51.535799 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b683f28b-da48-4d24-9e96-e4b736f4fd8a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:51.536563 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b683f28b-da48-4d24-9e96-e4b736f4fd8a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:51.537004 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b683f28b-da48-4d24-9e96-e4b736f4fd8a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:51.565349 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-b683f28b-da48-4d24-9e96-e4b736f4fd8a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041329 Mar 08 15:00:51.565911 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 768/1557] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:51 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:00:52.228932 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f08deffd-3afb-4cad-98af-9fe325a8db02 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:52.229550 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f08deffd-3afb-4cad-98af-9fe325a8db02 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:52.237836 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f08deffd-3afb-4cad-98af-9fe325a8db02 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:52.238331 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f08deffd-3afb-4cad-98af-9fe325a8db02 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:52.239131 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f08deffd-3afb-4cad-98af-9fe325a8db02 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:52.239575 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f08deffd-3afb-4cad-98af-9fe325a8db02 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:52.255612 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-f3c41390-2596-48b9-8f07-bd93dbb76601 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:52.256540 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-f3c41390-2596-48b9-8f07-bd93dbb76601 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:52.263287 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f3c41390-2596-48b9-8f07-bd93dbb76601 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:52.263743 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f3c41390-2596-48b9-8f07-bd93dbb76601 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:52.264517 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f3c41390-2596-48b9-8f07-bd93dbb76601 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:52.264954 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f3c41390-2596-48b9-8f07-bd93dbb76601 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:52.303352 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-f3c41390-2596-48b9-8f07-bd93dbb76601 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051754 Mar 08 15:00:52.303938 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 769/1558] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:52 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 15:00:52.334489 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-2b8eeb2d-0534-45e1-ab29-fe46022dc55a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:52.335155 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-2b8eeb2d-0534-45e1-ab29-fe46022dc55a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:52.341901 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2b8eeb2d-0534-45e1-ab29-fe46022dc55a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:52.342394 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2b8eeb2d-0534-45e1-ab29-fe46022dc55a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:52.343102 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2b8eeb2d-0534-45e1-ab29-fe46022dc55a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:52.343540 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2b8eeb2d-0534-45e1-ab29-fe46022dc55a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:52.378947 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f08deffd-3afb-4cad-98af-9fe325a8db02 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:52.387739 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f08deffd-3afb-4cad-98af-9fe325a8db02 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.163080 Mar 08 15:00:52.388324 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 790/1559] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:52 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:52.403811 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-2b8eeb2d-0534-45e1-ab29-fe46022dc55a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:52.411353 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-2b8eeb2d-0534-45e1-ab29-fe46022dc55a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080711 Mar 08 15:00:52.411916 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 770/1560] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:52 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:00:52.577196 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-98603dd2-cadd-454b-b69d-e0a721cb7429 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:52.578074 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-98603dd2-cadd-454b-b69d-e0a721cb7429 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:52.583803 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-98603dd2-cadd-454b-b69d-e0a721cb7429 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:52.584254 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-98603dd2-cadd-454b-b69d-e0a721cb7429 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:52.585016 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-98603dd2-cadd-454b-b69d-e0a721cb7429 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:52.585452 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-98603dd2-cadd-454b-b69d-e0a721cb7429 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:52.612682 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-98603dd2-cadd-454b-b69d-e0a721cb7429 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039518 Mar 08 15:00:52.613219 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 791/1561] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:52 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:00:53.315765 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-ba34497c-7a1c-4296-80f9-0349020ef4ce tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:53.316763 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-ba34497c-7a1c-4296-80f9-0349020ef4ce tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:53.323966 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ba34497c-7a1c-4296-80f9-0349020ef4ce tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:53.324428 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ba34497c-7a1c-4296-80f9-0349020ef4ce tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:53.325201 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ba34497c-7a1c-4296-80f9-0349020ef4ce tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:53.325658 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ba34497c-7a1c-4296-80f9-0349020ef4ce tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:53.355094 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-ba34497c-7a1c-4296-80f9-0349020ef4ce tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043737 Mar 08 15:00:53.355651 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 771/1562] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:53 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:00:53.405109 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f17d8a24-8577-4421-8e92-b17b9fb60706 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:53.405716 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f17d8a24-8577-4421-8e92-b17b9fb60706 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:53.411935 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f17d8a24-8577-4421-8e92-b17b9fb60706 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:53.412383 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f17d8a24-8577-4421-8e92-b17b9fb60706 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:53.413140 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f17d8a24-8577-4421-8e92-b17b9fb60706 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:53.413590 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f17d8a24-8577-4421-8e92-b17b9fb60706 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:53.428526 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-c759debf-c673-4fbf-890a-8cd6bde648d6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:53.429142 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-c759debf-c673-4fbf-890a-8cd6bde648d6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:53.435081 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c759debf-c673-4fbf-890a-8cd6bde648d6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:53.435544 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c759debf-c673-4fbf-890a-8cd6bde648d6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:53.436326 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c759debf-c673-4fbf-890a-8cd6bde648d6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:53.436768 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c759debf-c673-4fbf-890a-8cd6bde648d6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:53.498924 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-c759debf-c673-4fbf-890a-8cd6bde648d6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:53.506394 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-c759debf-c673-4fbf-890a-8cd6bde648d6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081862 Mar 08 15:00:53.506964 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 772/1563] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:53 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:00:53.548097 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f17d8a24-8577-4421-8e92-b17b9fb60706 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:53.555569 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f17d8a24-8577-4421-8e92-b17b9fb60706 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.154293 Mar 08 15:00:53.556358 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 792/1564] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:53 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:53.624408 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-9b5a8e29-c3a4-440e-9079-29517e1cbf6f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:53.625271 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-9b5a8e29-c3a4-440e-9079-29517e1cbf6f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:53.631201 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9b5a8e29-c3a4-440e-9079-29517e1cbf6f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:53.631659 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9b5a8e29-c3a4-440e-9079-29517e1cbf6f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:53.632440 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9b5a8e29-c3a4-440e-9079-29517e1cbf6f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:53.632938 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9b5a8e29-c3a4-440e-9079-29517e1cbf6f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:53.661272 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-9b5a8e29-c3a4-440e-9079-29517e1cbf6f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041201 Mar 08 15:00:53.661811 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 773/1565] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:53 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:00:54.366630 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-dcc069b6-ee19-4fd2-b71d-66c1c7b9f287 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:54.367534 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-dcc069b6-ee19-4fd2-b71d-66c1c7b9f287 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:54.374126 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dcc069b6-ee19-4fd2-b71d-66c1c7b9f287 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:54.374583 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dcc069b6-ee19-4fd2-b71d-66c1c7b9f287 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:54.375373 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dcc069b6-ee19-4fd2-b71d-66c1c7b9f287 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:54.375809 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dcc069b6-ee19-4fd2-b71d-66c1c7b9f287 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:54.403292 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-dcc069b6-ee19-4fd2-b71d-66c1c7b9f287 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040632 Mar 08 15:00:54.403832 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 793/1566] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:54 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:00:54.523762 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-f9d41abf-e516-4bae-9ff7-a6da1c95c0c6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:54.524394 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-f9d41abf-e516-4bae-9ff7-a6da1c95c0c6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:54.531479 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f9d41abf-e516-4bae-9ff7-a6da1c95c0c6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:54.531931 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f9d41abf-e516-4bae-9ff7-a6da1c95c0c6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:54.532691 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f9d41abf-e516-4bae-9ff7-a6da1c95c0c6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:54.533127 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f9d41abf-e516-4bae-9ff7-a6da1c95c0c6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:54.572460 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3b382ed1-069d-4c9c-a9e9-34b752f4b24f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:54.573075 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-3b382ed1-069d-4c9c-a9e9-34b752f4b24f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:54.579412 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3b382ed1-069d-4c9c-a9e9-34b752f4b24f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:54.579864 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3b382ed1-069d-4c9c-a9e9-34b752f4b24f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:54.580638 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3b382ed1-069d-4c9c-a9e9-34b752f4b24f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:54.581077 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3b382ed1-069d-4c9c-a9e9-34b752f4b24f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:54.591767 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-f9d41abf-e516-4bae-9ff7-a6da1c95c0c6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:54.599050 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-f9d41abf-e516-4bae-9ff7-a6da1c95c0c6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079182 Mar 08 15:00:54.599605 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 774/1567] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:54 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:54.672693 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-78f71cd8-2b20-44c5-9648-91a52cae17b9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:54.673612 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-78f71cd8-2b20-44c5-9648-91a52cae17b9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:54.679745 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-78f71cd8-2b20-44c5-9648-91a52cae17b9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:54.680192 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-78f71cd8-2b20-44c5-9648-91a52cae17b9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:54.681272 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-78f71cd8-2b20-44c5-9648-91a52cae17b9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:54.681743 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-78f71cd8-2b20-44c5-9648-91a52cae17b9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:54.709328 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-78f71cd8-2b20-44c5-9648-91a52cae17b9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040481 Mar 08 15:00:54.709898 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 775/1568] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:54 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 15:00:54.718978 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-3b382ed1-069d-4c9c-a9e9-34b752f4b24f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:54.726241 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-3b382ed1-069d-4c9c-a9e9-34b752f4b24f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.157677 Mar 08 15:00:54.726791 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 794/1569] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:54 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:00:55.414635 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-c470d1b8-be8f-4af2-a199-368c0cda23a4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:55.415788 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-c470d1b8-be8f-4af2-a199-368c0cda23a4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:55.421778 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c470d1b8-be8f-4af2-a199-368c0cda23a4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:55.422263 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c470d1b8-be8f-4af2-a199-368c0cda23a4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:55.423030 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c470d1b8-be8f-4af2-a199-368c0cda23a4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:55.423470 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c470d1b8-be8f-4af2-a199-368c0cda23a4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:55.453482 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-c470d1b8-be8f-4af2-a199-368c0cda23a4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042876 Mar 08 15:00:55.454067 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 776/1570] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:55 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:00:55.617575 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-e6c9a2ed-c339-4789-a5b5-d06e9e8cf2cb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:55.618243 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-e6c9a2ed-c339-4789-a5b5-d06e9e8cf2cb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:55.625070 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e6c9a2ed-c339-4789-a5b5-d06e9e8cf2cb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:55.625528 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e6c9a2ed-c339-4789-a5b5-d06e9e8cf2cb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:55.626336 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e6c9a2ed-c339-4789-a5b5-d06e9e8cf2cb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:55.626773 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e6c9a2ed-c339-4789-a5b5-d06e9e8cf2cb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:55.686981 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-e6c9a2ed-c339-4789-a5b5-d06e9e8cf2cb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:55.694248 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-e6c9a2ed-c339-4789-a5b5-d06e9e8cf2cb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080489 Mar 08 15:00:55.694807 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 795/1571] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:55 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:55.720523 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-18c7600a-6c9a-4798-82e4-21e4b0d577b0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:55.721454 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-18c7600a-6c9a-4798-82e4-21e4b0d577b0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:55.727586 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-18c7600a-6c9a-4798-82e4-21e4b0d577b0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:55.728562 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-18c7600a-6c9a-4798-82e4-21e4b0d577b0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:55.729404 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-18c7600a-6c9a-4798-82e4-21e4b0d577b0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:55.729835 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-18c7600a-6c9a-4798-82e4-21e4b0d577b0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:55.743157 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3a05bdc5-ddc6-4ecb-a0d0-89c163f424ab tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:55.744392 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-3a05bdc5-ddc6-4ecb-a0d0-89c163f424ab tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:55.750245 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3a05bdc5-ddc6-4ecb-a0d0-89c163f424ab tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:55.750705 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3a05bdc5-ddc6-4ecb-a0d0-89c163f424ab tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:55.751487 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3a05bdc5-ddc6-4ecb-a0d0-89c163f424ab tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:55.751927 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3a05bdc5-ddc6-4ecb-a0d0-89c163f424ab tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:55.757925 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-18c7600a-6c9a-4798-82e4-21e4b0d577b0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041269 Mar 08 15:00:55.758478 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 777/1572] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:55 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:00:55.888526 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-3a05bdc5-ddc6-4ecb-a0d0-89c163f424ab tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:55.895902 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-3a05bdc5-ddc6-4ecb-a0d0-89c163f424ab tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.156505 Mar 08 15:00:55.896471 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 796/1573] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:55 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:00:56.464590 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-a22e0449-f93b-462e-ad1b-3de3cb0c54f6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:56.465485 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-a22e0449-f93b-462e-ad1b-3de3cb0c54f6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:56.472089 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a22e0449-f93b-462e-ad1b-3de3cb0c54f6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:56.472568 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a22e0449-f93b-462e-ad1b-3de3cb0c54f6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:56.473360 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a22e0449-f93b-462e-ad1b-3de3cb0c54f6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:56.473798 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a22e0449-f93b-462e-ad1b-3de3cb0c54f6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:56.501220 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-a22e0449-f93b-462e-ad1b-3de3cb0c54f6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040735 Mar 08 15:00:56.501760 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 778/1574] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:56 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:00:56.711188 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-a21af2be-8420-4015-bd98-590cebb26ff1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:56.711798 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-a21af2be-8420-4015-bd98-590cebb26ff1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:56.718766 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a21af2be-8420-4015-bd98-590cebb26ff1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:56.719159 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a21af2be-8420-4015-bd98-590cebb26ff1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:56.719922 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a21af2be-8420-4015-bd98-590cebb26ff1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:56.720358 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a21af2be-8420-4015-bd98-590cebb26ff1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:56.768761 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-55e9284f-0a53-4a1b-9fa7-2efcdbf827cc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:56.769676 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-55e9284f-0a53-4a1b-9fa7-2efcdbf827cc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:56.776283 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-55e9284f-0a53-4a1b-9fa7-2efcdbf827cc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:56.776740 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-55e9284f-0a53-4a1b-9fa7-2efcdbf827cc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:56.777736 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-55e9284f-0a53-4a1b-9fa7-2efcdbf827cc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:56.778115 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-55e9284f-0a53-4a1b-9fa7-2efcdbf827cc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:56.779736 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-a21af2be-8420-4015-bd98-590cebb26ff1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:56.787141 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-a21af2be-8420-4015-bd98-590cebb26ff1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079820 Mar 08 15:00:56.787711 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 797/1575] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:56 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:56.807254 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-55e9284f-0a53-4a1b-9fa7-2efcdbf827cc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042326 Mar 08 15:00:56.807768 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 779/1576] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:56 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 15:00:56.913203 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-4945ef25-78f1-442a-8def-39075f8b46da tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:56.913811 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-4945ef25-78f1-442a-8def-39075f8b46da tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:56.920216 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4945ef25-78f1-442a-8def-39075f8b46da tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:56.920663 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4945ef25-78f1-442a-8def-39075f8b46da tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:56.921423 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4945ef25-78f1-442a-8def-39075f8b46da tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:56.921871 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4945ef25-78f1-442a-8def-39075f8b46da tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:57.054722 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-4945ef25-78f1-442a-8def-39075f8b46da tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:57.062950 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-4945ef25-78f1-442a-8def-39075f8b46da tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.153580 Mar 08 15:00:57.063512 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 798/1577] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:56 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:57.512749 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-7fba9229-3afe-4bf5-856b-a9f683604e87 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:57.513662 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-7fba9229-3afe-4bf5-856b-a9f683604e87 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:57.519529 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7fba9229-3afe-4bf5-856b-a9f683604e87 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:57.519985 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7fba9229-3afe-4bf5-856b-a9f683604e87 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:57.520752 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7fba9229-3afe-4bf5-856b-a9f683604e87 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:57.521191 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7fba9229-3afe-4bf5-856b-a9f683604e87 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:57.549990 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-7fba9229-3afe-4bf5-856b-a9f683604e87 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041258 Mar 08 15:00:57.550539 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 780/1578] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:57 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:00:57.804222 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ffc0593c-e9d2-4cd3-be8d-77c0c86c2bc0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:57.804758 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ffc0593c-e9d2-4cd3-be8d-77c0c86c2bc0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:57.811148 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ffc0593c-e9d2-4cd3-be8d-77c0c86c2bc0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:57.811595 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ffc0593c-e9d2-4cd3-be8d-77c0c86c2bc0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:57.812362 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ffc0593c-e9d2-4cd3-be8d-77c0c86c2bc0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:57.812794 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ffc0593c-e9d2-4cd3-be8d-77c0c86c2bc0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:57.818380 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-4a0eb01a-a6a6-4e1c-b6f2-0169c4de7efc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:57.819322 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-4a0eb01a-a6a6-4e1c-b6f2-0169c4de7efc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:57.826492 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4a0eb01a-a6a6-4e1c-b6f2-0169c4de7efc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:57.826955 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4a0eb01a-a6a6-4e1c-b6f2-0169c4de7efc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:57.827729 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4a0eb01a-a6a6-4e1c-b6f2-0169c4de7efc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:57.828172 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4a0eb01a-a6a6-4e1c-b6f2-0169c4de7efc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:57.856559 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-4a0eb01a-a6a6-4e1c-b6f2-0169c4de7efc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041965 Mar 08 15:00:57.857133 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 781/1579] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:57 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 15:00:57.873093 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ffc0593c-e9d2-4cd3-be8d-77c0c86c2bc0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:57.880698 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ffc0593c-e9d2-4cd3-be8d-77c0c86c2bc0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080644 Mar 08 15:00:57.881255 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 799/1580] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:57 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:58.080535 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-8c418384-7859-4699-aac3-a59e495fa57f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:58.081073 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-8c418384-7859-4699-aac3-a59e495fa57f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:58.086859 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8c418384-7859-4699-aac3-a59e495fa57f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:58.087962 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8c418384-7859-4699-aac3-a59e495fa57f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:58.088722 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8c418384-7859-4699-aac3-a59e495fa57f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:58.089155 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8c418384-7859-4699-aac3-a59e495fa57f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:58.220961 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-8c418384-7859-4699-aac3-a59e495fa57f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:58.228301 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-8c418384-7859-4699-aac3-a59e495fa57f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.151700 Mar 08 15:00:58.228874 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 782/1581] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:58 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:58.562502 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-e608bbb4-9be1-4136-83e8-f6fb4345a815 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:58.563409 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-e608bbb4-9be1-4136-83e8-f6fb4345a815 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:58.569221 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e608bbb4-9be1-4136-83e8-f6fb4345a815 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:58.570041 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e608bbb4-9be1-4136-83e8-f6fb4345a815 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:58.570810 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e608bbb4-9be1-4136-83e8-f6fb4345a815 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:58.571247 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e608bbb4-9be1-4136-83e8-f6fb4345a815 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:58.598659 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-e608bbb4-9be1-4136-83e8-f6fb4345a815 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040157 Mar 08 15:00:58.599193 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 800/1582] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:58 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:00:58.868070 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-6ea6d040-9562-4176-9e75-a025a15b4e96 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:58.869716 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-6ea6d040-9562-4176-9e75-a025a15b4e96 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:58.875978 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6ea6d040-9562-4176-9e75-a025a15b4e96 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:58.876433 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6ea6d040-9562-4176-9e75-a025a15b4e96 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:58.877202 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6ea6d040-9562-4176-9e75-a025a15b4e96 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:58.877644 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6ea6d040-9562-4176-9e75-a025a15b4e96 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:58.898089 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5182bbc6-19f9-4791-8c40-e6fc59b1c632 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:58.899015 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5182bbc6-19f9-4791-8c40-e6fc59b1c632 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:58.905167 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5182bbc6-19f9-4791-8c40-e6fc59b1c632 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:58.905616 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5182bbc6-19f9-4791-8c40-e6fc59b1c632 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:58.905737 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-6ea6d040-9562-4176-9e75-a025a15b4e96 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041574 Mar 08 15:00:58.906242 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 783/1583] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:58 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:00:58.906408 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5182bbc6-19f9-4791-8c40-e6fc59b1c632 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:58.906840 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5182bbc6-19f9-4791-8c40-e6fc59b1c632 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:58.969291 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-5182bbc6-19f9-4791-8c40-e6fc59b1c632 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:58.977491 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5182bbc6-19f9-4791-8c40-e6fc59b1c632 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.083267 Mar 08 15:00:58.978643 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 801/1584] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:58 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:00:59.244204 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b8c260f7-1dc1-4c38-8b81-3ea492f45b8e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:59.244832 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-b8c260f7-1dc1-4c38-8b81-3ea492f45b8e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:59.250806 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b8c260f7-1dc1-4c38-8b81-3ea492f45b8e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:59.251260 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b8c260f7-1dc1-4c38-8b81-3ea492f45b8e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:59.252028 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b8c260f7-1dc1-4c38-8b81-3ea492f45b8e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:59.252463 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b8c260f7-1dc1-4c38-8b81-3ea492f45b8e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:59.389328 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-b8c260f7-1dc1-4c38-8b81-3ea492f45b8e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:00:59.396607 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-b8c260f7-1dc1-4c38-8b81-3ea492f45b8e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.156398 Mar 08 15:00:59.397162 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 784/1585] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:59 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:00:59.610162 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-70e20f1a-e6b2-4646-9c21-945e6fc4154b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:59.611072 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-70e20f1a-e6b2-4646-9c21-945e6fc4154b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:59.616830 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-70e20f1a-e6b2-4646-9c21-945e6fc4154b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:59.617278 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-70e20f1a-e6b2-4646-9c21-945e6fc4154b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:59.618067 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-70e20f1a-e6b2-4646-9c21-945e6fc4154b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:59.618704 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-70e20f1a-e6b2-4646-9c21-945e6fc4154b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:59.646107 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-70e20f1a-e6b2-4646-9c21-945e6fc4154b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039946 Mar 08 15:00:59.646645 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 802/1586] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:00:59 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:00:59.916750 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-3dec0c4c-5c99-4bd5-addc-9f5d1a799b16 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:59.917598 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-3dec0c4c-5c99-4bd5-addc-9f5d1a799b16 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:00:59.923840 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3dec0c4c-5c99-4bd5-addc-9f5d1a799b16 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:59.924302 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3dec0c4c-5c99-4bd5-addc-9f5d1a799b16 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:59.925070 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3dec0c4c-5c99-4bd5-addc-9f5d1a799b16 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:00:59.925519 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3dec0c4c-5c99-4bd5-addc-9f5d1a799b16 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:00:59.954537 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-3dec0c4c-5c99-4bd5-addc-9f5d1a799b16 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042134 Mar 08 15:00:59.955093 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 785/1587] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:00:59 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:00:59.996204 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3432a14c-1ae1-422e-966b-26c25e1dbabb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:00:59.996885 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-3432a14c-1ae1-422e-966b-26c25e1dbabb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:00.003193 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3432a14c-1ae1-422e-966b-26c25e1dbabb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:00.003655 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3432a14c-1ae1-422e-966b-26c25e1dbabb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:00.004464 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3432a14c-1ae1-422e-966b-26c25e1dbabb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:00.004910 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3432a14c-1ae1-422e-966b-26c25e1dbabb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:00.065296 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-3432a14c-1ae1-422e-966b-26c25e1dbabb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:00.073344 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-3432a14c-1ae1-422e-966b-26c25e1dbabb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081850 Mar 08 15:01:00.073927 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 803/1588] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:00:59 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:00.413880 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-436c1919-9a43-4378-a923-5f5f830c8591 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:00.414556 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-436c1919-9a43-4378-a923-5f5f830c8591 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:00.421057 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-436c1919-9a43-4378-a923-5f5f830c8591 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:00.421512 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-436c1919-9a43-4378-a923-5f5f830c8591 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:00.422301 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-436c1919-9a43-4378-a923-5f5f830c8591 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:00.422735 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-436c1919-9a43-4378-a923-5f5f830c8591 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:00.555244 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-436c1919-9a43-4378-a923-5f5f830c8591 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:00.562639 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-436c1919-9a43-4378-a923-5f5f830c8591 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.152591 Mar 08 15:01:00.563206 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 786/1589] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:00 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:00.657538 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-9733ce2a-75ce-4119-89bb-4e0d4ea43f58 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:00.658492 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-9733ce2a-75ce-4119-89bb-4e0d4ea43f58 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:00.664310 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9733ce2a-75ce-4119-89bb-4e0d4ea43f58 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:00.664705 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9733ce2a-75ce-4119-89bb-4e0d4ea43f58 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:00.666180 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9733ce2a-75ce-4119-89bb-4e0d4ea43f58 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:00.666621 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9733ce2a-75ce-4119-89bb-4e0d4ea43f58 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:00.693703 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-9733ce2a-75ce-4119-89bb-4e0d4ea43f58 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040121 Mar 08 15:01:00.694279 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 804/1590] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:01:00 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 15:01:00.966888 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-961420c2-7625-4677-95ea-b7f55fe19753 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:00.967799 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-961420c2-7625-4677-95ea-b7f55fe19753 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:00.974165 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-961420c2-7625-4677-95ea-b7f55fe19753 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:00.974617 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-961420c2-7625-4677-95ea-b7f55fe19753 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:00.975378 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-961420c2-7625-4677-95ea-b7f55fe19753 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:00.975814 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-961420c2-7625-4677-95ea-b7f55fe19753 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:01.003042 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-961420c2-7625-4677-95ea-b7f55fe19753 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040824 Mar 08 15:01:01.003576 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 787/1591] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:00 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:01:01.090618 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-9981ee99-5d92-4eb4-ac51-ef88af96e514 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:01.091250 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-9981ee99-5d92-4eb4-ac51-ef88af96e514 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:01.097766 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9981ee99-5d92-4eb4-ac51-ef88af96e514 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:01.098322 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9981ee99-5d92-4eb4-ac51-ef88af96e514 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:01.099099 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9981ee99-5d92-4eb4-ac51-ef88af96e514 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:01.099538 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9981ee99-5d92-4eb4-ac51-ef88af96e514 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:01.211605 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-9981ee99-5d92-4eb4-ac51-ef88af96e514 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:01.220437 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-9981ee99-5d92-4eb4-ac51-ef88af96e514 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.134272 Mar 08 15:01:01.220996 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 805/1592] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:01 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:01.579419 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-dcf43f1f-0470-46e6-99c3-e022692af589 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:01.580022 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-dcf43f1f-0470-46e6-99c3-e022692af589 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:01.585889 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-dcf43f1f-0470-46e6-99c3-e022692af589 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:01.586343 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-dcf43f1f-0470-46e6-99c3-e022692af589 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:01.587146 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-dcf43f1f-0470-46e6-99c3-e022692af589 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:01.587583 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-dcf43f1f-0470-46e6-99c3-e022692af589 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:01.704683 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-734a66a0-d864-408c-86dd-f0d5fc8ae488 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:01.705631 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-734a66a0-d864-408c-86dd-f0d5fc8ae488 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:01.711517 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-734a66a0-d864-408c-86dd-f0d5fc8ae488 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:01.712028 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-734a66a0-d864-408c-86dd-f0d5fc8ae488 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:01.713362 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-734a66a0-d864-408c-86dd-f0d5fc8ae488 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:01.713797 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-734a66a0-d864-408c-86dd-f0d5fc8ae488 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:01.719758 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-dcf43f1f-0470-46e6-99c3-e022692af589 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:01.727008 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-dcf43f1f-0470-46e6-99c3-e022692af589 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.151402 Mar 08 15:01:01.727571 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 788/1593] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:01 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:01.742924 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-734a66a0-d864-408c-86dd-f0d5fc8ae488 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042189 Mar 08 15:01:01.744242 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 806/1594] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:01:01 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 15:01:02.014860 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-38ff0c0c-7edc-403f-936f-789d7bb1d529 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:02.015772 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-38ff0c0c-7edc-403f-936f-789d7bb1d529 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:02.022152 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-38ff0c0c-7edc-403f-936f-789d7bb1d529 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:02.022602 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-38ff0c0c-7edc-403f-936f-789d7bb1d529 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:02.023369 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-38ff0c0c-7edc-403f-936f-789d7bb1d529 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:02.023805 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-38ff0c0c-7edc-403f-936f-789d7bb1d529 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:02.052311 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-38ff0c0c-7edc-403f-936f-789d7bb1d529 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041586 Mar 08 15:01:02.052848 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 789/1595] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:02 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 15:01:02.237957 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-9286f2bd-6f50-482e-b20a-9eb907f630ec tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:02.238575 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-9286f2bd-6f50-482e-b20a-9eb907f630ec tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:02.245867 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9286f2bd-6f50-482e-b20a-9eb907f630ec tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:02.246332 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9286f2bd-6f50-482e-b20a-9eb907f630ec tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:02.247125 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9286f2bd-6f50-482e-b20a-9eb907f630ec tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:02.247547 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9286f2bd-6f50-482e-b20a-9eb907f630ec tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:02.308155 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-9286f2bd-6f50-482e-b20a-9eb907f630ec tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:02.315434 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-9286f2bd-6f50-482e-b20a-9eb907f630ec tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081468 Mar 08 15:01:02.315997 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 807/1596] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:02 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:02.744966 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-838e69a0-e0d4-40f7-a82b-2ec6747e7e7d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:02.745583 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-838e69a0-e0d4-40f7-a82b-2ec6747e7e7d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:02.751757 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-838e69a0-e0d4-40f7-a82b-2ec6747e7e7d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:02.752216 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-838e69a0-e0d4-40f7-a82b-2ec6747e7e7d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:02.752994 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-838e69a0-e0d4-40f7-a82b-2ec6747e7e7d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:02.753437 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-838e69a0-e0d4-40f7-a82b-2ec6747e7e7d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:02.755125 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-6141953d-0d36-45d4-a8d0-7642f3bb16c1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:02.756035 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-6141953d-0d36-45d4-a8d0-7642f3bb16c1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:02.762050 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6141953d-0d36-45d4-a8d0-7642f3bb16c1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:02.762501 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6141953d-0d36-45d4-a8d0-7642f3bb16c1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:02.763270 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6141953d-0d36-45d4-a8d0-7642f3bb16c1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:02.763704 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6141953d-0d36-45d4-a8d0-7642f3bb16c1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:02.792943 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-6141953d-0d36-45d4-a8d0-7642f3bb16c1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041714 Mar 08 15:01:02.793502 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 808/1597] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:01:02 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 15:01:02.890862 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-838e69a0-e0d4-40f7-a82b-2ec6747e7e7d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:02.897969 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-838e69a0-e0d4-40f7-a82b-2ec6747e7e7d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.156913 Mar 08 15:01:02.898536 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 790/1598] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:02 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:03.063930 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-40f2ffec-2c2e-4998-abb4-91fa580f552e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:03.064777 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-40f2ffec-2c2e-4998-abb4-91fa580f552e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:03.070652 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-40f2ffec-2c2e-4998-abb4-91fa580f552e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:03.071101 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-40f2ffec-2c2e-4998-abb4-91fa580f552e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:03.072765 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-40f2ffec-2c2e-4998-abb4-91fa580f552e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:03.073198 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-40f2ffec-2c2e-4998-abb4-91fa580f552e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:03.099914 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-40f2ffec-2c2e-4998-abb4-91fa580f552e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040065 Mar 08 15:01:03.100449 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 809/1599] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:03 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:01:03.332918 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-a7687e15-663e-4869-81b4-df316b5b0c60 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:03.333596 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-a7687e15-663e-4869-81b4-df316b5b0c60 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:03.339908 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a7687e15-663e-4869-81b4-df316b5b0c60 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:03.340362 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a7687e15-663e-4869-81b4-df316b5b0c60 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:03.341134 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a7687e15-663e-4869-81b4-df316b5b0c60 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:03.341577 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a7687e15-663e-4869-81b4-df316b5b0c60 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:03.405969 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-a7687e15-663e-4869-81b4-df316b5b0c60 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:03.413255 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-a7687e15-663e-4869-81b4-df316b5b0c60 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.084306 Mar 08 15:01:03.413795 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 791/1600] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:03 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:03.804758 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-0009d1f5-656b-4f14-b6cf-01dd1a7e3a68 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:03.805665 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-0009d1f5-656b-4f14-b6cf-01dd1a7e3a68 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:03.811871 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0009d1f5-656b-4f14-b6cf-01dd1a7e3a68 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:03.812318 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0009d1f5-656b-4f14-b6cf-01dd1a7e3a68 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:03.813107 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0009d1f5-656b-4f14-b6cf-01dd1a7e3a68 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:03.813540 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0009d1f5-656b-4f14-b6cf-01dd1a7e3a68 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:03.842540 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-0009d1f5-656b-4f14-b6cf-01dd1a7e3a68 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041999 Mar 08 15:01:03.843085 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 810/1601] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:01:03 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:01:03.914692 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-3d85c9e1-b66a-4dd6-9b64-38f682cf32b6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:03.915386 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-3d85c9e1-b66a-4dd6-9b64-38f682cf32b6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:03.921222 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3d85c9e1-b66a-4dd6-9b64-38f682cf32b6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:03.921677 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3d85c9e1-b66a-4dd6-9b64-38f682cf32b6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:03.922494 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3d85c9e1-b66a-4dd6-9b64-38f682cf32b6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:03.922932 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3d85c9e1-b66a-4dd6-9b64-38f682cf32b6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:04.101603 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-3d85c9e1-b66a-4dd6-9b64-38f682cf32b6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:04.109067 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-3d85c9e1-b66a-4dd6-9b64-38f682cf32b6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.198232 Mar 08 15:01:04.109629 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 792/1602] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:03 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:04.112647 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-34720f05-5949-4a67-9b36-90b50f7399d8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:04.113571 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-34720f05-5949-4a67-9b36-90b50f7399d8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:04.119894 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-34720f05-5949-4a67-9b36-90b50f7399d8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:04.120354 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-34720f05-5949-4a67-9b36-90b50f7399d8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:04.121127 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-34720f05-5949-4a67-9b36-90b50f7399d8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:04.121565 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-34720f05-5949-4a67-9b36-90b50f7399d8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:04.150489 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-34720f05-5949-4a67-9b36-90b50f7399d8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041338 Mar 08 15:01:04.151051 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 811/1603] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:04 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 15:01:04.431424 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-bca75e70-0655-4930-ac03-0523a097be8e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:04.431950 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-bca75e70-0655-4930-ac03-0523a097be8e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:04.438167 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bca75e70-0655-4930-ac03-0523a097be8e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:04.438629 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bca75e70-0655-4930-ac03-0523a097be8e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:04.439398 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bca75e70-0655-4930-ac03-0523a097be8e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:04.439845 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bca75e70-0655-4930-ac03-0523a097be8e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:04.501814 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-bca75e70-0655-4930-ac03-0523a097be8e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:04.509724 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-bca75e70-0655-4930-ac03-0523a097be8e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.082477 Mar 08 15:01:04.510541 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 793/1604] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:04 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:04.854846 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-35aad801-4084-472a-b9f5-2d322751eb88 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:04.855756 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-35aad801-4084-472a-b9f5-2d322751eb88 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:04.862011 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-35aad801-4084-472a-b9f5-2d322751eb88 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:04.862463 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-35aad801-4084-472a-b9f5-2d322751eb88 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:04.863227 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-35aad801-4084-472a-b9f5-2d322751eb88 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:04.863667 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-35aad801-4084-472a-b9f5-2d322751eb88 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:04.891744 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-35aad801-4084-472a-b9f5-2d322751eb88 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041530 Mar 08 15:01:04.892287 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 812/1605] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:01:04 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:01:05.125260 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-f82dc758-3eee-4177-8ba0-5b5ab927a790 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:05.125806 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-f82dc758-3eee-4177-8ba0-5b5ab927a790 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:05.131783 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f82dc758-3eee-4177-8ba0-5b5ab927a790 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:05.132239 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f82dc758-3eee-4177-8ba0-5b5ab927a790 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:05.133007 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f82dc758-3eee-4177-8ba0-5b5ab927a790 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:05.133443 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f82dc758-3eee-4177-8ba0-5b5ab927a790 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:05.161841 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-85308a48-2092-4b85-9c78-74e7c435e501 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:05.162789 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-85308a48-2092-4b85-9c78-74e7c435e501 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:05.169198 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-85308a48-2092-4b85-9c78-74e7c435e501 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:05.169654 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-85308a48-2092-4b85-9c78-74e7c435e501 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:05.170462 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-85308a48-2092-4b85-9c78-74e7c435e501 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:05.170904 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-85308a48-2092-4b85-9c78-74e7c435e501 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:05.200134 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-85308a48-2092-4b85-9c78-74e7c435e501 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042113 Mar 08 15:01:05.200699 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 813/1606] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:05 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 15:01:05.270712 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-f82dc758-3eee-4177-8ba0-5b5ab927a790 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:05.278510 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-f82dc758-3eee-4177-8ba0-5b5ab927a790 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.157185 Mar 08 15:01:05.279074 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 794/1607] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:05 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:05.473898 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 15:01:05.474118 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: Tue Mar 8 15:01:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 15:01:05.526534 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-a3db3304-218e-4e27-b5eb-099d82b3c059 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:05.527172 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-a3db3304-218e-4e27-b5eb-099d82b3c059 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:05.533663 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a3db3304-218e-4e27-b5eb-099d82b3c059 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:05.534145 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a3db3304-218e-4e27-b5eb-099d82b3c059 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:05.534917 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a3db3304-218e-4e27-b5eb-099d82b3c059 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:05.535355 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a3db3304-218e-4e27-b5eb-099d82b3c059 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:05.594650 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-a3db3304-218e-4e27-b5eb-099d82b3c059 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:05.602882 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-a3db3304-218e-4e27-b5eb-099d82b3c059 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080050 Mar 08 15:01:05.603437 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 814/1608] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:05 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:05.903956 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-4cbb2bf7-5c91-453b-ae1e-6f65011d80f5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:05.904868 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-4cbb2bf7-5c91-453b-ae1e-6f65011d80f5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:05.911171 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4cbb2bf7-5c91-453b-ae1e-6f65011d80f5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:05.911624 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4cbb2bf7-5c91-453b-ae1e-6f65011d80f5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:05.912390 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4cbb2bf7-5c91-453b-ae1e-6f65011d80f5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:05.912827 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4cbb2bf7-5c91-453b-ae1e-6f65011d80f5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:05.943565 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-4cbb2bf7-5c91-453b-ae1e-6f65011d80f5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044110 Mar 08 15:01:05.944117 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 795/1609] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:01:05 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:01:06.211889 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-85a804e6-d99c-47f3-813f-293301f26b42 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:06.212819 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-85a804e6-d99c-47f3-813f-293301f26b42 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:06.218765 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-85a804e6-d99c-47f3-813f-293301f26b42 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:06.219218 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-85a804e6-d99c-47f3-813f-293301f26b42 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:06.219993 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-85a804e6-d99c-47f3-813f-293301f26b42 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:06.220428 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-85a804e6-d99c-47f3-813f-293301f26b42 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:06.248345 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-85a804e6-d99c-47f3-813f-293301f26b42 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040684 Mar 08 15:01:06.248890 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 815/1610] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:06 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:01:06.295951 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-bf8934fd-912c-4c9d-9f4d-d70e1cbcbc43 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:06.296559 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-bf8934fd-912c-4c9d-9f4d-d70e1cbcbc43 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:06.302609 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bf8934fd-912c-4c9d-9f4d-d70e1cbcbc43 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:06.303065 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bf8934fd-912c-4c9d-9f4d-d70e1cbcbc43 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:06.303822 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bf8934fd-912c-4c9d-9f4d-d70e1cbcbc43 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:06.304254 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bf8934fd-912c-4c9d-9f4d-d70e1cbcbc43 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:06.435712 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-bf8934fd-912c-4c9d-9f4d-d70e1cbcbc43 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:06.442953 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-bf8934fd-912c-4c9d-9f4d-d70e1cbcbc43 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.150985 Mar 08 15:01:06.443520 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 796/1611] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:06 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:06.619902 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-619be8ad-de89-4495-b821-4b660871581e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:06.620514 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-619be8ad-de89-4495-b821-4b660871581e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:06.626289 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-619be8ad-de89-4495-b821-4b660871581e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:06.626745 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-619be8ad-de89-4495-b821-4b660871581e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:06.627516 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-619be8ad-de89-4495-b821-4b660871581e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:06.627955 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-619be8ad-de89-4495-b821-4b660871581e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:06.689001 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-619be8ad-de89-4495-b821-4b660871581e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:06.696278 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-619be8ad-de89-4495-b821-4b660871581e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080438 Mar 08 15:01:06.696916 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 816/1612] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:06 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:06.955838 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-63a884d3-04ba-4645-b0b1-55867bfe5f6e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:06.956762 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-63a884d3-04ba-4645-b0b1-55867bfe5f6e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:06.963356 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-63a884d3-04ba-4645-b0b1-55867bfe5f6e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:06.963815 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-63a884d3-04ba-4645-b0b1-55867bfe5f6e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:06.964590 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-63a884d3-04ba-4645-b0b1-55867bfe5f6e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:06.965034 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-63a884d3-04ba-4645-b0b1-55867bfe5f6e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:06.992787 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-63a884d3-04ba-4645-b0b1-55867bfe5f6e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041039 Mar 08 15:01:06.993984 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 797/1613] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:01:06 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:01:07.260166 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-8f3cc329-566e-4334-8516-8c8d4aa01d39 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:07.261080 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-8f3cc329-566e-4334-8516-8c8d4aa01d39 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:07.267377 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8f3cc329-566e-4334-8516-8c8d4aa01d39 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:07.267827 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8f3cc329-566e-4334-8516-8c8d4aa01d39 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:07.268604 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8f3cc329-566e-4334-8516-8c8d4aa01d39 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:07.269045 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8f3cc329-566e-4334-8516-8c8d4aa01d39 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:07.297397 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-8f3cc329-566e-4334-8516-8c8d4aa01d39 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041349 Mar 08 15:01:07.297950 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 817/1614] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:07 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:01:07.460438 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-bf9d956a-5d5f-404a-9cf2-1eb7aee2ba9a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:07.461044 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-bf9d956a-5d5f-404a-9cf2-1eb7aee2ba9a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:07.467635 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bf9d956a-5d5f-404a-9cf2-1eb7aee2ba9a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:07.468082 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bf9d956a-5d5f-404a-9cf2-1eb7aee2ba9a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:07.468877 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bf9d956a-5d5f-404a-9cf2-1eb7aee2ba9a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:07.469313 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bf9d956a-5d5f-404a-9cf2-1eb7aee2ba9a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:07.614601 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-bf9d956a-5d5f-404a-9cf2-1eb7aee2ba9a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:07.622922 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-bf9d956a-5d5f-404a-9cf2-1eb7aee2ba9a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.166350 Mar 08 15:01:07.623497 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 798/1615] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:07 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:07.713187 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-9f99cc71-8655-49ec-9aa0-8f74e394abae tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:07.713823 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-9f99cc71-8655-49ec-9aa0-8f74e394abae tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:07.721560 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9f99cc71-8655-49ec-9aa0-8f74e394abae tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:07.722087 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9f99cc71-8655-49ec-9aa0-8f74e394abae tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:07.722868 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9f99cc71-8655-49ec-9aa0-8f74e394abae tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:07.723301 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9f99cc71-8655-49ec-9aa0-8f74e394abae tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:07.785638 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-9f99cc71-8655-49ec-9aa0-8f74e394abae tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:07.795283 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-9f99cc71-8655-49ec-9aa0-8f74e394abae tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.086005 Mar 08 15:01:07.795849 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 818/1616] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:07 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:08.007822 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-80c6309d-cf31-4fe0-9efb-314048acd73c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:08.009333 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-80c6309d-cf31-4fe0-9efb-314048acd73c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:08.017034 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-80c6309d-cf31-4fe0-9efb-314048acd73c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:08.017474 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-80c6309d-cf31-4fe0-9efb-314048acd73c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:08.018280 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-80c6309d-cf31-4fe0-9efb-314048acd73c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:08.018719 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-80c6309d-cf31-4fe0-9efb-314048acd73c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:08.051709 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-80c6309d-cf31-4fe0-9efb-314048acd73c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050073 Mar 08 15:01:08.052268 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 799/1617] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:01:07 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:01:08.309107 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-a910bd30-026d-4d34-aa14-e5dff767eaac tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:08.310086 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-a910bd30-026d-4d34-aa14-e5dff767eaac tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:08.316460 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a910bd30-026d-4d34-aa14-e5dff767eaac tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:08.316913 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a910bd30-026d-4d34-aa14-e5dff767eaac tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:08.317692 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a910bd30-026d-4d34-aa14-e5dff767eaac tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:08.318163 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a910bd30-026d-4d34-aa14-e5dff767eaac tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:08.348018 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-a910bd30-026d-4d34-aa14-e5dff767eaac tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042852 Mar 08 15:01:08.348579 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 819/1618] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:08 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:01:08.640959 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-ca9df6d6-5227-4a42-9fbc-1cf9c77c77f2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:08.641640 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-ca9df6d6-5227-4a42-9fbc-1cf9c77c77f2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:08.647956 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ca9df6d6-5227-4a42-9fbc-1cf9c77c77f2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:08.648424 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ca9df6d6-5227-4a42-9fbc-1cf9c77c77f2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:08.649294 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ca9df6d6-5227-4a42-9fbc-1cf9c77c77f2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:08.650525 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ca9df6d6-5227-4a42-9fbc-1cf9c77c77f2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:08.785024 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-ca9df6d6-5227-4a42-9fbc-1cf9c77c77f2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:08.793171 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-ca9df6d6-5227-4a42-9fbc-1cf9c77c77f2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.156219 Mar 08 15:01:08.793732 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 800/1619] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:08 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:08.812272 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-51a9b5b3-9643-4c1d-aa51-eab82335837a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:08.812888 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-51a9b5b3-9643-4c1d-aa51-eab82335837a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:08.818655 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-51a9b5b3-9643-4c1d-aa51-eab82335837a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:08.819108 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-51a9b5b3-9643-4c1d-aa51-eab82335837a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:08.819879 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-51a9b5b3-9643-4c1d-aa51-eab82335837a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:08.820315 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-51a9b5b3-9643-4c1d-aa51-eab82335837a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:08.879406 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-51a9b5b3-9643-4c1d-aa51-eab82335837a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:08.887233 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-51a9b5b3-9643-4c1d-aa51-eab82335837a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078743 Mar 08 15:01:08.887795 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 820/1620] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:08 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:09.064681 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-eca18b24-bb04-4061-8540-357c411172c2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:09.065577 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-eca18b24-bb04-4061-8540-357c411172c2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:09.072426 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-eca18b24-bb04-4061-8540-357c411172c2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:09.072871 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-eca18b24-bb04-4061-8540-357c411172c2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:09.073637 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-eca18b24-bb04-4061-8540-357c411172c2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:09.074102 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-eca18b24-bb04-4061-8540-357c411172c2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:09.103104 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-eca18b24-bb04-4061-8540-357c411172c2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041877 Mar 08 15:01:09.103846 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 801/1621] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:01:09 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:01:09.360360 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-6bf0c637-388f-4455-9b0a-4ef6298f4f9b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:09.361300 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-6bf0c637-388f-4455-9b0a-4ef6298f4f9b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:09.367703 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6bf0c637-388f-4455-9b0a-4ef6298f4f9b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:09.368158 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6bf0c637-388f-4455-9b0a-4ef6298f4f9b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:09.369543 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6bf0c637-388f-4455-9b0a-4ef6298f4f9b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:09.370021 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6bf0c637-388f-4455-9b0a-4ef6298f4f9b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:09.404333 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-6bf0c637-388f-4455-9b0a-4ef6298f4f9b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048023 Mar 08 15:01:09.404888 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 821/1622] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:09 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:01:09.810428 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-21ca15f5-573a-4e4c-9308-7085b24b4dab tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:09.811101 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-21ca15f5-573a-4e4c-9308-7085b24b4dab tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:09.816920 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-21ca15f5-573a-4e4c-9308-7085b24b4dab tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:09.817369 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-21ca15f5-573a-4e4c-9308-7085b24b4dab tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:09.818169 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-21ca15f5-573a-4e4c-9308-7085b24b4dab tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:09.818605 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-21ca15f5-573a-4e4c-9308-7085b24b4dab tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:09.903819 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-e580a7e5-ea7a-4504-bdc9-62668a3d085c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:09.904442 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-e580a7e5-ea7a-4504-bdc9-62668a3d085c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:09.910274 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e580a7e5-ea7a-4504-bdc9-62668a3d085c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:09.910720 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e580a7e5-ea7a-4504-bdc9-62668a3d085c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:09.911489 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e580a7e5-ea7a-4504-bdc9-62668a3d085c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:09.911922 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e580a7e5-ea7a-4504-bdc9-62668a3d085c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:09.957012 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-21ca15f5-573a-4e4c-9308-7085b24b4dab tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:09.964997 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-21ca15f5-573a-4e4c-9308-7085b24b4dab tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.158494 Mar 08 15:01:09.965571 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 802/1623] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:09 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:09.973358 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-e580a7e5-ea7a-4504-bdc9-62668a3d085c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:09.981377 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-e580a7e5-ea7a-4504-bdc9-62668a3d085c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081366 Mar 08 15:01:09.981948 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 822/1624] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:09 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:01:10.114938 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-28658b65-5536-4981-99a3-16e0c722bc00 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:10.115763 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-28658b65-5536-4981-99a3-16e0c722bc00 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:10.122440 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-28658b65-5536-4981-99a3-16e0c722bc00 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:10.123222 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-28658b65-5536-4981-99a3-16e0c722bc00 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:10.124046 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-28658b65-5536-4981-99a3-16e0c722bc00 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:10.124487 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-28658b65-5536-4981-99a3-16e0c722bc00 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:10.152237 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-28658b65-5536-4981-99a3-16e0c722bc00 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041325 Mar 08 15:01:10.152777 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 803/1625] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:01:10 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:01:10.416164 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-61b370b8-1e39-418d-ab4e-f0301a0f21c2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:10.417011 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-61b370b8-1e39-418d-ab4e-f0301a0f21c2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:10.423308 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-61b370b8-1e39-418d-ab4e-f0301a0f21c2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:10.423770 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-61b370b8-1e39-418d-ab4e-f0301a0f21c2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:10.424541 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-61b370b8-1e39-418d-ab4e-f0301a0f21c2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:10.424984 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-61b370b8-1e39-418d-ab4e-f0301a0f21c2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:10.452971 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-61b370b8-1e39-418d-ab4e-f0301a0f21c2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041048 Mar 08 15:01:10.453515 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 823/1626] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:10 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:01:10.982487 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-a76973a1-c0b9-42ae-b04b-bbb5cf23a495 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:10.983233 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-a76973a1-c0b9-42ae-b04b-bbb5cf23a495 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:10.988982 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a76973a1-c0b9-42ae-b04b-bbb5cf23a495 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:10.989441 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a76973a1-c0b9-42ae-b04b-bbb5cf23a495 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:10.990244 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a76973a1-c0b9-42ae-b04b-bbb5cf23a495 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:10.990688 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a76973a1-c0b9-42ae-b04b-bbb5cf23a495 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:10.998926 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3beed07c-8788-414c-8d18-8b3a53794cae tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:10.999542 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-3beed07c-8788-414c-8d18-8b3a53794cae tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:11.005687 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3beed07c-8788-414c-8d18-8b3a53794cae tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:11.005687 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3beed07c-8788-414c-8d18-8b3a53794cae tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:11.006447 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3beed07c-8788-414c-8d18-8b3a53794cae tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:11.006884 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3beed07c-8788-414c-8d18-8b3a53794cae tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:11.069810 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-3beed07c-8788-414c-8d18-8b3a53794cae tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:11.077733 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-3beed07c-8788-414c-8d18-8b3a53794cae tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.082497 Mar 08 15:01:11.078506 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 824/1627] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:10 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:01:11.163933 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-2abead6c-5ebf-4744-83fc-08fc3a6e4bf4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:11.164947 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-2abead6c-5ebf-4744-83fc-08fc3a6e4bf4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:11.172601 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2abead6c-5ebf-4744-83fc-08fc3a6e4bf4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:11.173055 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2abead6c-5ebf-4744-83fc-08fc3a6e4bf4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:11.173841 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2abead6c-5ebf-4744-83fc-08fc3a6e4bf4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:11.174305 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2abead6c-5ebf-4744-83fc-08fc3a6e4bf4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:11.206393 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-2abead6c-5ebf-4744-83fc-08fc3a6e4bf4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046385 Mar 08 15:01:11.206977 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 825/1628] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:01:11 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 15:01:11.464640 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-de2e904c-99e3-433d-b832-f4af2cb6ca58 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:11.465212 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-a76973a1-c0b9-42ae-b04b-bbb5cf23a495 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:11.466115 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-de2e904c-99e3-433d-b832-f4af2cb6ca58 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:11.472366 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-a76973a1-c0b9-42ae-b04b-bbb5cf23a495 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.493840 Mar 08 15:01:11.472945 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 804/1629] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:10 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:11.473071 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-de2e904c-99e3-433d-b832-f4af2cb6ca58 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:11.473412 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-de2e904c-99e3-433d-b832-f4af2cb6ca58 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:11.474357 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-de2e904c-99e3-433d-b832-f4af2cb6ca58 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:11.474796 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-de2e904c-99e3-433d-b832-f4af2cb6ca58 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:11.503648 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-de2e904c-99e3-433d-b832-f4af2cb6ca58 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043016 Mar 08 15:01:11.504204 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 826/1630] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:11 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 15:01:12.094831 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-f38ed6b2-99a5-4b82-9a27-27019698cd31 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:12.095442 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-f38ed6b2-99a5-4b82-9a27-27019698cd31 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:12.101134 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f38ed6b2-99a5-4b82-9a27-27019698cd31 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:12.101587 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f38ed6b2-99a5-4b82-9a27-27019698cd31 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:12.102392 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f38ed6b2-99a5-4b82-9a27-27019698cd31 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:12.103487 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f38ed6b2-99a5-4b82-9a27-27019698cd31 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:12.168828 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-f38ed6b2-99a5-4b82-9a27-27019698cd31 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:12.176187 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-f38ed6b2-99a5-4b82-9a27-27019698cd31 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.085272 Mar 08 15:01:12.177007 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 805/1631] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:12 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:12.218959 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3c1c190e-6687-4765-979a-55a4c05ea446 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:12.219873 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-3c1c190e-6687-4765-979a-55a4c05ea446 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:12.225707 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3c1c190e-6687-4765-979a-55a4c05ea446 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:12.226194 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3c1c190e-6687-4765-979a-55a4c05ea446 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:12.226964 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3c1c190e-6687-4765-979a-55a4c05ea446 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:12.227398 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3c1c190e-6687-4765-979a-55a4c05ea446 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:12.257522 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-3c1c190e-6687-4765-979a-55a4c05ea446 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042721 Mar 08 15:01:12.258102 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 827/1632] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:01:12 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:01:12.489646 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-0b2aed6d-404f-4742-8c64-a66e1a8c75a9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:12.490292 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-0b2aed6d-404f-4742-8c64-a66e1a8c75a9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:12.496049 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0b2aed6d-404f-4742-8c64-a66e1a8c75a9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:12.496550 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0b2aed6d-404f-4742-8c64-a66e1a8c75a9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:12.497694 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0b2aed6d-404f-4742-8c64-a66e1a8c75a9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:12.498200 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0b2aed6d-404f-4742-8c64-a66e1a8c75a9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:12.515130 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-cb3b27da-2aaf-421e-9629-c81cddeafb0b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:12.516218 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-cb3b27da-2aaf-421e-9629-c81cddeafb0b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:12.522448 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cb3b27da-2aaf-421e-9629-c81cddeafb0b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:12.522894 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cb3b27da-2aaf-421e-9629-c81cddeafb0b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:12.523660 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cb3b27da-2aaf-421e-9629-c81cddeafb0b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:12.524093 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cb3b27da-2aaf-421e-9629-c81cddeafb0b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:12.555364 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-cb3b27da-2aaf-421e-9629-c81cddeafb0b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044084 Mar 08 15:01:12.556061 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 828/1633] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:12 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 15:01:12.633290 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-0b2aed6d-404f-4742-8c64-a66e1a8c75a9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:12.641052 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-0b2aed6d-404f-4742-8c64-a66e1a8c75a9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.155768 Mar 08 15:01:12.641611 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 806/1634] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:12 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:13.194001 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f434cef1-fdb5-4ed6-a54f-9cc97fd20cb4 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:13.194547 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f434cef1-fdb5-4ed6-a54f-9cc97fd20cb4 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:13.201271 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f434cef1-fdb5-4ed6-a54f-9cc97fd20cb4 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:13.201733 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f434cef1-fdb5-4ed6-a54f-9cc97fd20cb4 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:13.202571 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f434cef1-fdb5-4ed6-a54f-9cc97fd20cb4 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:13.203014 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f434cef1-fdb5-4ed6-a54f-9cc97fd20cb4 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:13.262402 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f434cef1-fdb5-4ed6-a54f-9cc97fd20cb4 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:13.269210 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-f6e8f0f1-5cc4-4c3a-9e43-f386226431a3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:13.269800 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f434cef1-fdb5-4ed6-a54f-9cc97fd20cb4 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079897 Mar 08 15:01:13.270152 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-f6e8f0f1-5cc4-4c3a-9e43-f386226431a3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:13.270403 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 829/1635] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:13 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:13.276620 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f6e8f0f1-5cc4-4c3a-9e43-f386226431a3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:13.277075 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f6e8f0f1-5cc4-4c3a-9e43-f386226431a3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:13.277867 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f6e8f0f1-5cc4-4c3a-9e43-f386226431a3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:13.278393 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f6e8f0f1-5cc4-4c3a-9e43-f386226431a3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:13.306966 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-f6e8f0f1-5cc4-4c3a-9e43-f386226431a3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041762 Mar 08 15:01:13.307521 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 807/1636] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:01:13 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 15:01:13.566508 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-a90c02fe-acb2-4ad9-8717-a9d5636174ae tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:13.567423 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-a90c02fe-acb2-4ad9-8717-a9d5636174ae tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:13.573688 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a90c02fe-acb2-4ad9-8717-a9d5636174ae tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:13.574392 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a90c02fe-acb2-4ad9-8717-a9d5636174ae tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:13.574995 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a90c02fe-acb2-4ad9-8717-a9d5636174ae tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:13.575428 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a90c02fe-acb2-4ad9-8717-a9d5636174ae tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:13.603609 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-a90c02fe-acb2-4ad9-8717-a9d5636174ae tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041020 Mar 08 15:01:13.604147 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 830/1637] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:13 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:01:13.658366 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-874c006f-0155-4597-9193-f6e801843940 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:13.658978 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-874c006f-0155-4597-9193-f6e801843940 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:13.664824 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-874c006f-0155-4597-9193-f6e801843940 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:13.665939 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-874c006f-0155-4597-9193-f6e801843940 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:13.666707 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-874c006f-0155-4597-9193-f6e801843940 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:13.667150 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-874c006f-0155-4597-9193-f6e801843940 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:13.798598 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-874c006f-0155-4597-9193-f6e801843940 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:13.806282 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-874c006f-0155-4597-9193-f6e801843940 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.151695 Mar 08 15:01:13.806844 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 808/1638] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:13 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:14.285847 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-21fbf543-3cc2-451f-8c23-73c0209782b7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:14.286492 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-21fbf543-3cc2-451f-8c23-73c0209782b7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:14.292391 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-21fbf543-3cc2-451f-8c23-73c0209782b7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:14.292844 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-21fbf543-3cc2-451f-8c23-73c0209782b7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:14.293615 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-21fbf543-3cc2-451f-8c23-73c0209782b7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:14.294083 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-21fbf543-3cc2-451f-8c23-73c0209782b7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:14.318765 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-15c7458f-be24-47ca-afe3-9a9ba836c1a8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:14.319676 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-15c7458f-be24-47ca-afe3-9a9ba836c1a8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:14.326854 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-15c7458f-be24-47ca-afe3-9a9ba836c1a8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:14.327319 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-15c7458f-be24-47ca-afe3-9a9ba836c1a8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:14.328092 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-15c7458f-be24-47ca-afe3-9a9ba836c1a8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:14.328533 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-15c7458f-be24-47ca-afe3-9a9ba836c1a8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:14.353803 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-21fbf543-3cc2-451f-8c23-73c0209782b7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:14.357679 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-15c7458f-be24-47ca-afe3-9a9ba836c1a8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042888 Mar 08 15:01:14.358280 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 809/1639] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:01:14 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 15:01:14.361932 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-21fbf543-3cc2-451f-8c23-73c0209782b7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079372 Mar 08 15:01:14.362482 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 831/1640] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:14 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:14.615685 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-9f5c1e61-8147-42d3-9017-9d319c2b06f1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:14.616504 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-9f5c1e61-8147-42d3-9017-9d319c2b06f1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:14.623007 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9f5c1e61-8147-42d3-9017-9d319c2b06f1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:14.623455 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9f5c1e61-8147-42d3-9017-9d319c2b06f1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:14.624212 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9f5c1e61-8147-42d3-9017-9d319c2b06f1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:14.624641 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9f5c1e61-8147-42d3-9017-9d319c2b06f1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:14.652364 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-9f5c1e61-8147-42d3-9017-9d319c2b06f1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040768 Mar 08 15:01:14.652902 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 810/1641] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:14 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 15:01:14.824129 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-a533d940-bc2e-42a2-9c62-b6991904b119 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:14.824747 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-a533d940-bc2e-42a2-9c62-b6991904b119 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:14.831041 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a533d940-bc2e-42a2-9c62-b6991904b119 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:14.831501 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a533d940-bc2e-42a2-9c62-b6991904b119 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:14.832305 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a533d940-bc2e-42a2-9c62-b6991904b119 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:14.832751 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a533d940-bc2e-42a2-9c62-b6991904b119 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:14.967004 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-a533d940-bc2e-42a2-9c62-b6991904b119 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:14.974461 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-a533d940-bc2e-42a2-9c62-b6991904b119 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.154797 Mar 08 15:01:14.975018 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 832/1642] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:14 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:15.369425 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-7a48b879-40b2-4f11-8522-8c034e1cf697 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:15.370392 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-7a48b879-40b2-4f11-8522-8c034e1cf697 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:15.376876 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7a48b879-40b2-4f11-8522-8c034e1cf697 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:15.377393 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7a48b879-40b2-4f11-8522-8c034e1cf697 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:15.378245 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7a48b879-40b2-4f11-8522-8c034e1cf697 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:15.378622 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-57c40e44-204b-428d-bddc-5f4ee28b8b24 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:15.378788 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7a48b879-40b2-4f11-8522-8c034e1cf697 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:15.379356 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-57c40e44-204b-428d-bddc-5f4ee28b8b24 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:15.385283 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-57c40e44-204b-428d-bddc-5f4ee28b8b24 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:15.385729 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-57c40e44-204b-428d-bddc-5f4ee28b8b24 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:15.386528 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-57c40e44-204b-428d-bddc-5f4ee28b8b24 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:15.386958 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-57c40e44-204b-428d-bddc-5f4ee28b8b24 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:15.407836 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-7a48b879-40b2-4f11-8522-8c034e1cf697 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042389 Mar 08 15:01:15.408483 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 811/1643] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:01:15 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:01:15.450894 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-57c40e44-204b-428d-bddc-5f4ee28b8b24 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:15.458297 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-57c40e44-204b-428d-bddc-5f4ee28b8b24 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.083405 Mar 08 15:01:15.458845 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 833/1644] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:15 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:01:15.663831 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-cefe4ebf-a69c-43e6-90e4-2f1bd508e0ba tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:15.664749 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-cefe4ebf-a69c-43e6-90e4-2f1bd508e0ba tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:15.670883 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cefe4ebf-a69c-43e6-90e4-2f1bd508e0ba tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:15.671335 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cefe4ebf-a69c-43e6-90e4-2f1bd508e0ba tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:15.672107 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cefe4ebf-a69c-43e6-90e4-2f1bd508e0ba tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:15.672548 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cefe4ebf-a69c-43e6-90e4-2f1bd508e0ba tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:15.700253 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-cefe4ebf-a69c-43e6-90e4-2f1bd508e0ba tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040368 Mar 08 15:01:15.700797 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 812/1645] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:15 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:01:15.991901 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ebfb40aa-b336-4743-9a17-8b90c0db68b8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:15.992563 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ebfb40aa-b336-4743-9a17-8b90c0db68b8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:15.999963 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ebfb40aa-b336-4743-9a17-8b90c0db68b8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:16.000411 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ebfb40aa-b336-4743-9a17-8b90c0db68b8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:16.001186 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ebfb40aa-b336-4743-9a17-8b90c0db68b8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:16.001626 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ebfb40aa-b336-4743-9a17-8b90c0db68b8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:16.135843 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ebfb40aa-b336-4743-9a17-8b90c0db68b8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:16.143234 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ebfb40aa-b336-4743-9a17-8b90c0db68b8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.155219 Mar 08 15:01:16.143799 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 834/1646] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:15 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:16.420524 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-2d52947f-4ad5-45d8-9de0-4dbc68159dec tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:16.421439 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-2d52947f-4ad5-45d8-9de0-4dbc68159dec tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:16.428123 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2d52947f-4ad5-45d8-9de0-4dbc68159dec tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:16.428581 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2d52947f-4ad5-45d8-9de0-4dbc68159dec tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:16.429353 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2d52947f-4ad5-45d8-9de0-4dbc68159dec tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:16.429798 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2d52947f-4ad5-45d8-9de0-4dbc68159dec tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:16.458104 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-2d52947f-4ad5-45d8-9de0-4dbc68159dec tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041632 Mar 08 15:01:16.458656 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 813/1647] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:01:16 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:01:16.475942 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-488df4f3-39ec-483c-850e-e2e72c938dea tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:16.476558 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-488df4f3-39ec-483c-850e-e2e72c938dea tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:16.483213 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-488df4f3-39ec-483c-850e-e2e72c938dea tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:16.483687 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-488df4f3-39ec-483c-850e-e2e72c938dea tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:16.484532 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-488df4f3-39ec-483c-850e-e2e72c938dea tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:16.485001 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-488df4f3-39ec-483c-850e-e2e72c938dea tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:16.547329 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-488df4f3-39ec-483c-850e-e2e72c938dea tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:16.555174 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-488df4f3-39ec-483c-850e-e2e72c938dea tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.083277 Mar 08 15:01:16.556487 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 835/1648] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:16 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:16.711781 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-9ef945b7-6717-41ae-aeb8-97acabda1247 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:16.713279 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-9ef945b7-6717-41ae-aeb8-97acabda1247 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:16.719204 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9ef945b7-6717-41ae-aeb8-97acabda1247 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:16.719652 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9ef945b7-6717-41ae-aeb8-97acabda1247 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:16.720408 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9ef945b7-6717-41ae-aeb8-97acabda1247 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:16.720841 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9ef945b7-6717-41ae-aeb8-97acabda1247 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:16.748161 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-9ef945b7-6717-41ae-aeb8-97acabda1247 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040388 Mar 08 15:01:16.748699 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 814/1649] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:16 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:01:17.160050 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-323fd864-046a-476f-9037-71c5215521a0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:17.160664 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-323fd864-046a-476f-9037-71c5215521a0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:17.166970 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-323fd864-046a-476f-9037-71c5215521a0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:17.167425 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-323fd864-046a-476f-9037-71c5215521a0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:17.168194 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-323fd864-046a-476f-9037-71c5215521a0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:17.168633 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-323fd864-046a-476f-9037-71c5215521a0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:17.302897 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-323fd864-046a-476f-9037-71c5215521a0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:17.310363 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-323fd864-046a-476f-9037-71c5215521a0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.154102 Mar 08 15:01:17.311133 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 836/1650] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:17 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:17.470120 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-92407b8b-aa97-45f9-82af-43fbc4ce5017 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:17.470961 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-92407b8b-aa97-45f9-82af-43fbc4ce5017 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:17.477220 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-92407b8b-aa97-45f9-82af-43fbc4ce5017 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:17.478375 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-92407b8b-aa97-45f9-82af-43fbc4ce5017 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:17.479158 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-92407b8b-aa97-45f9-82af-43fbc4ce5017 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:17.479643 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-92407b8b-aa97-45f9-82af-43fbc4ce5017 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:17.508131 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-92407b8b-aa97-45f9-82af-43fbc4ce5017 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042260 Mar 08 15:01:17.508679 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 815/1651] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:01:17 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:01:17.573319 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-662af6db-a0de-4543-8617-923e963c5220 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:17.573953 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-662af6db-a0de-4543-8617-923e963c5220 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:17.579877 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-662af6db-a0de-4543-8617-923e963c5220 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:17.580384 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-662af6db-a0de-4543-8617-923e963c5220 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:17.581099 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-662af6db-a0de-4543-8617-923e963c5220 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:17.581564 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-662af6db-a0de-4543-8617-923e963c5220 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:17.640341 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-662af6db-a0de-4543-8617-923e963c5220 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:17.647628 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-662af6db-a0de-4543-8617-923e963c5220 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078750 Mar 08 15:01:17.648189 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 837/1652] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:17 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:17.760377 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-845345b4-f6be-4f46-9f6c-d2c390493c8f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:17.761284 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-845345b4-f6be-4f46-9f6c-d2c390493c8f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:17.767156 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-845345b4-f6be-4f46-9f6c-d2c390493c8f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:17.767603 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-845345b4-f6be-4f46-9f6c-d2c390493c8f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:17.768360 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-845345b4-f6be-4f46-9f6c-d2c390493c8f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:17.768795 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-845345b4-f6be-4f46-9f6c-d2c390493c8f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:17.795822 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-845345b4-f6be-4f46-9f6c-d2c390493c8f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040267 Mar 08 15:01:17.796361 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 816/1653] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:17 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:01:18.328075 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3c11069e-018d-4a84-826c-54b6d1be5367 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:18.328687 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-3c11069e-018d-4a84-826c-54b6d1be5367 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:18.335009 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3c11069e-018d-4a84-826c-54b6d1be5367 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:18.335464 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3c11069e-018d-4a84-826c-54b6d1be5367 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:18.336231 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3c11069e-018d-4a84-826c-54b6d1be5367 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:18.336671 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3c11069e-018d-4a84-826c-54b6d1be5367 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:18.469750 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-3c11069e-018d-4a84-826c-54b6d1be5367 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:18.477010 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-3c11069e-018d-4a84-826c-54b6d1be5367 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.152800 Mar 08 15:01:18.478244 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 838/1654] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:18 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:18.520307 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-7ca1e58f-c2c6-44f9-9900-3c6414089743 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:18.521255 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-7ca1e58f-c2c6-44f9-9900-3c6414089743 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:18.528101 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7ca1e58f-c2c6-44f9-9900-3c6414089743 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:18.528561 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7ca1e58f-c2c6-44f9-9900-3c6414089743 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:18.529334 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7ca1e58f-c2c6-44f9-9900-3c6414089743 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:18.529805 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7ca1e58f-c2c6-44f9-9900-3c6414089743 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:18.558101 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-7ca1e58f-c2c6-44f9-9900-3c6414089743 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041718 Mar 08 15:01:18.558652 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 817/1655] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:01:18 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:01:18.665344 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-4c2d7f3a-3e61-43d6-b8af-6a08c39a43a8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:18.666117 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-4c2d7f3a-3e61-43d6-b8af-6a08c39a43a8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:18.671733 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4c2d7f3a-3e61-43d6-b8af-6a08c39a43a8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:18.672189 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4c2d7f3a-3e61-43d6-b8af-6a08c39a43a8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:18.672963 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4c2d7f3a-3e61-43d6-b8af-6a08c39a43a8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:18.673399 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4c2d7f3a-3e61-43d6-b8af-6a08c39a43a8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:18.735569 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-4c2d7f3a-3e61-43d6-b8af-6a08c39a43a8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:18.742892 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-4c2d7f3a-3e61-43d6-b8af-6a08c39a43a8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081664 Mar 08 15:01:18.743489 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 839/1656] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:18 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:18.806790 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-af6e3582-7b4e-446b-b859-0ef998c6cd9b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:18.807697 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-af6e3582-7b4e-446b-b859-0ef998c6cd9b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:18.813424 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-af6e3582-7b4e-446b-b859-0ef998c6cd9b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:18.814002 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-af6e3582-7b4e-446b-b859-0ef998c6cd9b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:18.814716 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-af6e3582-7b4e-446b-b859-0ef998c6cd9b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:18.815147 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-af6e3582-7b4e-446b-b859-0ef998c6cd9b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:18.843264 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-af6e3582-7b4e-446b-b859-0ef998c6cd9b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040437 Mar 08 15:01:18.843807 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 818/1657] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:18 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 15:01:19.494671 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-7da9019b-af44-4e87-bcf4-8cf75d9c4d06 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:19.495347 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-7da9019b-af44-4e87-bcf4-8cf75d9c4d06 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:19.501801 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7da9019b-af44-4e87-bcf4-8cf75d9c4d06 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:19.502281 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7da9019b-af44-4e87-bcf4-8cf75d9c4d06 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:19.503048 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7da9019b-af44-4e87-bcf4-8cf75d9c4d06 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:19.503481 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7da9019b-af44-4e87-bcf4-8cf75d9c4d06 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:19.570290 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-e85e62fc-4942-4c8f-878f-147883e85dad tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:19.571763 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-e85e62fc-4942-4c8f-878f-147883e85dad tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:19.578441 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e85e62fc-4942-4c8f-878f-147883e85dad tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:19.578628 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e85e62fc-4942-4c8f-878f-147883e85dad tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:19.579367 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e85e62fc-4942-4c8f-878f-147883e85dad tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:19.579804 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e85e62fc-4942-4c8f-878f-147883e85dad tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:19.609476 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-e85e62fc-4942-4c8f-878f-147883e85dad tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043203 Mar 08 15:01:19.610418 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 819/1658] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:01:19 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 15:01:19.638398 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-7da9019b-af44-4e87-bcf4-8cf75d9c4d06 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:19.645616 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-7da9019b-af44-4e87-bcf4-8cf75d9c4d06 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.154864 Mar 08 15:01:19.646225 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 840/1659] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:19 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:19.759818 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-f2d1c933-2814-4088-98d7-c22c24ca2b02 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:19.760247 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-f2d1c933-2814-4088-98d7-c22c24ca2b02 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:19.766171 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f2d1c933-2814-4088-98d7-c22c24ca2b02 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:19.766635 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f2d1c933-2814-4088-98d7-c22c24ca2b02 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:19.767407 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f2d1c933-2814-4088-98d7-c22c24ca2b02 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:19.767852 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f2d1c933-2814-4088-98d7-c22c24ca2b02 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:19.829955 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-f2d1c933-2814-4088-98d7-c22c24ca2b02 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:19.837381 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-f2d1c933-2814-4088-98d7-c22c24ca2b02 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.082147 Mar 08 15:01:19.838131 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 820/1660] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:19 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:19.854949 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-17300496-176a-435b-bf7a-edbff6ec265b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:19.855868 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-17300496-176a-435b-bf7a-edbff6ec265b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:19.861600 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-17300496-176a-435b-bf7a-edbff6ec265b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:19.862094 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-17300496-176a-435b-bf7a-edbff6ec265b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:19.862870 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-17300496-176a-435b-bf7a-edbff6ec265b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:19.863313 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-17300496-176a-435b-bf7a-edbff6ec265b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:19.891138 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-17300496-176a-435b-bf7a-edbff6ec265b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040359 Mar 08 15:01:19.891682 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 841/1661] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:19 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:01:20.621727 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-da3022fd-5820-4aac-bcc1-380b1886bb85 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:20.622670 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-da3022fd-5820-4aac-bcc1-380b1886bb85 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:20.628947 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-da3022fd-5820-4aac-bcc1-380b1886bb85 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:20.629401 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-da3022fd-5820-4aac-bcc1-380b1886bb85 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:20.630198 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-da3022fd-5820-4aac-bcc1-380b1886bb85 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:20.630641 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-da3022fd-5820-4aac-bcc1-380b1886bb85 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:20.659115 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-da3022fd-5820-4aac-bcc1-380b1886bb85 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042349 Mar 08 15:01:20.659590 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 821/1662] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:01:20 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:01:20.663220 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-0f2cd2ff-9669-4dd8-bf28-ff606e1b4655 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:20.663828 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-0f2cd2ff-9669-4dd8-bf28-ff606e1b4655 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:20.670173 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0f2cd2ff-9669-4dd8-bf28-ff606e1b4655 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:20.670621 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0f2cd2ff-9669-4dd8-bf28-ff606e1b4655 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:20.671386 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0f2cd2ff-9669-4dd8-bf28-ff606e1b4655 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:20.671821 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0f2cd2ff-9669-4dd8-bf28-ff606e1b4655 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:20.807823 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-0f2cd2ff-9669-4dd8-bf28-ff606e1b4655 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:20.815043 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-0f2cd2ff-9669-4dd8-bf28-ff606e1b4655 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.155825 Mar 08 15:01:20.815603 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 842/1663] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:20 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:01:20.854912 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-150fa3d4-fd9f-46e0-a5a5-c96017142889 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:20.855515 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-150fa3d4-fd9f-46e0-a5a5-c96017142889 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:20.861155 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-150fa3d4-fd9f-46e0-a5a5-c96017142889 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:20.861606 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-150fa3d4-fd9f-46e0-a5a5-c96017142889 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:20.862398 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-150fa3d4-fd9f-46e0-a5a5-c96017142889 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:20.862833 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-150fa3d4-fd9f-46e0-a5a5-c96017142889 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:20.902664 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c3fd427b-54bc-4952-8649-4fcb2f8ce59b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:20.903581 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-c3fd427b-54bc-4952-8649-4fcb2f8ce59b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:20.909414 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c3fd427b-54bc-4952-8649-4fcb2f8ce59b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:20.909802 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c3fd427b-54bc-4952-8649-4fcb2f8ce59b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:20.910609 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c3fd427b-54bc-4952-8649-4fcb2f8ce59b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:20.911048 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c3fd427b-54bc-4952-8649-4fcb2f8ce59b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:20.921593 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-150fa3d4-fd9f-46e0-a5a5-c96017142889 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:20.929066 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-150fa3d4-fd9f-46e0-a5a5-c96017142889 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078657 Mar 08 15:01:20.929953 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 822/1664] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:20 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:20.940986 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-c3fd427b-54bc-4952-8649-4fcb2f8ce59b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042372 Mar 08 15:01:20.941547 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 843/1665] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:20 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 15:01:21.732338 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-73d81d23-d8f5-441d-b76c-0f506c40db82 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:21.733294 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-73d81d23-d8f5-441d-b76c-0f506c40db82 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:21.739160 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-73d81d23-d8f5-441d-b76c-0f506c40db82 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:21.739614 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-73d81d23-d8f5-441d-b76c-0f506c40db82 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:21.740383 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-73d81d23-d8f5-441d-b76c-0f506c40db82 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:21.740824 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-73d81d23-d8f5-441d-b76c-0f506c40db82 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:21.768583 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-73d81d23-d8f5-441d-b76c-0f506c40db82 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.102696 Mar 08 15:01:21.769129 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 823/1666] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:01:21 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:01:21.832542 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-48d9da6b-bceb-4b8e-a09f-57e3e5e58ba5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:21.833092 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-48d9da6b-bceb-4b8e-a09f-57e3e5e58ba5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:21.839952 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-48d9da6b-bceb-4b8e-a09f-57e3e5e58ba5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:21.840410 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-48d9da6b-bceb-4b8e-a09f-57e3e5e58ba5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:21.841185 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-48d9da6b-bceb-4b8e-a09f-57e3e5e58ba5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:21.841629 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-48d9da6b-bceb-4b8e-a09f-57e3e5e58ba5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:21.949716 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-a0688b57-ce6b-4f00-9dff-fcd47e82ec75 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:21.949716 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-a0688b57-ce6b-4f00-9dff-fcd47e82ec75 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:21.953952 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a0688b57-ce6b-4f00-9dff-fcd47e82ec75 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:21.954413 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a0688b57-ce6b-4f00-9dff-fcd47e82ec75 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:21.955199 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a0688b57-ce6b-4f00-9dff-fcd47e82ec75 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:21.955813 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a0688b57-ce6b-4f00-9dff-fcd47e82ec75 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:21.978476 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-48d9da6b-bceb-4b8e-a09f-57e3e5e58ba5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:21.985889 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-48d9da6b-bceb-4b8e-a09f-57e3e5e58ba5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.157233 Mar 08 15:01:21.986489 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 844/1667] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:21 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:21.990980 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-61998785-08ef-4270-bf73-1c705474b16d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:21.991912 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-61998785-08ef-4270-bf73-1c705474b16d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:21.998617 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-61998785-08ef-4270-bf73-1c705474b16d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:21.999066 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-61998785-08ef-4270-bf73-1c705474b16d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:21.999855 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-61998785-08ef-4270-bf73-1c705474b16d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:22.000292 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-61998785-08ef-4270-bf73-1c705474b16d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:22.016676 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-a0688b57-ce6b-4f00-9dff-fcd47e82ec75 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:22.024462 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-a0688b57-ce6b-4f00-9dff-fcd47e82ec75 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081775 Mar 08 15:01:22.025311 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 824/1668] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:21 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:01:22.029207 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-61998785-08ef-4270-bf73-1c705474b16d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041708 Mar 08 15:01:22.029890 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 845/1669] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:21 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:01:22.781008 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-8108e956-5b27-4f80-85d3-7f17a660d3a3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:22.781954 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-8108e956-5b27-4f80-85d3-7f17a660d3a3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:22.788187 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8108e956-5b27-4f80-85d3-7f17a660d3a3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:22.788633 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8108e956-5b27-4f80-85d3-7f17a660d3a3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:22.789396 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8108e956-5b27-4f80-85d3-7f17a660d3a3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:22.789833 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8108e956-5b27-4f80-85d3-7f17a660d3a3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:22.818424 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-8108e956-5b27-4f80-85d3-7f17a660d3a3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041554 Mar 08 15:01:22.818966 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 825/1670] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:01:22 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:01:23.003739 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d641f957-34fa-4f8b-afdb-677c3c3c65fa tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:23.004350 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d641f957-34fa-4f8b-afdb-677c3c3c65fa tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:23.011218 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d641f957-34fa-4f8b-afdb-677c3c3c65fa tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:23.011662 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d641f957-34fa-4f8b-afdb-677c3c3c65fa tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:23.012426 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d641f957-34fa-4f8b-afdb-677c3c3c65fa tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:23.012860 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d641f957-34fa-4f8b-afdb-677c3c3c65fa tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:23.041081 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-ed2a0823-5e33-4124-a29a-500be83f07c7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:23.041987 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-ed2a0823-5e33-4124-a29a-500be83f07c7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:23.048154 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ed2a0823-5e33-4124-a29a-500be83f07c7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:23.048607 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ed2a0823-5e33-4124-a29a-500be83f07c7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:23.049378 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ed2a0823-5e33-4124-a29a-500be83f07c7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:23.049815 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ed2a0823-5e33-4124-a29a-500be83f07c7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:23.079326 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-ed2a0823-5e33-4124-a29a-500be83f07c7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042588 Mar 08 15:01:23.079893 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 826/1671] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:23 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 15:01:23.084240 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-66224784-bb95-445d-8b10-a03d69fa7b93 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:23.084842 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-66224784-bb95-445d-8b10-a03d69fa7b93 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:23.090892 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-66224784-bb95-445d-8b10-a03d69fa7b93 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:23.091342 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-66224784-bb95-445d-8b10-a03d69fa7b93 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:23.092110 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-66224784-bb95-445d-8b10-a03d69fa7b93 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:23.092547 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-66224784-bb95-445d-8b10-a03d69fa7b93 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:23.146676 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d641f957-34fa-4f8b-afdb-677c3c3c65fa tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:23.154119 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-66224784-bb95-445d-8b10-a03d69fa7b93 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:23.154282 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d641f957-34fa-4f8b-afdb-677c3c3c65fa tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.154233 Mar 08 15:01:23.154782 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 846/1672] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:22 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:23.161450 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-66224784-bb95-445d-8b10-a03d69fa7b93 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080601 Mar 08 15:01:23.162033 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 827/1673] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:23 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:23.829657 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-af67a62c-d3c0-4188-91eb-d941c53e505c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:23.830648 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-af67a62c-d3c0-4188-91eb-d941c53e505c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:23.836469 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-af67a62c-d3c0-4188-91eb-d941c53e505c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:23.837557 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-af67a62c-d3c0-4188-91eb-d941c53e505c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:23.838498 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-af67a62c-d3c0-4188-91eb-d941c53e505c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:23.838942 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-af67a62c-d3c0-4188-91eb-d941c53e505c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:23.865926 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-af67a62c-d3c0-4188-91eb-d941c53e505c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040234 Mar 08 15:01:23.866466 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 847/1674] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:01:23 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:01:24.091303 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-3786b8ed-1acb-477d-b55a-af3989e2ebc1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:24.092155 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-3786b8ed-1acb-477d-b55a-af3989e2ebc1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:24.098424 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3786b8ed-1acb-477d-b55a-af3989e2ebc1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:24.098874 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3786b8ed-1acb-477d-b55a-af3989e2ebc1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:24.099642 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3786b8ed-1acb-477d-b55a-af3989e2ebc1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:24.100079 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3786b8ed-1acb-477d-b55a-af3989e2ebc1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:24.127928 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-3786b8ed-1acb-477d-b55a-af3989e2ebc1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041375 Mar 08 15:01:24.128758 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 828/1675] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:24 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:01:24.171358 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-089bb5d9-743c-4fa2-923f-9d5d95d1cc31 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:24.173320 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-089bb5d9-743c-4fa2-923f-9d5d95d1cc31 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:24.178348 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-089bb5d9-743c-4fa2-923f-9d5d95d1cc31 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:24.178802 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-27cc3d23-d28f-47f6-90fd-72687982853d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:24.178965 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-089bb5d9-743c-4fa2-923f-9d5d95d1cc31 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:24.179416 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-27cc3d23-d28f-47f6-90fd-72687982853d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:24.179591 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-089bb5d9-743c-4fa2-923f-9d5d95d1cc31 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:24.180024 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-089bb5d9-743c-4fa2-923f-9d5d95d1cc31 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:24.185827 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-27cc3d23-d28f-47f6-90fd-72687982853d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:24.186316 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-27cc3d23-d28f-47f6-90fd-72687982853d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:24.187091 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-27cc3d23-d28f-47f6-90fd-72687982853d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:24.187534 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-27cc3d23-d28f-47f6-90fd-72687982853d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:24.246736 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-27cc3d23-d28f-47f6-90fd-72687982853d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:24.254099 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-27cc3d23-d28f-47f6-90fd-72687982853d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079448 Mar 08 15:01:24.254674 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 829/1676] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:24 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:24.325482 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-089bb5d9-743c-4fa2-923f-9d5d95d1cc31 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:24.332764 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-089bb5d9-743c-4fa2-923f-9d5d95d1cc31 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.165224 Mar 08 15:01:24.333322 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 848/1677] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:24 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:24.876978 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-5bd0a534-f0f1-4177-8068-bbb0b61d2541 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:24.877912 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-5bd0a534-f0f1-4177-8068-bbb0b61d2541 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:24.884194 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5bd0a534-f0f1-4177-8068-bbb0b61d2541 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:24.884545 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5bd0a534-f0f1-4177-8068-bbb0b61d2541 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:24.885313 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5bd0a534-f0f1-4177-8068-bbb0b61d2541 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:24.885757 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5bd0a534-f0f1-4177-8068-bbb0b61d2541 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:24.913298 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-5bd0a534-f0f1-4177-8068-bbb0b61d2541 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040293 Mar 08 15:01:24.913843 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 830/1678] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:01:24 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 15:01:24.963192 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 15:01:24.963367 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: Tue Mar 8 15:01:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 15:01:25.139973 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-4f67af1b-3c1e-4978-aa30-c81344585911 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:25.140825 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-4f67af1b-3c1e-4978-aa30-c81344585911 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:25.146659 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4f67af1b-3c1e-4978-aa30-c81344585911 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:25.147106 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4f67af1b-3c1e-4978-aa30-c81344585911 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:25.147862 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4f67af1b-3c1e-4978-aa30-c81344585911 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:25.148298 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4f67af1b-3c1e-4978-aa30-c81344585911 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:25.176963 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-4f67af1b-3c1e-4978-aa30-c81344585911 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041020 Mar 08 15:01:25.177565 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 849/1679] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:25 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:01:25.272443 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-7ab018ca-d672-4084-b101-9ade02162ce6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:25.273061 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-7ab018ca-d672-4084-b101-9ade02162ce6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:25.279862 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7ab018ca-d672-4084-b101-9ade02162ce6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:25.280316 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7ab018ca-d672-4084-b101-9ade02162ce6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:25.281091 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7ab018ca-d672-4084-b101-9ade02162ce6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:25.281532 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7ab018ca-d672-4084-b101-9ade02162ce6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:25.343638 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-7ab018ca-d672-4084-b101-9ade02162ce6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:25.350025 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-e9d2ad95-744e-4695-95ac-69bb4e3c80c4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:25.350690 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-e9d2ad95-744e-4695-95ac-69bb4e3c80c4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:25.351032 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-7ab018ca-d672-4084-b101-9ade02162ce6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.082432 Mar 08 15:01:25.351599 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 831/1680] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:25 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:25.357427 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e9d2ad95-744e-4695-95ac-69bb4e3c80c4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:25.357954 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e9d2ad95-744e-4695-95ac-69bb4e3c80c4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:25.358785 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e9d2ad95-744e-4695-95ac-69bb4e3c80c4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:25.359266 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e9d2ad95-744e-4695-95ac-69bb4e3c80c4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:25.498458 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-e9d2ad95-744e-4695-95ac-69bb4e3c80c4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:25.505657 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-e9d2ad95-744e-4695-95ac-69bb4e3c80c4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.159976 Mar 08 15:01:25.506283 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 850/1681] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:25 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:01:25.924781 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-a3a46a72-8b5b-4ed8-be29-ab89719d7f95 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:25.925692 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-a3a46a72-8b5b-4ed8-be29-ab89719d7f95 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:25.931875 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a3a46a72-8b5b-4ed8-be29-ab89719d7f95 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:25.932331 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a3a46a72-8b5b-4ed8-be29-ab89719d7f95 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:25.933101 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a3a46a72-8b5b-4ed8-be29-ab89719d7f95 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:25.933575 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a3a46a72-8b5b-4ed8-be29-ab89719d7f95 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:25.961571 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-a3a46a72-8b5b-4ed8-be29-ab89719d7f95 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040785 Mar 08 15:01:25.963288 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 832/1682] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:01:25 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:01:26.188336 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-92e65cba-ff80-4ef6-bf09-1c53ab9136ac tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:26.189288 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-92e65cba-ff80-4ef6-bf09-1c53ab9136ac tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:26.195170 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-92e65cba-ff80-4ef6-bf09-1c53ab9136ac tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:26.195629 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-92e65cba-ff80-4ef6-bf09-1c53ab9136ac tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:26.197418 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-92e65cba-ff80-4ef6-bf09-1c53ab9136ac tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:26.197885 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-92e65cba-ff80-4ef6-bf09-1c53ab9136ac tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:26.226771 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-92e65cba-ff80-4ef6-bf09-1c53ab9136ac tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042469 Mar 08 15:01:26.227324 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 851/1683] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:26 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:01:26.368304 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-cca94b88-a398-4067-b003-96d2d334b9af tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:26.368941 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-cca94b88-a398-4067-b003-96d2d334b9af tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:26.375182 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cca94b88-a398-4067-b003-96d2d334b9af tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:26.375630 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cca94b88-a398-4067-b003-96d2d334b9af tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:26.376422 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cca94b88-a398-4067-b003-96d2d334b9af tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:26.376860 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cca94b88-a398-4067-b003-96d2d334b9af tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:26.439659 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-cca94b88-a398-4067-b003-96d2d334b9af tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:26.447782 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-cca94b88-a398-4067-b003-96d2d334b9af tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.083474 Mar 08 15:01:26.448342 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 833/1684] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:26 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:26.522210 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-10e4bad6-2416-429e-8685-7f556f9442d5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:26.522825 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-10e4bad6-2416-429e-8685-7f556f9442d5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:26.529692 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-10e4bad6-2416-429e-8685-7f556f9442d5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:26.530178 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-10e4bad6-2416-429e-8685-7f556f9442d5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:26.530951 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-10e4bad6-2416-429e-8685-7f556f9442d5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:26.531387 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-10e4bad6-2416-429e-8685-7f556f9442d5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:26.666281 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-10e4bad6-2416-429e-8685-7f556f9442d5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:26.673733 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-10e4bad6-2416-429e-8685-7f556f9442d5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.155296 Mar 08 15:01:26.674338 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 852/1685] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:26 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:26.974040 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-0095994e-85c3-4b00-b020-7cc4863a73f9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:26.974949 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-0095994e-85c3-4b00-b020-7cc4863a73f9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:26.981287 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0095994e-85c3-4b00-b020-7cc4863a73f9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:26.981735 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0095994e-85c3-4b00-b020-7cc4863a73f9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:26.982527 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0095994e-85c3-4b00-b020-7cc4863a73f9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:26.982962 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0095994e-85c3-4b00-b020-7cc4863a73f9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:27.010546 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-0095994e-85c3-4b00-b020-7cc4863a73f9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040493 Mar 08 15:01:27.011081 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 834/1686] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:01:26 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:01:27.238579 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-81f24883-2f20-4f55-9b61-f3c2b6adec27 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:27.239510 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-81f24883-2f20-4f55-9b61-f3c2b6adec27 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:27.245617 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-81f24883-2f20-4f55-9b61-f3c2b6adec27 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:27.246099 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-81f24883-2f20-4f55-9b61-f3c2b6adec27 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:27.246870 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-81f24883-2f20-4f55-9b61-f3c2b6adec27 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:27.247311 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-81f24883-2f20-4f55-9b61-f3c2b6adec27 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:27.274040 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-81f24883-2f20-4f55-9b61-f3c2b6adec27 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039448 Mar 08 15:01:27.275093 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 853/1687] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:27 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:01:27.465847 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-56406c7d-dc02-4628-92e8-06d60bb74777 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:27.466667 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-56406c7d-dc02-4628-92e8-06d60bb74777 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:27.473462 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-56406c7d-dc02-4628-92e8-06d60bb74777 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:27.473962 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-56406c7d-dc02-4628-92e8-06d60bb74777 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:27.474795 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-56406c7d-dc02-4628-92e8-06d60bb74777 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:27.475254 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-56406c7d-dc02-4628-92e8-06d60bb74777 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:27.536148 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-56406c7d-dc02-4628-92e8-06d60bb74777 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:27.544135 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-56406c7d-dc02-4628-92e8-06d60bb74777 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.083208 Mar 08 15:01:27.544691 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 835/1688] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:27 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:27.694087 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c492e669-e799-4395-aa0a-a880ee63decf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:27.694694 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-c492e669-e799-4395-aa0a-a880ee63decf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:27.701366 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c492e669-e799-4395-aa0a-a880ee63decf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:27.701818 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c492e669-e799-4395-aa0a-a880ee63decf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:27.702606 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c492e669-e799-4395-aa0a-a880ee63decf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:27.703041 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c492e669-e799-4395-aa0a-a880ee63decf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:27.839962 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-c492e669-e799-4395-aa0a-a880ee63decf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:27.847231 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-c492e669-e799-4395-aa0a-a880ee63decf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.157089 Mar 08 15:01:27.847781 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 854/1689] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:27 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:01:28.022220 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-5fc0fed3-d734-4045-9e9f-22138f674218 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:28.023144 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-5fc0fed3-d734-4045-9e9f-22138f674218 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:28.029114 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5fc0fed3-d734-4045-9e9f-22138f674218 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:28.029576 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5fc0fed3-d734-4045-9e9f-22138f674218 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:28.030380 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5fc0fed3-d734-4045-9e9f-22138f674218 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:28.030828 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5fc0fed3-d734-4045-9e9f-22138f674218 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:28.059419 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-5fc0fed3-d734-4045-9e9f-22138f674218 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041204 Mar 08 15:01:28.059909 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 836/1690] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:01:28 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:01:28.286119 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b54134a5-3ecd-4821-bebd-fe7b64290493 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:28.287039 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b54134a5-3ecd-4821-bebd-fe7b64290493 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:28.292954 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b54134a5-3ecd-4821-bebd-fe7b64290493 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:28.293403 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b54134a5-3ecd-4821-bebd-fe7b64290493 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:28.294187 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b54134a5-3ecd-4821-bebd-fe7b64290493 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:28.294623 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b54134a5-3ecd-4821-bebd-fe7b64290493 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:28.324598 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b54134a5-3ecd-4821-bebd-fe7b64290493 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042253 Mar 08 15:01:28.325118 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 855/1691] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:28 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:01:28.561621 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-f9807bde-9c90-49ea-b186-5c626b2cb169 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:28.562262 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-f9807bde-9c90-49ea-b186-5c626b2cb169 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:28.568735 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f9807bde-9c90-49ea-b186-5c626b2cb169 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:28.569192 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f9807bde-9c90-49ea-b186-5c626b2cb169 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:28.569993 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f9807bde-9c90-49ea-b186-5c626b2cb169 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:28.570434 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f9807bde-9c90-49ea-b186-5c626b2cb169 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:28.628951 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-f9807bde-9c90-49ea-b186-5c626b2cb169 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:28.636525 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-f9807bde-9c90-49ea-b186-5c626b2cb169 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078708 Mar 08 15:01:28.637084 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 837/1692] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:28 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:28.864310 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-e989fed1-1aae-4dc2-90bf-88a17fe434a4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:28.864917 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-e989fed1-1aae-4dc2-90bf-88a17fe434a4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:28.871643 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e989fed1-1aae-4dc2-90bf-88a17fe434a4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:28.872095 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e989fed1-1aae-4dc2-90bf-88a17fe434a4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:28.872863 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e989fed1-1aae-4dc2-90bf-88a17fe434a4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:28.873300 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e989fed1-1aae-4dc2-90bf-88a17fe434a4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:29.007136 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-e989fed1-1aae-4dc2-90bf-88a17fe434a4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:29.015016 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-e989fed1-1aae-4dc2-90bf-88a17fe434a4 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.154600 Mar 08 15:01:29.015574 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 856/1693] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:28 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:29.070499 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-d5a3a5dd-f2bb-4c85-8535-64d3fb2d6edf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:29.072057 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-d5a3a5dd-f2bb-4c85-8535-64d3fb2d6edf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:29.077884 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d5a3a5dd-f2bb-4c85-8535-64d3fb2d6edf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:29.078347 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d5a3a5dd-f2bb-4c85-8535-64d3fb2d6edf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:29.079117 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d5a3a5dd-f2bb-4c85-8535-64d3fb2d6edf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:29.079564 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d5a3a5dd-f2bb-4c85-8535-64d3fb2d6edf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:29.107485 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-d5a3a5dd-f2bb-4c85-8535-64d3fb2d6edf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040990 Mar 08 15:01:29.108034 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 838/1694] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:01:29 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:01:29.336094 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-353cc59f-bce5-4503-86e3-0428ffefdb9b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:29.337050 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-353cc59f-bce5-4503-86e3-0428ffefdb9b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:29.342936 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-353cc59f-bce5-4503-86e3-0428ffefdb9b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:29.343390 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-353cc59f-bce5-4503-86e3-0428ffefdb9b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:29.344158 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-353cc59f-bce5-4503-86e3-0428ffefdb9b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:29.344597 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-353cc59f-bce5-4503-86e3-0428ffefdb9b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:29.372331 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-353cc59f-bce5-4503-86e3-0428ffefdb9b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040183 Mar 08 15:01:29.372878 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 857/1695] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:29 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:01:29.654391 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-e42fe96a-cb2f-4430-aca9-76e26a959702 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:29.655003 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-e42fe96a-cb2f-4430-aca9-76e26a959702 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:29.661170 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e42fe96a-cb2f-4430-aca9-76e26a959702 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:29.661621 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e42fe96a-cb2f-4430-aca9-76e26a959702 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:29.662425 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e42fe96a-cb2f-4430-aca9-76e26a959702 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:29.662862 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e42fe96a-cb2f-4430-aca9-76e26a959702 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:29.721440 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-e42fe96a-cb2f-4430-aca9-76e26a959702 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:29.729425 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-e42fe96a-cb2f-4430-aca9-76e26a959702 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078832 Mar 08 15:01:29.729993 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 839/1696] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:29 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:30.032315 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-9b1c91a9-4177-41ef-b666-2b119a6c0a64 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:30.032931 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-9b1c91a9-4177-41ef-b666-2b119a6c0a64 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:30.039172 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9b1c91a9-4177-41ef-b666-2b119a6c0a64 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:30.039625 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9b1c91a9-4177-41ef-b666-2b119a6c0a64 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:30.040575 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9b1c91a9-4177-41ef-b666-2b119a6c0a64 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:30.041019 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9b1c91a9-4177-41ef-b666-2b119a6c0a64 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:30.119446 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-0c048b09-69da-4fef-9abd-5bf392814241 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:30.120527 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-0c048b09-69da-4fef-9abd-5bf392814241 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:30.126365 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0c048b09-69da-4fef-9abd-5bf392814241 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:30.126823 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0c048b09-69da-4fef-9abd-5bf392814241 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:30.127598 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0c048b09-69da-4fef-9abd-5bf392814241 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:30.128038 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0c048b09-69da-4fef-9abd-5bf392814241 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:30.158687 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-0c048b09-69da-4fef-9abd-5bf392814241 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043895 Mar 08 15:01:30.159440 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 840/1697] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:01:30 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 15:01:30.183498 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-9b1c91a9-4177-41ef-b666-2b119a6c0a64 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:30.190855 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-9b1c91a9-4177-41ef-b666-2b119a6c0a64 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.162357 Mar 08 15:01:30.191351 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 858/1698] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:30 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:30.384700 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-e2eaaca1-bfb0-4d9a-82cd-67c336536883 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:30.385641 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-e2eaaca1-bfb0-4d9a-82cd-67c336536883 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:30.391502 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e2eaaca1-bfb0-4d9a-82cd-67c336536883 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:30.391955 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e2eaaca1-bfb0-4d9a-82cd-67c336536883 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:30.392718 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e2eaaca1-bfb0-4d9a-82cd-67c336536883 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:30.393149 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e2eaaca1-bfb0-4d9a-82cd-67c336536883 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:30.420258 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-e2eaaca1-bfb0-4d9a-82cd-67c336536883 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040192 Mar 08 15:01:30.420803 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 841/1699] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:30 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:01:30.747188 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f44f0b47-f079-4b6b-9ebc-d5470a9d8c28 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:30.747852 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f44f0b47-f079-4b6b-9ebc-d5470a9d8c28 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:30.753978 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f44f0b47-f079-4b6b-9ebc-d5470a9d8c28 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:30.754428 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f44f0b47-f079-4b6b-9ebc-d5470a9d8c28 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:30.755194 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f44f0b47-f079-4b6b-9ebc-d5470a9d8c28 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:30.755678 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f44f0b47-f079-4b6b-9ebc-d5470a9d8c28 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:30.815190 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f44f0b47-f079-4b6b-9ebc-d5470a9d8c28 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:30.822422 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f44f0b47-f079-4b6b-9ebc-d5470a9d8c28 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080089 Mar 08 15:01:30.822986 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 859/1700] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:30 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:31.169769 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-6788ce80-5155-4c60-8c0b-9bfe3f89d2e1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:31.170627 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-6788ce80-5155-4c60-8c0b-9bfe3f89d2e1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:31.177110 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6788ce80-5155-4c60-8c0b-9bfe3f89d2e1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:31.177559 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6788ce80-5155-4c60-8c0b-9bfe3f89d2e1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:31.178357 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6788ce80-5155-4c60-8c0b-9bfe3f89d2e1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:31.178793 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6788ce80-5155-4c60-8c0b-9bfe3f89d2e1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:31.207360 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-6788ce80-5155-4c60-8c0b-9bfe3f89d2e1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041617 Mar 08 15:01:31.207904 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 842/1701] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:01:31 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:01:31.208866 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-06ba1932-b877-450e-b7cf-ceb7fc68dd97 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:31.209481 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-06ba1932-b877-450e-b7cf-ceb7fc68dd97 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:31.216052 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-06ba1932-b877-450e-b7cf-ceb7fc68dd97 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:31.216497 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-06ba1932-b877-450e-b7cf-ceb7fc68dd97 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:31.217296 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-06ba1932-b877-450e-b7cf-ceb7fc68dd97 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:31.217733 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-06ba1932-b877-450e-b7cf-ceb7fc68dd97 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:31.349809 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-06ba1932-b877-450e-b7cf-ceb7fc68dd97 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:31.357559 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-06ba1932-b877-450e-b7cf-ceb7fc68dd97 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.152577 Mar 08 15:01:31.358148 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 860/1702] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:31 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:01:31.432773 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-7be43d56-8f4e-43da-a77d-d2916ac6b897 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:31.433674 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-7be43d56-8f4e-43da-a77d-d2916ac6b897 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:31.439527 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7be43d56-8f4e-43da-a77d-d2916ac6b897 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:31.439984 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7be43d56-8f4e-43da-a77d-d2916ac6b897 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:31.440754 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7be43d56-8f4e-43da-a77d-d2916ac6b897 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:31.441198 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7be43d56-8f4e-43da-a77d-d2916ac6b897 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:31.474733 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-7be43d56-8f4e-43da-a77d-d2916ac6b897 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046686 Mar 08 15:01:31.475274 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 843/1703] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:31 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:01:31.839698 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-35f429ac-2944-47dc-989e-743f8916e323 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:31.840341 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-35f429ac-2944-47dc-989e-743f8916e323 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:31.846305 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-35f429ac-2944-47dc-989e-743f8916e323 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:31.846760 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-35f429ac-2944-47dc-989e-743f8916e323 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:31.847535 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-35f429ac-2944-47dc-989e-743f8916e323 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:31.847973 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-35f429ac-2944-47dc-989e-743f8916e323 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:31.909428 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-35f429ac-2944-47dc-989e-743f8916e323 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:31.918288 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-35f429ac-2944-47dc-989e-743f8916e323 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.082988 Mar 08 15:01:31.918850 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 861/1704] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:31 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:32.219155 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-9247cd26-4840-4334-9185-7464b1d13fbd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:32.219983 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-9247cd26-4840-4334-9185-7464b1d13fbd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:32.226420 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9247cd26-4840-4334-9185-7464b1d13fbd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:32.226877 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9247cd26-4840-4334-9185-7464b1d13fbd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:32.228698 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9247cd26-4840-4334-9185-7464b1d13fbd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:32.229142 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9247cd26-4840-4334-9185-7464b1d13fbd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:32.257380 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-9247cd26-4840-4334-9185-7464b1d13fbd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042341 Mar 08 15:01:32.257941 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 844/1705] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:01:32 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:01:32.375014 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-8973625c-d987-47c0-8e74-6303e4ebb081 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:32.375648 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-8973625c-d987-47c0-8e74-6303e4ebb081 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:32.381900 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8973625c-d987-47c0-8e74-6303e4ebb081 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:32.382352 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8973625c-d987-47c0-8e74-6303e4ebb081 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:32.383119 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8973625c-d987-47c0-8e74-6303e4ebb081 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:32.383820 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8973625c-d987-47c0-8e74-6303e4ebb081 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:32.485965 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-70593234-bfbf-4ad7-876c-e7ae78a033ff tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:32.487005 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-70593234-bfbf-4ad7-876c-e7ae78a033ff tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:32.493080 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-70593234-bfbf-4ad7-876c-e7ae78a033ff tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:32.493610 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-70593234-bfbf-4ad7-876c-e7ae78a033ff tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:32.494510 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-70593234-bfbf-4ad7-876c-e7ae78a033ff tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:32.495016 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-70593234-bfbf-4ad7-876c-e7ae78a033ff tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:32.515987 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-8973625c-d987-47c0-8e74-6303e4ebb081 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:32.523879 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-8973625c-d987-47c0-8e74-6303e4ebb081 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.152411 Mar 08 15:01:32.524584 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-70593234-bfbf-4ad7-876c-e7ae78a033ff tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042113 Mar 08 15:01:32.525371 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 845/1706] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:32 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 15:01:32.525529 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 862/1707] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:32 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:32.935574 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-fca52732-6045-4092-a4cf-c13dfd2d4ab8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:32.936102 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-fca52732-6045-4092-a4cf-c13dfd2d4ab8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:32.942024 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fca52732-6045-4092-a4cf-c13dfd2d4ab8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:32.942476 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fca52732-6045-4092-a4cf-c13dfd2d4ab8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:32.943237 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fca52732-6045-4092-a4cf-c13dfd2d4ab8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:32.943673 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fca52732-6045-4092-a4cf-c13dfd2d4ab8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:33.002798 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-fca52732-6045-4092-a4cf-c13dfd2d4ab8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:33.010196 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-fca52732-6045-4092-a4cf-c13dfd2d4ab8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078541 Mar 08 15:01:33.010753 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 846/1708] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:32 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:01:33.268682 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-730e16cf-dd10-4c2a-a560-c01b1e95e838 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:33.269589 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-730e16cf-dd10-4c2a-a560-c01b1e95e838 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:33.275997 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-730e16cf-dd10-4c2a-a560-c01b1e95e838 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:33.276444 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-730e16cf-dd10-4c2a-a560-c01b1e95e838 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:33.277205 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-730e16cf-dd10-4c2a-a560-c01b1e95e838 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:33.277638 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-730e16cf-dd10-4c2a-a560-c01b1e95e838 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:33.305406 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-730e16cf-dd10-4c2a-a560-c01b1e95e838 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040713 Mar 08 15:01:33.306051 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 863/1709] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:01:33 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:01:33.536277 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-67d68df4-0fa6-4b25-a102-aab941cb80eb tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:33.537105 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-67d68df4-0fa6-4b25-a102-aab941cb80eb tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:33.543266 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-6b27c7d0-e757-4af1-b1f9-510b625bfc72 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:33.543971 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-6b27c7d0-e757-4af1-b1f9-510b625bfc72 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:33.544273 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-67d68df4-0fa6-4b25-a102-aab941cb80eb tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:33.544725 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-67d68df4-0fa6-4b25-a102-aab941cb80eb tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:33.545499 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-67d68df4-0fa6-4b25-a102-aab941cb80eb tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:33.545963 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-67d68df4-0fa6-4b25-a102-aab941cb80eb tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:33.550952 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6b27c7d0-e757-4af1-b1f9-510b625bfc72 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:33.551681 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6b27c7d0-e757-4af1-b1f9-510b625bfc72 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:33.552476 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6b27c7d0-e757-4af1-b1f9-510b625bfc72 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:33.552917 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6b27c7d0-e757-4af1-b1f9-510b625bfc72 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:33.576503 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-67d68df4-0fa6-4b25-a102-aab941cb80eb tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044278 Mar 08 15:01:33.577073 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 847/1710] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:33 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:01:33.690080 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-6b27c7d0-e757-4af1-b1f9-510b625bfc72 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:33.698393 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-6b27c7d0-e757-4af1-b1f9-510b625bfc72 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.160354 Mar 08 15:01:33.698960 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 864/1711] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:33 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:34.026929 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-a1aeb51b-3148-449c-bacb-e81fa0cac372 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:34.027545 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-a1aeb51b-3148-449c-bacb-e81fa0cac372 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:34.033363 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a1aeb51b-3148-449c-bacb-e81fa0cac372 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:34.033819 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a1aeb51b-3148-449c-bacb-e81fa0cac372 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:34.034638 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a1aeb51b-3148-449c-bacb-e81fa0cac372 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:34.035062 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a1aeb51b-3148-449c-bacb-e81fa0cac372 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:34.092911 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-a1aeb51b-3148-449c-bacb-e81fa0cac372 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:34.100216 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-a1aeb51b-3148-449c-bacb-e81fa0cac372 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.077159 Mar 08 15:01:34.100775 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 848/1712] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:34 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:34.317172 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-25ca7454-1c3f-44ef-9c20-51b4582676a1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:34.318293 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-25ca7454-1c3f-44ef-9c20-51b4582676a1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:34.325449 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-25ca7454-1c3f-44ef-9c20-51b4582676a1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:34.325930 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-25ca7454-1c3f-44ef-9c20-51b4582676a1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:34.326701 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-25ca7454-1c3f-44ef-9c20-51b4582676a1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:34.327162 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-25ca7454-1c3f-44ef-9c20-51b4582676a1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:34.355870 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-25ca7454-1c3f-44ef-9c20-51b4582676a1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042952 Mar 08 15:01:34.356413 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 865/1713] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:01:34 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:01:34.588280 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-8aa4b08d-e10d-4090-8e46-e3b3e63c6b7c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:34.589111 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-8aa4b08d-e10d-4090-8e46-e3b3e63c6b7c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:34.595427 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8aa4b08d-e10d-4090-8e46-e3b3e63c6b7c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:34.595886 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8aa4b08d-e10d-4090-8e46-e3b3e63c6b7c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:34.596647 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8aa4b08d-e10d-4090-8e46-e3b3e63c6b7c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:34.597099 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8aa4b08d-e10d-4090-8e46-e3b3e63c6b7c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:34.625365 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-8aa4b08d-e10d-4090-8e46-e3b3e63c6b7c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041305 Mar 08 15:01:34.625933 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 849/1714] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:34 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:01:34.715661 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-768bbf27-e7c1-4363-86ea-9339115fdf6b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:34.716271 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-768bbf27-e7c1-4363-86ea-9339115fdf6b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:34.722505 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-768bbf27-e7c1-4363-86ea-9339115fdf6b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:34.722953 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-768bbf27-e7c1-4363-86ea-9339115fdf6b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:34.723714 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-768bbf27-e7c1-4363-86ea-9339115fdf6b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:34.724149 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-768bbf27-e7c1-4363-86ea-9339115fdf6b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:35.079105 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-768bbf27-e7c1-4363-86ea-9339115fdf6b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:35.086258 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-768bbf27-e7c1-4363-86ea-9339115fdf6b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.374917 Mar 08 15:01:35.087449 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 866/1715] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:34 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:35.116357 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-00d38e17-9f59-468e-96bd-5d4fbe9849ab tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:35.116969 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-00d38e17-9f59-468e-96bd-5d4fbe9849ab tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:35.123068 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-00d38e17-9f59-468e-96bd-5d4fbe9849ab tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:35.123517 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-00d38e17-9f59-468e-96bd-5d4fbe9849ab tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:35.124282 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-00d38e17-9f59-468e-96bd-5d4fbe9849ab tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:35.124720 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-00d38e17-9f59-468e-96bd-5d4fbe9849ab tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:35.186310 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-00d38e17-9f59-468e-96bd-5d4fbe9849ab tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:35.193536 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-00d38e17-9f59-468e-96bd-5d4fbe9849ab tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081011 Mar 08 15:01:35.194058 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 850/1716] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:35 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:35.367468 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-8adeb30b-32b8-4d1a-b003-835d4588f8ce tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:35.368505 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-8adeb30b-32b8-4d1a-b003-835d4588f8ce tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:35.374324 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8adeb30b-32b8-4d1a-b003-835d4588f8ce tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:35.374773 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8adeb30b-32b8-4d1a-b003-835d4588f8ce tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:35.375536 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8adeb30b-32b8-4d1a-b003-835d4588f8ce tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:35.375974 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8adeb30b-32b8-4d1a-b003-835d4588f8ce tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:35.405456 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-8adeb30b-32b8-4d1a-b003-835d4588f8ce tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041952 Mar 08 15:01:35.406027 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 867/1717] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:01:35 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:01:35.637445 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-eff35c94-472f-4b7f-a8fb-1ecf7dfeccbb tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:35.638383 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-eff35c94-472f-4b7f-a8fb-1ecf7dfeccbb tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:35.644600 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-eff35c94-472f-4b7f-a8fb-1ecf7dfeccbb tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:35.645048 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-eff35c94-472f-4b7f-a8fb-1ecf7dfeccbb tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:35.645804 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-eff35c94-472f-4b7f-a8fb-1ecf7dfeccbb tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:35.646270 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-eff35c94-472f-4b7f-a8fb-1ecf7dfeccbb tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:35.673244 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-eff35c94-472f-4b7f-a8fb-1ecf7dfeccbb tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040409 Mar 08 15:01:35.673801 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 851/1718] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:35 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:01:36.104290 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f1e869c0-a769-41d6-9813-4e9a01c69ccf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:36.104903 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f1e869c0-a769-41d6-9813-4e9a01c69ccf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:36.111316 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f1e869c0-a769-41d6-9813-4e9a01c69ccf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:36.111768 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f1e869c0-a769-41d6-9813-4e9a01c69ccf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:36.112537 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f1e869c0-a769-41d6-9813-4e9a01c69ccf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:36.112985 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f1e869c0-a769-41d6-9813-4e9a01c69ccf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:36.212029 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-8599e00e-fd9c-4f5b-9727-44f321151d0f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:36.212766 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-8599e00e-fd9c-4f5b-9727-44f321151d0f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:36.218754 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8599e00e-fd9c-4f5b-9727-44f321151d0f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:36.219239 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8599e00e-fd9c-4f5b-9727-44f321151d0f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:36.220017 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8599e00e-fd9c-4f5b-9727-44f321151d0f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:36.220461 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8599e00e-fd9c-4f5b-9727-44f321151d0f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:36.246021 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f1e869c0-a769-41d6-9813-4e9a01c69ccf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:36.253409 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f1e869c0-a769-41d6-9813-4e9a01c69ccf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.153503 Mar 08 15:01:36.254003 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 868/1719] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:36 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:36.282163 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-8599e00e-fd9c-4f5b-9727-44f321151d0f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:36.290784 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-8599e00e-fd9c-4f5b-9727-44f321151d0f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.082564 Mar 08 15:01:36.291131 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 852/1720] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:36 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:01:36.417825 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-76b43a36-146f-42f4-801b-abb046f05da4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:36.418774 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-76b43a36-146f-42f4-801b-abb046f05da4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:36.424625 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-76b43a36-146f-42f4-801b-abb046f05da4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:36.425081 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-76b43a36-146f-42f4-801b-abb046f05da4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:36.425864 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-76b43a36-146f-42f4-801b-abb046f05da4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:36.426312 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-76b43a36-146f-42f4-801b-abb046f05da4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:36.453804 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-76b43a36-146f-42f4-801b-abb046f05da4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040701 Mar 08 15:01:36.454312 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 869/1721] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:01:36 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:01:36.685280 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-ab2d1867-0dea-4b75-b0bf-ca6f145691d1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:36.686227 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-ab2d1867-0dea-4b75-b0bf-ca6f145691d1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:36.692509 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ab2d1867-0dea-4b75-b0bf-ca6f145691d1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:36.692961 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ab2d1867-0dea-4b75-b0bf-ca6f145691d1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:36.693735 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ab2d1867-0dea-4b75-b0bf-ca6f145691d1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:36.694200 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ab2d1867-0dea-4b75-b0bf-ca6f145691d1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:36.722727 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-ab2d1867-0dea-4b75-b0bf-ca6f145691d1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041421 Mar 08 15:01:36.723210 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 853/1722] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:36 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:01:37.271341 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5cf06a32-40d4-46ad-b2ad-81eaa22100c9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:37.271984 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5cf06a32-40d4-46ad-b2ad-81eaa22100c9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:37.278634 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5cf06a32-40d4-46ad-b2ad-81eaa22100c9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:37.279088 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5cf06a32-40d4-46ad-b2ad-81eaa22100c9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:37.280041 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5cf06a32-40d4-46ad-b2ad-81eaa22100c9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:37.281288 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5cf06a32-40d4-46ad-b2ad-81eaa22100c9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:37.308764 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-e97df537-30e9-4931-9e17-9b1b3812d024 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:37.309377 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-e97df537-30e9-4931-9e17-9b1b3812d024 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:37.315223 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e97df537-30e9-4931-9e17-9b1b3812d024 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:37.315681 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e97df537-30e9-4931-9e17-9b1b3812d024 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:37.316456 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e97df537-30e9-4931-9e17-9b1b3812d024 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:37.316901 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e97df537-30e9-4931-9e17-9b1b3812d024 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:37.380248 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-e97df537-30e9-4931-9e17-9b1b3812d024 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:37.387871 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-e97df537-30e9-4931-9e17-9b1b3812d024 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.084075 Mar 08 15:01:37.388636 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 854/1723] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:37 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:01:37.423630 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-5cf06a32-40d4-46ad-b2ad-81eaa22100c9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:37.432536 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5cf06a32-40d4-46ad-b2ad-81eaa22100c9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.165060 Mar 08 15:01:37.433101 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 870/1724] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:37 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:37.465114 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-fee196a2-cfef-4180-8119-1e1f50794c81 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:37.466069 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-fee196a2-cfef-4180-8119-1e1f50794c81 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:37.471861 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fee196a2-cfef-4180-8119-1e1f50794c81 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:37.472318 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fee196a2-cfef-4180-8119-1e1f50794c81 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:37.473087 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fee196a2-cfef-4180-8119-1e1f50794c81 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:37.473530 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fee196a2-cfef-4180-8119-1e1f50794c81 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:37.502077 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-fee196a2-cfef-4180-8119-1e1f50794c81 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040867 Mar 08 15:01:37.502618 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 855/1725] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:01:37 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:01:37.734498 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-64096268-20cc-46ab-be90-b53727138ff0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:37.735420 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-64096268-20cc-46ab-be90-b53727138ff0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:37.741257 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-64096268-20cc-46ab-be90-b53727138ff0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:37.741714 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-64096268-20cc-46ab-be90-b53727138ff0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:37.742539 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-64096268-20cc-46ab-be90-b53727138ff0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:37.743016 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-64096268-20cc-46ab-be90-b53727138ff0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:37.769625 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-64096268-20cc-46ab-be90-b53727138ff0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039087 Mar 08 15:01:37.770209 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 871/1726] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:37 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:01:38.405146 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-57e4d5d9-e586-4880-a53d-de5e389b7ca0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:38.405783 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-57e4d5d9-e586-4880-a53d-de5e389b7ca0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:38.412046 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-57e4d5d9-e586-4880-a53d-de5e389b7ca0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:38.412492 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-57e4d5d9-e586-4880-a53d-de5e389b7ca0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:38.413250 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-57e4d5d9-e586-4880-a53d-de5e389b7ca0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:38.413684 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-57e4d5d9-e586-4880-a53d-de5e389b7ca0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:38.448382 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-273620d0-ce58-4090-902d-41bed4911741 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:38.448996 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-273620d0-ce58-4090-902d-41bed4911741 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:38.455364 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-273620d0-ce58-4090-902d-41bed4911741 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:38.455822 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-273620d0-ce58-4090-902d-41bed4911741 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:38.456602 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-273620d0-ce58-4090-902d-41bed4911741 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:38.457050 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-273620d0-ce58-4090-902d-41bed4911741 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:38.475596 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-57e4d5d9-e586-4880-a53d-de5e389b7ca0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:38.483712 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-57e4d5d9-e586-4880-a53d-de5e389b7ca0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.082875 Mar 08 15:01:38.484360 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 856/1727] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:38 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:38.513166 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-3d375db7-07fc-40f3-a4e3-5882aab7636c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:38.514104 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-3d375db7-07fc-40f3-a4e3-5882aab7636c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:38.520021 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3d375db7-07fc-40f3-a4e3-5882aab7636c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:38.520518 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3d375db7-07fc-40f3-a4e3-5882aab7636c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:38.521302 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3d375db7-07fc-40f3-a4e3-5882aab7636c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:38.521756 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3d375db7-07fc-40f3-a4e3-5882aab7636c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:38.551779 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-3d375db7-07fc-40f3-a4e3-5882aab7636c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042276 Mar 08 15:01:38.552353 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 857/1728] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:01:38 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 15:01:38.589335 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-273620d0-ce58-4090-902d-41bed4911741 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:38.596573 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-273620d0-ce58-4090-902d-41bed4911741 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.152048 Mar 08 15:01:38.597127 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 872/1729] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:38 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:01:38.781418 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-9c04cbec-1db3-486f-a036-c1ded54a6267 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:38.782396 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-9c04cbec-1db3-486f-a036-c1ded54a6267 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:38.788472 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9c04cbec-1db3-486f-a036-c1ded54a6267 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:38.788930 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9c04cbec-1db3-486f-a036-c1ded54a6267 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:38.790325 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9c04cbec-1db3-486f-a036-c1ded54a6267 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:38.790786 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9c04cbec-1db3-486f-a036-c1ded54a6267 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:38.818034 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-9c04cbec-1db3-486f-a036-c1ded54a6267 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040628 Mar 08 15:01:38.818589 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 858/1730] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:38 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:01:39.501340 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-61c9dbac-325f-4e7f-bfaf-ca853425b82e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:39.501973 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-61c9dbac-325f-4e7f-bfaf-ca853425b82e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:39.508205 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-61c9dbac-325f-4e7f-bfaf-ca853425b82e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:39.509833 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-61c9dbac-325f-4e7f-bfaf-ca853425b82e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:39.510638 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-61c9dbac-325f-4e7f-bfaf-ca853425b82e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:39.511081 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-61c9dbac-325f-4e7f-bfaf-ca853425b82e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:39.563447 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-5aac6f09-1ba7-424d-b54c-679b13d1137c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:39.564361 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-5aac6f09-1ba7-424d-b54c-679b13d1137c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:39.570159 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-61c9dbac-325f-4e7f-bfaf-ca853425b82e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:39.570871 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5aac6f09-1ba7-424d-b54c-679b13d1137c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:39.571916 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5aac6f09-1ba7-424d-b54c-679b13d1137c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:39.572807 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5aac6f09-1ba7-424d-b54c-679b13d1137c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:39.573295 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5aac6f09-1ba7-424d-b54c-679b13d1137c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:39.578095 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-61c9dbac-325f-4e7f-bfaf-ca853425b82e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080611 Mar 08 15:01:39.578660 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 873/1731] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:39 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:39.602862 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-5aac6f09-1ba7-424d-b54c-679b13d1137c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042793 Mar 08 15:01:39.603476 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 859/1732] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:01:39 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 15:01:39.613728 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-eb751911-6303-414c-aa50-e654625727c8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:39.614362 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-eb751911-6303-414c-aa50-e654625727c8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:39.620834 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-eb751911-6303-414c-aa50-e654625727c8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:39.621279 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-eb751911-6303-414c-aa50-e654625727c8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:39.622066 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-eb751911-6303-414c-aa50-e654625727c8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:39.622502 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-eb751911-6303-414c-aa50-e654625727c8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:39.757964 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-eb751911-6303-414c-aa50-e654625727c8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:39.765699 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-eb751911-6303-414c-aa50-e654625727c8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.155761 Mar 08 15:01:39.766293 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 874/1733] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:39 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:39.829983 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-2ab9ae6e-011d-435c-a254-425024536b95 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:39.830919 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-2ab9ae6e-011d-435c-a254-425024536b95 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:39.836674 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2ab9ae6e-011d-435c-a254-425024536b95 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:39.837131 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2ab9ae6e-011d-435c-a254-425024536b95 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:39.837911 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2ab9ae6e-011d-435c-a254-425024536b95 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:39.838350 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2ab9ae6e-011d-435c-a254-425024536b95 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:39.865557 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-2ab9ae6e-011d-435c-a254-425024536b95 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039487 Mar 08 15:01:39.866118 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 860/1734] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:39 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:01:40.594644 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-37ccda6e-e6bd-46f0-bc28-5c1f320a2369 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:40.595254 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-37ccda6e-e6bd-46f0-bc28-5c1f320a2369 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:40.601492 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-37ccda6e-e6bd-46f0-bc28-5c1f320a2369 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:40.601973 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-37ccda6e-e6bd-46f0-bc28-5c1f320a2369 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:40.603082 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-37ccda6e-e6bd-46f0-bc28-5c1f320a2369 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:40.603525 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-37ccda6e-e6bd-46f0-bc28-5c1f320a2369 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:40.614536 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-d4c7a8c2-8606-4914-8881-781051ee48a8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:40.615444 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-d4c7a8c2-8606-4914-8881-781051ee48a8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:40.622206 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d4c7a8c2-8606-4914-8881-781051ee48a8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:40.622665 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d4c7a8c2-8606-4914-8881-781051ee48a8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:40.623439 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d4c7a8c2-8606-4914-8881-781051ee48a8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:40.623883 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d4c7a8c2-8606-4914-8881-781051ee48a8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:40.654089 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-d4c7a8c2-8606-4914-8881-781051ee48a8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043360 Mar 08 15:01:40.654662 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 861/1735] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:01:40 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 15:01:40.664565 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-37ccda6e-e6bd-46f0-bc28-5c1f320a2369 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:40.672249 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-37ccda6e-e6bd-46f0-bc28-5c1f320a2369 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081532 Mar 08 15:01:40.672807 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 875/1736] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:40 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:40.782784 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-63b5be08-921a-4c5a-8314-594b606ae914 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:40.783396 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-63b5be08-921a-4c5a-8314-594b606ae914 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:40.789204 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-63b5be08-921a-4c5a-8314-594b606ae914 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:40.789661 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-63b5be08-921a-4c5a-8314-594b606ae914 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:40.790728 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-63b5be08-921a-4c5a-8314-594b606ae914 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:40.791175 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-63b5be08-921a-4c5a-8314-594b606ae914 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:40.877885 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-78e50410-42ff-43cb-90b2-168f3c755599 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:40.878887 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-78e50410-42ff-43cb-90b2-168f3c755599 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:40.885960 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-78e50410-42ff-43cb-90b2-168f3c755599 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:40.886526 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-78e50410-42ff-43cb-90b2-168f3c755599 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:40.887380 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-78e50410-42ff-43cb-90b2-168f3c755599 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:40.887824 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-78e50410-42ff-43cb-90b2-168f3c755599 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:40.916429 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-78e50410-42ff-43cb-90b2-168f3c755599 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042428 Mar 08 15:01:40.916994 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 876/1737] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:40 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 15:01:40.925111 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-63b5be08-921a-4c5a-8314-594b606ae914 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:40.933678 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-63b5be08-921a-4c5a-8314-594b606ae914 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.154687 Mar 08 15:01:40.934297 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 862/1738] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:40 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:41.666546 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d739fbde-65fb-4b9d-8ce5-fa7a82729884 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:41.667453 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d739fbde-65fb-4b9d-8ce5-fa7a82729884 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:41.673604 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d739fbde-65fb-4b9d-8ce5-fa7a82729884 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:41.674083 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d739fbde-65fb-4b9d-8ce5-fa7a82729884 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:41.674876 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d739fbde-65fb-4b9d-8ce5-fa7a82729884 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:41.675307 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d739fbde-65fb-4b9d-8ce5-fa7a82729884 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:41.690305 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-7018e443-6187-42ec-a51e-cba55e81d67b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:41.690915 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-7018e443-6187-42ec-a51e-cba55e81d67b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:41.697238 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7018e443-6187-42ec-a51e-cba55e81d67b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:41.697695 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7018e443-6187-42ec-a51e-cba55e81d67b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:41.698513 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7018e443-6187-42ec-a51e-cba55e81d67b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:41.698966 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7018e443-6187-42ec-a51e-cba55e81d67b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:41.703809 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d739fbde-65fb-4b9d-8ce5-fa7a82729884 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041794 Mar 08 15:01:41.704370 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 877/1739] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:01:41 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:01:41.761637 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-7018e443-6187-42ec-a51e-cba55e81d67b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:41.768979 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-7018e443-6187-42ec-a51e-cba55e81d67b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.082489 Mar 08 15:01:41.769550 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 863/1740] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:41 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:01:41.928137 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-025767b8-026b-4a5a-ba35-c0d7439ae4bc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:41.928976 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-025767b8-026b-4a5a-ba35-c0d7439ae4bc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:41.934846 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-025767b8-026b-4a5a-ba35-c0d7439ae4bc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:41.935293 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-025767b8-026b-4a5a-ba35-c0d7439ae4bc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:41.936061 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-025767b8-026b-4a5a-ba35-c0d7439ae4bc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:41.936491 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-025767b8-026b-4a5a-ba35-c0d7439ae4bc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:41.951381 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-8d8ae33a-9733-4ece-8bdb-3aa201045a99 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:41.951993 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-8d8ae33a-9733-4ece-8bdb-3aa201045a99 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:41.957759 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8d8ae33a-9733-4ece-8bdb-3aa201045a99 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:41.958252 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8d8ae33a-9733-4ece-8bdb-3aa201045a99 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:41.959026 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8d8ae33a-9733-4ece-8bdb-3aa201045a99 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:41.959469 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8d8ae33a-9733-4ece-8bdb-3aa201045a99 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:41.966244 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-025767b8-026b-4a5a-ba35-c0d7439ae4bc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042303 Mar 08 15:01:41.966823 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 878/1741] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:41 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:01:42.094419 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-8d8ae33a-9733-4ece-8bdb-3aa201045a99 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:42.101670 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-8d8ae33a-9733-4ece-8bdb-3aa201045a99 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.154141 Mar 08 15:01:42.102853 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 864/1742] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:41 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:42.715630 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-143a4f50-1e27-4ad1-920f-f8384be78e91 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:01:42.716537 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-143a4f50-1e27-4ad1-920f-f8384be78e91 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:42.722792 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-143a4f50-1e27-4ad1-920f-f8384be78e91 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:42.723248 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-143a4f50-1e27-4ad1-920f-f8384be78e91 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:42.724005 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-143a4f50-1e27-4ad1-920f-f8384be78e91 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:42.724538 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-143a4f50-1e27-4ad1-920f-f8384be78e91 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:42.785575 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-324c8b83-f016-47fd-8696-7db95072ca34 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:42.786217 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-324c8b83-f016-47fd-8696-7db95072ca34 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:42.792992 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-324c8b83-f016-47fd-8696-7db95072ca34 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:42.793475 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-324c8b83-f016-47fd-8696-7db95072ca34 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:42.794284 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-324c8b83-f016-47fd-8696-7db95072ca34 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:42.794723 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-324c8b83-f016-47fd-8696-7db95072ca34 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:42.826517 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-143a4f50-1e27-4ad1-920f-f8384be78e91 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "POST /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/action" status: 200 len: 38306 microversion: 2.20 time: 0.114675 Mar 08 15:01:42.829917 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 879/1743] 10.222.0.30 () {62 vars in 1318 bytes} [Tue Mar 8 15:01:42 2022] POST /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416/action => generated 38306 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Mar 08 15:01:42.855077 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-324c8b83-f016-47fd-8696-7db95072ca34 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:42.862341 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-324c8b83-f016-47fd-8696-7db95072ca34 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080671 Mar 08 15:01:42.862894 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 865/1744] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:42 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:01:42.978880 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-8c86d01a-1a37-4e73-8043-3b7dc08a7e08 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:42.979881 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-8c86d01a-1a37-4e73-8043-3b7dc08a7e08 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:42.986730 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8c86d01a-1a37-4e73-8043-3b7dc08a7e08 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:42.987183 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8c86d01a-1a37-4e73-8043-3b7dc08a7e08 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:42.987953 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8c86d01a-1a37-4e73-8043-3b7dc08a7e08 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:42.988391 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8c86d01a-1a37-4e73-8043-3b7dc08a7e08 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:43.016494 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-8c86d01a-1a37-4e73-8043-3b7dc08a7e08 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042622 Mar 08 15:01:43.017038 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 880/1745] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:42 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:01:43.119505 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-0011d8e0-35ad-424a-af1d-63ff97dc93ec tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:43.120112 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-0011d8e0-35ad-424a-af1d-63ff97dc93ec tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:43.125904 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0011d8e0-35ad-424a-af1d-63ff97dc93ec tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:43.126356 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0011d8e0-35ad-424a-af1d-63ff97dc93ec tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:43.127112 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0011d8e0-35ad-424a-af1d-63ff97dc93ec tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:43.127543 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0011d8e0-35ad-424a-af1d-63ff97dc93ec tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:43.266683 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-0011d8e0-35ad-424a-af1d-63ff97dc93ec tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:43.274475 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-0011d8e0-35ad-424a-af1d-63ff97dc93ec tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.158291 Mar 08 15:01:43.275424 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 866/1746] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:43 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:43.880164 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f6c33c2a-2799-4c47-a700-78f3a018fcdf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:43.880740 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f6c33c2a-2799-4c47-a700-78f3a018fcdf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:43.887863 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f6c33c2a-2799-4c47-a700-78f3a018fcdf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:43.888322 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f6c33c2a-2799-4c47-a700-78f3a018fcdf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:43.889099 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f6c33c2a-2799-4c47-a700-78f3a018fcdf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:43.889544 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f6c33c2a-2799-4c47-a700-78f3a018fcdf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:43.950815 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f6c33c2a-2799-4c47-a700-78f3a018fcdf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:43.958265 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f6c33c2a-2799-4c47-a700-78f3a018fcdf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.082044 Mar 08 15:01:43.958822 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 881/1747] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:43 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:44.028354 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-fce5fbff-54b7-4d11-bc45-5a8e34f6d0b1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:44.029270 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-fce5fbff-54b7-4d11-bc45-5a8e34f6d0b1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:44.035343 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fce5fbff-54b7-4d11-bc45-5a8e34f6d0b1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:44.035798 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fce5fbff-54b7-4d11-bc45-5a8e34f6d0b1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:44.036561 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fce5fbff-54b7-4d11-bc45-5a8e34f6d0b1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:44.037002 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fce5fbff-54b7-4d11-bc45-5a8e34f6d0b1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:44.065562 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-fce5fbff-54b7-4d11-bc45-5a8e34f6d0b1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041588 Mar 08 15:01:44.066137 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 867/1748] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:44 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:01:44.292657 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-a7ede207-77ef-422a-b39d-71760f1e3d3b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:44.293269 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-a7ede207-77ef-422a-b39d-71760f1e3d3b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:44.299465 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a7ede207-77ef-422a-b39d-71760f1e3d3b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:44.299922 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a7ede207-77ef-422a-b39d-71760f1e3d3b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:44.300691 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a7ede207-77ef-422a-b39d-71760f1e3d3b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:44.301135 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a7ede207-77ef-422a-b39d-71760f1e3d3b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:44.453097 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-a7ede207-77ef-422a-b39d-71760f1e3d3b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:44.460425 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-a7ede207-77ef-422a-b39d-71760f1e3d3b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.172734 Mar 08 15:01:44.460985 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 882/1749] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:44 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:44.975567 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-f78cde9b-fb5c-4396-b4d7-2e4ce26f0525 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:44.976183 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-f78cde9b-fb5c-4396-b4d7-2e4ce26f0525 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:44.982379 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f78cde9b-fb5c-4396-b4d7-2e4ce26f0525 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:44.982837 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f78cde9b-fb5c-4396-b4d7-2e4ce26f0525 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:44.983611 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f78cde9b-fb5c-4396-b4d7-2e4ce26f0525 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:44.984056 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f78cde9b-fb5c-4396-b4d7-2e4ce26f0525 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:45.042908 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-f78cde9b-fb5c-4396-b4d7-2e4ce26f0525 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:45.050115 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-f78cde9b-fb5c-4396-b4d7-2e4ce26f0525 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078380 Mar 08 15:01:45.050678 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 868/1750] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:44 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:45.077011 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-25126342-9e11-48c3-bbac-503c7d717020 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:45.077952 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-25126342-9e11-48c3-bbac-503c7d717020 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:45.084116 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-25126342-9e11-48c3-bbac-503c7d717020 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:45.084562 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-25126342-9e11-48c3-bbac-503c7d717020 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:45.085325 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-25126342-9e11-48c3-bbac-503c7d717020 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:45.085759 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-25126342-9e11-48c3-bbac-503c7d717020 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:45.112678 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-25126342-9e11-48c3-bbac-503c7d717020 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039541 Mar 08 15:01:45.113220 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 883/1751] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:45 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 15:01:45.478150 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-149c1b5d-eb34-4712-8f2f-b3fa81a99dd9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:45.478752 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-149c1b5d-eb34-4712-8f2f-b3fa81a99dd9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:45.484660 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-149c1b5d-eb34-4712-8f2f-b3fa81a99dd9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:45.485107 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-149c1b5d-eb34-4712-8f2f-b3fa81a99dd9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:45.485876 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-149c1b5d-eb34-4712-8f2f-b3fa81a99dd9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:45.486326 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-149c1b5d-eb34-4712-8f2f-b3fa81a99dd9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:45.627197 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-149c1b5d-eb34-4712-8f2f-b3fa81a99dd9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:45.635746 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-149c1b5d-eb34-4712-8f2f-b3fa81a99dd9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.161361 Mar 08 15:01:45.636323 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 869/1752] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:45 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:46.066901 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-036e31c6-4c12-4032-97f2-38bb41844077 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:46.067512 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-036e31c6-4c12-4032-97f2-38bb41844077 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:46.074440 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-036e31c6-4c12-4032-97f2-38bb41844077 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:46.074898 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-036e31c6-4c12-4032-97f2-38bb41844077 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:46.075673 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-036e31c6-4c12-4032-97f2-38bb41844077 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:46.076117 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-036e31c6-4c12-4032-97f2-38bb41844077 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:46.124758 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-47182da0-b027-4682-b23f-716439e86020 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:46.125771 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-47182da0-b027-4682-b23f-716439e86020 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:46.132244 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-47182da0-b027-4682-b23f-716439e86020 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:46.132703 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-47182da0-b027-4682-b23f-716439e86020 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:46.134130 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-47182da0-b027-4682-b23f-716439e86020 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:46.134574 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-47182da0-b027-4682-b23f-716439e86020 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:46.136165 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-036e31c6-4c12-4032-97f2-38bb41844077 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:46.143833 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-036e31c6-4c12-4032-97f2-38bb41844077 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080770 Mar 08 15:01:46.144439 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 884/1753] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:46 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:46.163909 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-47182da0-b027-4682-b23f-716439e86020 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043133 Mar 08 15:01:46.164458 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 870/1754] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:46 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 15:01:46.658531 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c0945888-4da1-4aed-9cc0-ffeaf9fda33b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:46.659145 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-c0945888-4da1-4aed-9cc0-ffeaf9fda33b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:46.666276 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c0945888-4da1-4aed-9cc0-ffeaf9fda33b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:46.666734 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c0945888-4da1-4aed-9cc0-ffeaf9fda33b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:46.667506 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c0945888-4da1-4aed-9cc0-ffeaf9fda33b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:46.667948 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c0945888-4da1-4aed-9cc0-ffeaf9fda33b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:46.800400 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-c0945888-4da1-4aed-9cc0-ffeaf9fda33b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:46.808116 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-c0945888-4da1-4aed-9cc0-ffeaf9fda33b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.153600 Mar 08 15:01:46.808703 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 885/1755] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:46 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:47.160566 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-39269e06-6038-42e1-9476-48481420bd07 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:47.161175 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-39269e06-6038-42e1-9476-48481420bd07 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:47.167545 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-39269e06-6038-42e1-9476-48481420bd07 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:47.167996 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-39269e06-6038-42e1-9476-48481420bd07 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:47.168761 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-39269e06-6038-42e1-9476-48481420bd07 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:47.169199 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-39269e06-6038-42e1-9476-48481420bd07 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:47.175201 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d6b2d618-3c50-47e1-9873-2bf04d331747 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:47.176203 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d6b2d618-3c50-47e1-9873-2bf04d331747 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:47.182457 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d6b2d618-3c50-47e1-9873-2bf04d331747 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:47.182925 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d6b2d618-3c50-47e1-9873-2bf04d331747 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:47.183712 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d6b2d618-3c50-47e1-9873-2bf04d331747 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:47.184157 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d6b2d618-3c50-47e1-9873-2bf04d331747 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:47.213916 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d6b2d618-3c50-47e1-9873-2bf04d331747 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042468 Mar 08 15:01:47.214630 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 886/1756] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:47 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 15:01:47.241165 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-39269e06-6038-42e1-9476-48481420bd07 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:47.249193 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-39269e06-6038-42e1-9476-48481420bd07 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.092489 Mar 08 15:01:47.249753 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 871/1757] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:47 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:47.825527 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-173165bd-9a62-43e7-a9f4-b729713a3074 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:47.826080 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-173165bd-9a62-43e7-a9f4-b729713a3074 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:47.832283 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-173165bd-9a62-43e7-a9f4-b729713a3074 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:47.832736 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-173165bd-9a62-43e7-a9f4-b729713a3074 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:47.833504 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-173165bd-9a62-43e7-a9f4-b729713a3074 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:47.833967 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-173165bd-9a62-43e7-a9f4-b729713a3074 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:47.972354 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-173165bd-9a62-43e7-a9f4-b729713a3074 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:47.980224 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-173165bd-9a62-43e7-a9f4-b729713a3074 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.159624 Mar 08 15:01:47.980780 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 887/1758] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:47 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:48.226142 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-20759009-77b6-46e9-aba8-bfd50286b9c2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:48.227681 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-20759009-77b6-46e9-aba8-bfd50286b9c2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:48.234152 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-20759009-77b6-46e9-aba8-bfd50286b9c2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:48.234613 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-20759009-77b6-46e9-aba8-bfd50286b9c2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:48.235396 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-20759009-77b6-46e9-aba8-bfd50286b9c2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:48.235843 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-20759009-77b6-46e9-aba8-bfd50286b9c2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:48.263127 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-20759009-77b6-46e9-aba8-bfd50286b9c2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040982 Mar 08 15:01:48.263684 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 872/1759] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:48 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:01:48.267143 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c4429ab0-fe26-4611-aa13-4ca3c451cfd0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:48.267751 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-c4429ab0-fe26-4611-aa13-4ca3c451cfd0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:48.273622 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c4429ab0-fe26-4611-aa13-4ca3c451cfd0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:48.274680 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c4429ab0-fe26-4611-aa13-4ca3c451cfd0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:48.275448 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c4429ab0-fe26-4611-aa13-4ca3c451cfd0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:48.275878 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c4429ab0-fe26-4611-aa13-4ca3c451cfd0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:48.334371 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-c4429ab0-fe26-4611-aa13-4ca3c451cfd0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:48.342381 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-c4429ab0-fe26-4611-aa13-4ca3c451cfd0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079271 Mar 08 15:01:48.342940 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 888/1760] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:48 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:01:48.997318 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-8642fa27-cdbf-4797-ae9b-a6f22819baa8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:48.997954 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-8642fa27-cdbf-4797-ae9b-a6f22819baa8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:49.003760 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8642fa27-cdbf-4797-ae9b-a6f22819baa8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:49.004214 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8642fa27-cdbf-4797-ae9b-a6f22819baa8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:49.004975 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8642fa27-cdbf-4797-ae9b-a6f22819baa8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:49.005414 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8642fa27-cdbf-4797-ae9b-a6f22819baa8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:49.139186 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-8642fa27-cdbf-4797-ae9b-a6f22819baa8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:49.146603 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-8642fa27-cdbf-4797-ae9b-a6f22819baa8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.153868 Mar 08 15:01:49.147164 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 873/1761] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:48 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:49.274952 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-6177b52d-37de-41dd-ad94-3e1829b1a84c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:49.275985 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-6177b52d-37de-41dd-ad94-3e1829b1a84c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:49.282276 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6177b52d-37de-41dd-ad94-3e1829b1a84c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:49.282730 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6177b52d-37de-41dd-ad94-3e1829b1a84c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:49.283501 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6177b52d-37de-41dd-ad94-3e1829b1a84c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:49.283940 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6177b52d-37de-41dd-ad94-3e1829b1a84c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:49.311858 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-6177b52d-37de-41dd-ad94-3e1829b1a84c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041253 Mar 08 15:01:49.312399 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 889/1762] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:49 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:01:49.358921 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-acbc4925-96b7-4b7e-8d47-264a38c7f19d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:49.359536 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-acbc4925-96b7-4b7e-8d47-264a38c7f19d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:49.365754 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-acbc4925-96b7-4b7e-8d47-264a38c7f19d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:49.366246 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-acbc4925-96b7-4b7e-8d47-264a38c7f19d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:49.367020 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-acbc4925-96b7-4b7e-8d47-264a38c7f19d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:49.367467 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-acbc4925-96b7-4b7e-8d47-264a38c7f19d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:49.426309 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-acbc4925-96b7-4b7e-8d47-264a38c7f19d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:49.434467 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-acbc4925-96b7-4b7e-8d47-264a38c7f19d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079401 Mar 08 15:01:49.435030 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 874/1763] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:49 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:01:50.164631 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3cde34c3-dded-4153-8980-2e83ff99e8fc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:50.165569 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-3cde34c3-dded-4153-8980-2e83ff99e8fc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:50.171379 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3cde34c3-dded-4153-8980-2e83ff99e8fc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:50.171827 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3cde34c3-dded-4153-8980-2e83ff99e8fc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:50.172585 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3cde34c3-dded-4153-8980-2e83ff99e8fc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:50.173019 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3cde34c3-dded-4153-8980-2e83ff99e8fc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:50.306505 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-3cde34c3-dded-4153-8980-2e83ff99e8fc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:50.313738 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-3cde34c3-dded-4153-8980-2e83ff99e8fc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.153075 Mar 08 15:01:50.314332 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 890/1764] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:50 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:50.323954 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b692bbe3-dd0c-4ffe-bbdf-cb2648420717 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:50.324918 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-b692bbe3-dd0c-4ffe-bbdf-cb2648420717 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:50.330840 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b692bbe3-dd0c-4ffe-bbdf-cb2648420717 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:50.331296 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b692bbe3-dd0c-4ffe-bbdf-cb2648420717 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:50.332074 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b692bbe3-dd0c-4ffe-bbdf-cb2648420717 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:50.332519 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b692bbe3-dd0c-4ffe-bbdf-cb2648420717 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:50.360013 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-b692bbe3-dd0c-4ffe-bbdf-cb2648420717 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040519 Mar 08 15:01:50.360640 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 875/1765] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:50 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 15:01:50.452007 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-7e6f4a27-e8c4-48cc-907d-03f446a50d4f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:50.452626 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-7e6f4a27-e8c4-48cc-907d-03f446a50d4f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:50.459254 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7e6f4a27-e8c4-48cc-907d-03f446a50d4f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:50.459710 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7e6f4a27-e8c4-48cc-907d-03f446a50d4f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:50.460486 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7e6f4a27-e8c4-48cc-907d-03f446a50d4f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:50.460960 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7e6f4a27-e8c4-48cc-907d-03f446a50d4f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:50.522553 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-7e6f4a27-e8c4-48cc-907d-03f446a50d4f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:50.529887 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-7e6f4a27-e8c4-48cc-907d-03f446a50d4f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081777 Mar 08 15:01:50.530468 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 891/1766] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:50 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:51.331419 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-356b04a2-964b-427b-9f2c-25677d4b6a47 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:51.332037 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-356b04a2-964b-427b-9f2c-25677d4b6a47 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:51.339106 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-356b04a2-964b-427b-9f2c-25677d4b6a47 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:51.339567 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-356b04a2-964b-427b-9f2c-25677d4b6a47 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:51.340340 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-356b04a2-964b-427b-9f2c-25677d4b6a47 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:51.340781 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-356b04a2-964b-427b-9f2c-25677d4b6a47 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:51.371452 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-7c135820-57f1-43cf-8ced-05d3f4e2958f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:51.372372 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-7c135820-57f1-43cf-8ced-05d3f4e2958f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:51.378689 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7c135820-57f1-43cf-8ced-05d3f4e2958f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:51.379149 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7c135820-57f1-43cf-8ced-05d3f4e2958f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:51.379925 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7c135820-57f1-43cf-8ced-05d3f4e2958f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:51.380366 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7c135820-57f1-43cf-8ced-05d3f4e2958f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:51.408864 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-7c135820-57f1-43cf-8ced-05d3f4e2958f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041342 Mar 08 15:01:51.409431 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 892/1767] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:51 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 15:01:51.478140 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-356b04a2-964b-427b-9f2c-25677d4b6a47 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:51.485533 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-356b04a2-964b-427b-9f2c-25677d4b6a47 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.158053 Mar 08 15:01:51.486138 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 876/1768] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:51 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:51.546534 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d94e3d5d-06d4-4c57-8e49-b4903f8e5dc5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:51.547183 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d94e3d5d-06d4-4c57-8e49-b4903f8e5dc5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:51.553399 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d94e3d5d-06d4-4c57-8e49-b4903f8e5dc5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:51.553873 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d94e3d5d-06d4-4c57-8e49-b4903f8e5dc5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:51.554658 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d94e3d5d-06d4-4c57-8e49-b4903f8e5dc5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:51.555107 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d94e3d5d-06d4-4c57-8e49-b4903f8e5dc5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:51.614317 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d94e3d5d-06d4-4c57-8e49-b4903f8e5dc5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:51.621726 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d94e3d5d-06d4-4c57-8e49-b4903f8e5dc5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078995 Mar 08 15:01:51.622316 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 893/1769] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:51 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:52.421025 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b2809a75-8c00-4915-b6cf-16e64c360523 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:52.421965 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-b2809a75-8c00-4915-b6cf-16e64c360523 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:52.428524 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b2809a75-8c00-4915-b6cf-16e64c360523 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:52.428979 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b2809a75-8c00-4915-b6cf-16e64c360523 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:52.429746 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b2809a75-8c00-4915-b6cf-16e64c360523 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:52.431021 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b2809a75-8c00-4915-b6cf-16e64c360523 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:52.458148 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-b2809a75-8c00-4915-b6cf-16e64c360523 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041127 Mar 08 15:01:52.458693 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 877/1770] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:52 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:01:52.502612 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-4de8ba48-84f3-4a68-88b5-8232ba50f85e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:52.503186 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-4de8ba48-84f3-4a68-88b5-8232ba50f85e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:52.510059 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4de8ba48-84f3-4a68-88b5-8232ba50f85e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:52.510510 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4de8ba48-84f3-4a68-88b5-8232ba50f85e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:52.511281 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4de8ba48-84f3-4a68-88b5-8232ba50f85e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:52.511719 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4de8ba48-84f3-4a68-88b5-8232ba50f85e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:52.638470 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-dedb328a-461d-45d7-b5ea-cf5c4b207446 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:52.639086 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-dedb328a-461d-45d7-b5ea-cf5c4b207446 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:52.645033 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-dedb328a-461d-45d7-b5ea-cf5c4b207446 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:52.645487 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-dedb328a-461d-45d7-b5ea-cf5c4b207446 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:52.645619 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-4de8ba48-84f3-4a68-88b5-8232ba50f85e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:52.646295 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-dedb328a-461d-45d7-b5ea-cf5c4b207446 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:52.646734 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-dedb328a-461d-45d7-b5ea-cf5c4b207446 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:52.653608 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-4de8ba48-84f3-4a68-88b5-8232ba50f85e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.154914 Mar 08 15:01:52.654203 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 894/1771] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:52 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:52.707197 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-dedb328a-461d-45d7-b5ea-cf5c4b207446 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:52.715174 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-dedb328a-461d-45d7-b5ea-cf5c4b207446 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080615 Mar 08 15:01:52.715732 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 878/1772] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:52 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:01:53.469738 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-138d2d4a-e504-4100-91c5-173f5673c7f9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:53.470706 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-138d2d4a-e504-4100-91c5-173f5673c7f9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:53.476598 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-138d2d4a-e504-4100-91c5-173f5673c7f9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:53.477168 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-138d2d4a-e504-4100-91c5-173f5673c7f9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:53.477977 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-138d2d4a-e504-4100-91c5-173f5673c7f9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:53.478413 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-138d2d4a-e504-4100-91c5-173f5673c7f9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:53.505158 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-138d2d4a-e504-4100-91c5-173f5673c7f9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039501 Mar 08 15:01:53.505758 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 895/1773] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:53 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 15:01:53.670115 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-6f449d8b-abc4-41f7-bf6d-bd82f1f52ad1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:53.670726 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-6f449d8b-abc4-41f7-bf6d-bd82f1f52ad1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:53.677291 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6f449d8b-abc4-41f7-bf6d-bd82f1f52ad1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:53.677739 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6f449d8b-abc4-41f7-bf6d-bd82f1f52ad1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:53.678528 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6f449d8b-abc4-41f7-bf6d-bd82f1f52ad1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:53.678963 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6f449d8b-abc4-41f7-bf6d-bd82f1f52ad1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:53.732298 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b7d8ee50-03cb-48f2-bb89-1d33bea94e24 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:53.732917 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b7d8ee50-03cb-48f2-bb89-1d33bea94e24 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:53.739304 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b7d8ee50-03cb-48f2-bb89-1d33bea94e24 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:53.739762 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b7d8ee50-03cb-48f2-bb89-1d33bea94e24 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:53.740539 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b7d8ee50-03cb-48f2-bb89-1d33bea94e24 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:53.740980 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b7d8ee50-03cb-48f2-bb89-1d33bea94e24 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:53.800562 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b7d8ee50-03cb-48f2-bb89-1d33bea94e24 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:53.808663 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b7d8ee50-03cb-48f2-bb89-1d33bea94e24 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080228 Mar 08 15:01:53.809225 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 896/1774] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:53 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:01:53.819609 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-6f449d8b-abc4-41f7-bf6d-bd82f1f52ad1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:53.828103 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-6f449d8b-abc4-41f7-bf6d-bd82f1f52ad1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.161861 Mar 08 15:01:53.828656 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 879/1775] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:53 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:54.517173 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-0881bd66-3b48-48ab-941e-758c8f16b64b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:54.518119 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-0881bd66-3b48-48ab-941e-758c8f16b64b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:54.524364 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0881bd66-3b48-48ab-941e-758c8f16b64b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:54.524815 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0881bd66-3b48-48ab-941e-758c8f16b64b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:54.525577 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0881bd66-3b48-48ab-941e-758c8f16b64b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:54.526044 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0881bd66-3b48-48ab-941e-758c8f16b64b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:54.553208 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-0881bd66-3b48-48ab-941e-758c8f16b64b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040002 Mar 08 15:01:54.553777 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 897/1776] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:54 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:01:54.825420 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-acafa97f-8ddd-4a63-ba9b-2d02be9a0d91 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:54.826020 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-acafa97f-8ddd-4a63-ba9b-2d02be9a0d91 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:54.832262 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-acafa97f-8ddd-4a63-ba9b-2d02be9a0d91 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:54.832715 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-acafa97f-8ddd-4a63-ba9b-2d02be9a0d91 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:54.833474 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-acafa97f-8ddd-4a63-ba9b-2d02be9a0d91 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:54.833939 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-acafa97f-8ddd-4a63-ba9b-2d02be9a0d91 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:54.844343 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-696c0cd6-0d1c-4a23-aeac-8cb5ed7e8c8f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:54.844883 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-696c0cd6-0d1c-4a23-aeac-8cb5ed7e8c8f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:54.851026 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-696c0cd6-0d1c-4a23-aeac-8cb5ed7e8c8f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:54.851473 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-696c0cd6-0d1c-4a23-aeac-8cb5ed7e8c8f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:54.852310 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-696c0cd6-0d1c-4a23-aeac-8cb5ed7e8c8f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:54.852855 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-696c0cd6-0d1c-4a23-aeac-8cb5ed7e8c8f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:54.897482 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-acafa97f-8ddd-4a63-ba9b-2d02be9a0d91 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:54.905883 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-acafa97f-8ddd-4a63-ba9b-2d02be9a0d91 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.084857 Mar 08 15:01:54.906469 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 880/1777] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:54 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:54.990446 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-696c0cd6-0d1c-4a23-aeac-8cb5ed7e8c8f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:54.998340 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-696c0cd6-0d1c-4a23-aeac-8cb5ed7e8c8f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.157892 Mar 08 15:01:54.999118 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 898/1778] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:54 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:01:55.564814 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-0aefa05b-ee44-4b8d-9637-81d488c831e3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:55.565752 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-0aefa05b-ee44-4b8d-9637-81d488c831e3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:55.571667 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0aefa05b-ee44-4b8d-9637-81d488c831e3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:55.572130 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0aefa05b-ee44-4b8d-9637-81d488c831e3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:55.572900 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0aefa05b-ee44-4b8d-9637-81d488c831e3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:55.573347 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0aefa05b-ee44-4b8d-9637-81d488c831e3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:55.600117 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-0aefa05b-ee44-4b8d-9637-81d488c831e3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039227 Mar 08 15:01:55.600650 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 881/1779] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:55 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:01:55.922919 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-9a69cbf5-a6b8-4830-a3dc-5c366f9c8fef tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:55.923465 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-9a69cbf5-a6b8-4830-a3dc-5c366f9c8fef tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:55.929941 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9a69cbf5-a6b8-4830-a3dc-5c366f9c8fef tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:55.930473 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9a69cbf5-a6b8-4830-a3dc-5c366f9c8fef tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:55.931421 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9a69cbf5-a6b8-4830-a3dc-5c366f9c8fef tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:55.931858 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9a69cbf5-a6b8-4830-a3dc-5c366f9c8fef tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:55.993379 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-9a69cbf5-a6b8-4830-a3dc-5c366f9c8fef tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:56.000568 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-9a69cbf5-a6b8-4830-a3dc-5c366f9c8fef tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081644 Mar 08 15:01:56.001120 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 899/1780] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:55 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:56.015906 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-38542229-2753-4ba1-b3e6-e2079bf35564 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:56.016513 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-38542229-2753-4ba1-b3e6-e2079bf35564 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:56.022700 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-38542229-2753-4ba1-b3e6-e2079bf35564 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:56.023250 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-38542229-2753-4ba1-b3e6-e2079bf35564 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:56.024025 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-38542229-2753-4ba1-b3e6-e2079bf35564 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:56.024461 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-38542229-2753-4ba1-b3e6-e2079bf35564 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:56.157371 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-38542229-2753-4ba1-b3e6-e2079bf35564 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:56.166049 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-38542229-2753-4ba1-b3e6-e2079bf35564 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.153307 Mar 08 15:01:56.166624 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 882/1781] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:56 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:56.612595 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-6ada69fa-0c4b-45ed-ab96-bf4f6b4a1f34 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:56.613508 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-6ada69fa-0c4b-45ed-ab96-bf4f6b4a1f34 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:56.619619 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6ada69fa-0c4b-45ed-ab96-bf4f6b4a1f34 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:56.620067 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6ada69fa-0c4b-45ed-ab96-bf4f6b4a1f34 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:56.620829 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6ada69fa-0c4b-45ed-ab96-bf4f6b4a1f34 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:56.621263 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6ada69fa-0c4b-45ed-ab96-bf4f6b4a1f34 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:56.648025 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-6ada69fa-0c4b-45ed-ab96-bf4f6b4a1f34 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039348 Mar 08 15:01:56.648561 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 900/1782] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:56 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:01:57.017953 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-23071233-80d8-48ec-b8eb-baf9d3ff4274 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:57.018619 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-23071233-80d8-48ec-b8eb-baf9d3ff4274 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:57.025758 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-23071233-80d8-48ec-b8eb-baf9d3ff4274 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:57.026251 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-23071233-80d8-48ec-b8eb-baf9d3ff4274 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:57.027050 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-23071233-80d8-48ec-b8eb-baf9d3ff4274 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:57.027536 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-23071233-80d8-48ec-b8eb-baf9d3ff4274 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:57.087806 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-23071233-80d8-48ec-b8eb-baf9d3ff4274 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:57.095021 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-23071233-80d8-48ec-b8eb-baf9d3ff4274 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081054 Mar 08 15:01:57.095579 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 883/1783] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:57 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:57.183971 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-2cf4a74c-1dfd-4926-b07f-92b643bf7550 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:57.184576 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-2cf4a74c-1dfd-4926-b07f-92b643bf7550 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:57.190873 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2cf4a74c-1dfd-4926-b07f-92b643bf7550 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:57.191273 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2cf4a74c-1dfd-4926-b07f-92b643bf7550 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:57.192034 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2cf4a74c-1dfd-4926-b07f-92b643bf7550 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:57.192467 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2cf4a74c-1dfd-4926-b07f-92b643bf7550 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:57.328310 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-2cf4a74c-1dfd-4926-b07f-92b643bf7550 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:57.335590 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-2cf4a74c-1dfd-4926-b07f-92b643bf7550 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.156309 Mar 08 15:01:57.336172 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 901/1784] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:57 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:57.660524 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-36650367-6f78-4dce-8222-4e67607235b1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:57.661459 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-36650367-6f78-4dce-8222-4e67607235b1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:57.667985 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-36650367-6f78-4dce-8222-4e67607235b1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:57.668433 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-36650367-6f78-4dce-8222-4e67607235b1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:57.669196 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-36650367-6f78-4dce-8222-4e67607235b1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:57.669631 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-36650367-6f78-4dce-8222-4e67607235b1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:57.697389 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-36650367-6f78-4dce-8222-4e67607235b1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041158 Mar 08 15:01:57.697950 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 884/1785] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:57 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:01:58.111939 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-dc978e55-19e1-4a5b-8002-6d38ea48d0cb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:58.112565 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-dc978e55-19e1-4a5b-8002-6d38ea48d0cb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:58.118737 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dc978e55-19e1-4a5b-8002-6d38ea48d0cb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:58.119189 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dc978e55-19e1-4a5b-8002-6d38ea48d0cb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:58.119969 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dc978e55-19e1-4a5b-8002-6d38ea48d0cb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:58.120385 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dc978e55-19e1-4a5b-8002-6d38ea48d0cb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:58.179754 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-dc978e55-19e1-4a5b-8002-6d38ea48d0cb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:58.187160 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-dc978e55-19e1-4a5b-8002-6d38ea48d0cb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079044 Mar 08 15:01:58.187752 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 902/1786] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:58 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:58.352561 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-c2d17564-1de7-4785-a8d7-85408511b6b2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:58.353176 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-c2d17564-1de7-4785-a8d7-85408511b6b2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:58.359596 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c2d17564-1de7-4785-a8d7-85408511b6b2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:58.360049 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c2d17564-1de7-4785-a8d7-85408511b6b2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:58.360821 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c2d17564-1de7-4785-a8d7-85408511b6b2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:58.361261 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c2d17564-1de7-4785-a8d7-85408511b6b2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:58.499915 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-c2d17564-1de7-4785-a8d7-85408511b6b2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:58.507132 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-c2d17564-1de7-4785-a8d7-85408511b6b2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.158623 Mar 08 15:01:58.507692 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 885/1787] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:58 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:58.708695 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-99b4040f-ef3f-4804-8d70-e3f72d3436f0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:58.709559 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-99b4040f-ef3f-4804-8d70-e3f72d3436f0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:58.716275 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-99b4040f-ef3f-4804-8d70-e3f72d3436f0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:58.716731 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-99b4040f-ef3f-4804-8d70-e3f72d3436f0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:58.717511 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-99b4040f-ef3f-4804-8d70-e3f72d3436f0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:58.718051 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-99b4040f-ef3f-4804-8d70-e3f72d3436f0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:58.746495 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-99b4040f-ef3f-4804-8d70-e3f72d3436f0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041805 Mar 08 15:01:58.747046 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 903/1788] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:58 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:01:59.204175 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-64103316-2b02-4ba4-93f2-86c768e17613 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:59.204778 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-64103316-2b02-4ba4-93f2-86c768e17613 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:59.210733 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-64103316-2b02-4ba4-93f2-86c768e17613 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:59.211207 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-64103316-2b02-4ba4-93f2-86c768e17613 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:59.211969 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-64103316-2b02-4ba4-93f2-86c768e17613 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:59.212401 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-64103316-2b02-4ba4-93f2-86c768e17613 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:59.271532 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-64103316-2b02-4ba4-93f2-86c768e17613 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:59.278941 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-64103316-2b02-4ba4-93f2-86c768e17613 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078621 Mar 08 15:01:59.279512 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 886/1789] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:59 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:59.525129 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-40a253ef-3724-481e-a533-6664f9f972ad tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:59.525753 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-40a253ef-3724-481e-a533-6664f9f972ad tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:59.531696 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-40a253ef-3724-481e-a533-6664f9f972ad tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:59.532152 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-40a253ef-3724-481e-a533-6664f9f972ad tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:59.532922 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-40a253ef-3724-481e-a533-6664f9f972ad tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:59.533361 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-40a253ef-3724-481e-a533-6664f9f972ad tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:59.665499 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-40a253ef-3724-481e-a533-6664f9f972ad tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:01:59.672770 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-40a253ef-3724-481e-a533-6664f9f972ad tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.152150 Mar 08 15:01:59.673336 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 904/1790] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:01:59 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:01:59.758869 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-ca558d57-a97e-4b85-9081-32f0b618b69f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:01:59.759888 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-ca558d57-a97e-4b85-9081-32f0b618b69f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:01:59.766431 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ca558d57-a97e-4b85-9081-32f0b618b69f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:59.766886 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ca558d57-a97e-4b85-9081-32f0b618b69f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:59.767655 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ca558d57-a97e-4b85-9081-32f0b618b69f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:01:59.768094 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ca558d57-a97e-4b85-9081-32f0b618b69f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:01:59.797318 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-ca558d57-a97e-4b85-9081-32f0b618b69f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042829 Mar 08 15:01:59.797796 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 887/1791] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:01:59 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 15:02:00.295902 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-78606e81-5ee9-43cd-bcfd-0af6aba984bc tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:00.296522 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-78606e81-5ee9-43cd-bcfd-0af6aba984bc tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:00.303194 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-78606e81-5ee9-43cd-bcfd-0af6aba984bc tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:00.303645 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-78606e81-5ee9-43cd-bcfd-0af6aba984bc tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:00.304408 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-78606e81-5ee9-43cd-bcfd-0af6aba984bc tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:00.304847 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-78606e81-5ee9-43cd-bcfd-0af6aba984bc tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:00.363882 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-78606e81-5ee9-43cd-bcfd-0af6aba984bc tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:00.371641 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-78606e81-5ee9-43cd-bcfd-0af6aba984bc tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079603 Mar 08 15:02:00.372197 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 905/1792] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:00 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:00.689943 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-3b273119-339a-4a02-8f46-415901853eff tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:00.690476 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-3b273119-339a-4a02-8f46-415901853eff tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:00.696444 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3b273119-339a-4a02-8f46-415901853eff tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:00.696893 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3b273119-339a-4a02-8f46-415901853eff tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:00.697655 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3b273119-339a-4a02-8f46-415901853eff tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:00.698123 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3b273119-339a-4a02-8f46-415901853eff tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:00.809465 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-2f821139-3ce6-48aa-8187-7796859a2e1c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:00.810414 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-2f821139-3ce6-48aa-8187-7796859a2e1c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:00.816090 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2f821139-3ce6-48aa-8187-7796859a2e1c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:00.816537 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2f821139-3ce6-48aa-8187-7796859a2e1c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:00.817298 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2f821139-3ce6-48aa-8187-7796859a2e1c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:00.817733 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2f821139-3ce6-48aa-8187-7796859a2e1c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:00.832032 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-3b273119-339a-4a02-8f46-415901853eff tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:00.839835 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-3b273119-339a-4a02-8f46-415901853eff tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.153764 Mar 08 15:02:00.840611 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 888/1793] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:00 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:00.845081 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-2f821139-3ce6-48aa-8187-7796859a2e1c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040397 Mar 08 15:02:00.845722 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 906/1794] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:00 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 15:02:01.388901 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-1832a7bb-cc86-46cc-8be2-8e59f14a3046 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:01.389516 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-1832a7bb-cc86-46cc-8be2-8e59f14a3046 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:01.395402 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1832a7bb-cc86-46cc-8be2-8e59f14a3046 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:01.395859 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1832a7bb-cc86-46cc-8be2-8e59f14a3046 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:01.396627 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1832a7bb-cc86-46cc-8be2-8e59f14a3046 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:01.397069 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1832a7bb-cc86-46cc-8be2-8e59f14a3046 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:01.456534 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-1832a7bb-cc86-46cc-8be2-8e59f14a3046 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:01.464376 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-1832a7bb-cc86-46cc-8be2-8e59f14a3046 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079350 Mar 08 15:02:01.464932 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 889/1795] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:01 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:01.856729 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-bfd2fe6e-74e4-4de8-a6c8-5074c6a269d5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:01.857320 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-632377ce-7fab-4311-bb86-31b2fe39eab7 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:01.857694 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-632377ce-7fab-4311-bb86-31b2fe39eab7 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:01.857799 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-bfd2fe6e-74e4-4de8-a6c8-5074c6a269d5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:01.863981 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-632377ce-7fab-4311-bb86-31b2fe39eab7 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:01.864167 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bfd2fe6e-74e4-4de8-a6c8-5074c6a269d5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:01.864434 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-632377ce-7fab-4311-bb86-31b2fe39eab7 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:01.864585 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bfd2fe6e-74e4-4de8-a6c8-5074c6a269d5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:01.865198 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-632377ce-7fab-4311-bb86-31b2fe39eab7 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:01.865392 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bfd2fe6e-74e4-4de8-a6c8-5074c6a269d5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:01.865635 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-632377ce-7fab-4311-bb86-31b2fe39eab7 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:01.865829 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bfd2fe6e-74e4-4de8-a6c8-5074c6a269d5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:01.895437 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-bfd2fe6e-74e4-4de8-a6c8-5074c6a269d5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042588 Mar 08 15:02:01.896117 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 907/1796] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:01 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:02:02.005157 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-632377ce-7fab-4311-bb86-31b2fe39eab7 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:02.013131 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-632377ce-7fab-4311-bb86-31b2fe39eab7 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.159969 Mar 08 15:02:02.013684 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 890/1797] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:01 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:02:02.481132 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-965bc450-8516-4f8e-85ae-602ea5b9ac7e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:02.481733 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-965bc450-8516-4f8e-85ae-602ea5b9ac7e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:02.487598 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-965bc450-8516-4f8e-85ae-602ea5b9ac7e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:02.488047 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-965bc450-8516-4f8e-85ae-602ea5b9ac7e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:02.488802 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-965bc450-8516-4f8e-85ae-602ea5b9ac7e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:02.489234 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-965bc450-8516-4f8e-85ae-602ea5b9ac7e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:02.550387 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-965bc450-8516-4f8e-85ae-602ea5b9ac7e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:02.557888 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-965bc450-8516-4f8e-85ae-602ea5b9ac7e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081197 Mar 08 15:02:02.558438 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 908/1798] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:02 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:02.907320 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-13940b5c-7f55-4d64-8154-f3d1c3f6853c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:02.908154 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-13940b5c-7f55-4d64-8154-f3d1c3f6853c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:02.915149 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-13940b5c-7f55-4d64-8154-f3d1c3f6853c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:02.915621 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-13940b5c-7f55-4d64-8154-f3d1c3f6853c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:02.916390 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-13940b5c-7f55-4d64-8154-f3d1c3f6853c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:02.916830 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-13940b5c-7f55-4d64-8154-f3d1c3f6853c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:02.944836 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-13940b5c-7f55-4d64-8154-f3d1c3f6853c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041575 Mar 08 15:02:02.945399 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 891/1799] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:02 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:02:03.030724 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-e6fcf9cf-978c-497c-87a0-d2f84bfe9340 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:03.031373 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-e6fcf9cf-978c-497c-87a0-d2f84bfe9340 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:03.037711 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e6fcf9cf-978c-497c-87a0-d2f84bfe9340 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:03.038205 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e6fcf9cf-978c-497c-87a0-d2f84bfe9340 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:03.038986 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e6fcf9cf-978c-497c-87a0-d2f84bfe9340 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:03.039432 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e6fcf9cf-978c-497c-87a0-d2f84bfe9340 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:03.172796 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-e6fcf9cf-978c-497c-87a0-d2f84bfe9340 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:03.184104 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-e6fcf9cf-978c-497c-87a0-d2f84bfe9340 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.157305 Mar 08 15:02:03.184688 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 909/1800] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:03 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:03.575295 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-786e5da7-7cc9-460d-882f-e05328513416 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:03.575911 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-786e5da7-7cc9-460d-882f-e05328513416 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:03.581820 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-786e5da7-7cc9-460d-882f-e05328513416 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:03.582307 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-786e5da7-7cc9-460d-882f-e05328513416 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:03.583074 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-786e5da7-7cc9-460d-882f-e05328513416 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:03.583520 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-786e5da7-7cc9-460d-882f-e05328513416 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:03.641908 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-786e5da7-7cc9-460d-882f-e05328513416 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:03.649295 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-786e5da7-7cc9-460d-882f-e05328513416 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078499 Mar 08 15:02:03.649872 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 892/1801] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:03 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:03.956682 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ea847966-2789-494f-b134-bf0c14a826c3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:03.957630 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ea847966-2789-494f-b134-bf0c14a826c3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:03.964460 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ea847966-2789-494f-b134-bf0c14a826c3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:03.964912 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ea847966-2789-494f-b134-bf0c14a826c3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:03.965682 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ea847966-2789-494f-b134-bf0c14a826c3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:03.966164 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ea847966-2789-494f-b134-bf0c14a826c3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:03.993490 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ea847966-2789-494f-b134-bf0c14a826c3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040758 Mar 08 15:02:03.994052 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 910/1802] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:03 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:02:04.200558 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-898ba886-c0f7-43a5-88f6-606dfa9087c0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:04.201175 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-898ba886-c0f7-43a5-88f6-606dfa9087c0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:04.207374 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-898ba886-c0f7-43a5-88f6-606dfa9087c0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:04.207835 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-898ba886-c0f7-43a5-88f6-606dfa9087c0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:04.208612 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-898ba886-c0f7-43a5-88f6-606dfa9087c0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:04.209055 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-898ba886-c0f7-43a5-88f6-606dfa9087c0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:04.357751 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-898ba886-c0f7-43a5-88f6-606dfa9087c0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:04.365236 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-898ba886-c0f7-43a5-88f6-606dfa9087c0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.168504 Mar 08 15:02:04.365797 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 893/1803] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:04 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:04.666173 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ddaac886-dd39-40de-969c-18ed7541ae3d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:04.666782 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ddaac886-dd39-40de-969c-18ed7541ae3d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:04.673023 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ddaac886-dd39-40de-969c-18ed7541ae3d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:04.673472 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ddaac886-dd39-40de-969c-18ed7541ae3d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:04.674263 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ddaac886-dd39-40de-969c-18ed7541ae3d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:04.674700 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ddaac886-dd39-40de-969c-18ed7541ae3d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:04.735316 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ddaac886-dd39-40de-969c-18ed7541ae3d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:04.743359 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ddaac886-dd39-40de-969c-18ed7541ae3d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080356 Mar 08 15:02:04.743927 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 911/1804] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:04 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:05.004920 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-e484241f-b7ba-4428-a11a-e2b0a474e3d7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:05.005912 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-e484241f-b7ba-4428-a11a-e2b0a474e3d7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:05.012997 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e484241f-b7ba-4428-a11a-e2b0a474e3d7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:05.013455 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e484241f-b7ba-4428-a11a-e2b0a474e3d7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:05.014266 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e484241f-b7ba-4428-a11a-e2b0a474e3d7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:05.014715 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e484241f-b7ba-4428-a11a-e2b0a474e3d7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:05.043002 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-e484241f-b7ba-4428-a11a-e2b0a474e3d7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041984 Mar 08 15:02:05.043573 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 894/1805] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:04 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:02:05.382213 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-74f4170e-33b3-426c-9bac-1aa825c6c3a1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:05.382860 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-74f4170e-33b3-426c-9bac-1aa825c6c3a1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:05.389266 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-74f4170e-33b3-426c-9bac-1aa825c6c3a1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:05.389721 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-74f4170e-33b3-426c-9bac-1aa825c6c3a1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:05.390529 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-74f4170e-33b3-426c-9bac-1aa825c6c3a1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:05.390969 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-74f4170e-33b3-426c-9bac-1aa825c6c3a1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:05.527151 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-74f4170e-33b3-426c-9bac-1aa825c6c3a1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:05.534293 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-74f4170e-33b3-426c-9bac-1aa825c6c3a1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.156038 Mar 08 15:02:05.534848 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 912/1806] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:05 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:05.760240 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-89a08145-c331-4fe4-a360-93ab5d2f9aa7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:05.760850 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-89a08145-c331-4fe4-a360-93ab5d2f9aa7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:05.767138 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-89a08145-c331-4fe4-a360-93ab5d2f9aa7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:05.767590 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-89a08145-c331-4fe4-a360-93ab5d2f9aa7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:05.768351 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-89a08145-c331-4fe4-a360-93ab5d2f9aa7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:05.768785 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-89a08145-c331-4fe4-a360-93ab5d2f9aa7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:05.834973 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-89a08145-c331-4fe4-a360-93ab5d2f9aa7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:05.843198 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-89a08145-c331-4fe4-a360-93ab5d2f9aa7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.086851 Mar 08 15:02:05.843751 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 895/1807] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:05 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:06.054779 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-aee06de4-8ceb-4e66-aa0f-df98829386b2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:06.055627 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-aee06de4-8ceb-4e66-aa0f-df98829386b2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:06.062069 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-aee06de4-8ceb-4e66-aa0f-df98829386b2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:06.062621 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-aee06de4-8ceb-4e66-aa0f-df98829386b2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:06.063393 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-aee06de4-8ceb-4e66-aa0f-df98829386b2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:06.063827 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-aee06de4-8ceb-4e66-aa0f-df98829386b2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:06.091553 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-aee06de4-8ceb-4e66-aa0f-df98829386b2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041065 Mar 08 15:02:06.092102 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 913/1808] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:06 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:02:06.552124 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-70d2f262-39b3-4bb5-a3c0-5134b234018b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:06.552730 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-70d2f262-39b3-4bb5-a3c0-5134b234018b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:06.559240 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-70d2f262-39b3-4bb5-a3c0-5134b234018b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:06.559690 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-70d2f262-39b3-4bb5-a3c0-5134b234018b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:06.560452 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-70d2f262-39b3-4bb5-a3c0-5134b234018b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:06.560885 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-70d2f262-39b3-4bb5-a3c0-5134b234018b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:06.696518 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-70d2f262-39b3-4bb5-a3c0-5134b234018b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:06.703781 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-70d2f262-39b3-4bb5-a3c0-5134b234018b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.155775 Mar 08 15:02:06.704340 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 896/1809] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:06 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:06.860366 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c1e96bb4-fc1f-45a7-a13c-6198f6692947 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:06.860905 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-c1e96bb4-fc1f-45a7-a13c-6198f6692947 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:06.866671 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c1e96bb4-fc1f-45a7-a13c-6198f6692947 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:06.867119 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c1e96bb4-fc1f-45a7-a13c-6198f6692947 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:06.868503 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c1e96bb4-fc1f-45a7-a13c-6198f6692947 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:06.868936 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c1e96bb4-fc1f-45a7-a13c-6198f6692947 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:06.926725 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-c1e96bb4-fc1f-45a7-a13c-6198f6692947 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:06.934676 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-c1e96bb4-fc1f-45a7-a13c-6198f6692947 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078188 Mar 08 15:02:06.935241 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 914/1810] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:06 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:07.103750 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-6ab4e9b6-521c-4a4d-96d2-7906faa8b59a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:07.104701 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-6ab4e9b6-521c-4a4d-96d2-7906faa8b59a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:07.111026 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6ab4e9b6-521c-4a4d-96d2-7906faa8b59a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:07.111432 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6ab4e9b6-521c-4a4d-96d2-7906faa8b59a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:07.112199 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6ab4e9b6-521c-4a4d-96d2-7906faa8b59a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:07.112641 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6ab4e9b6-521c-4a4d-96d2-7906faa8b59a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:07.140236 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-6ab4e9b6-521c-4a4d-96d2-7906faa8b59a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041195 Mar 08 15:02:07.140788 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 897/1811] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:07 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:02:07.721973 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-e3e9668c-8539-4d49-b709-63b1a82dce6a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:07.722593 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-e3e9668c-8539-4d49-b709-63b1a82dce6a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:07.728943 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e3e9668c-8539-4d49-b709-63b1a82dce6a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:07.729398 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e3e9668c-8539-4d49-b709-63b1a82dce6a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:07.730206 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e3e9668c-8539-4d49-b709-63b1a82dce6a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:07.730651 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e3e9668c-8539-4d49-b709-63b1a82dce6a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:07.864330 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-e3e9668c-8539-4d49-b709-63b1a82dce6a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:07.872303 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-e3e9668c-8539-4d49-b709-63b1a82dce6a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.154052 Mar 08 15:02:07.872693 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 915/1812] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:07 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:07.952128 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-3378c015-d1cb-4f65-a218-18838e5920be tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:07.952747 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-3378c015-d1cb-4f65-a218-18838e5920be tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:07.958669 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3378c015-d1cb-4f65-a218-18838e5920be tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:07.959124 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3378c015-d1cb-4f65-a218-18838e5920be tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:07.959889 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3378c015-d1cb-4f65-a218-18838e5920be tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:07.960330 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3378c015-d1cb-4f65-a218-18838e5920be tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:08.018523 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-3378c015-d1cb-4f65-a218-18838e5920be tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:08.025749 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-3378c015-d1cb-4f65-a218-18838e5920be tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.077492 Mar 08 15:02:08.026342 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 898/1813] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:07 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:08.152185 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-74780fa5-8814-47c7-9ae2-4a78463f42c8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:08.153037 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-74780fa5-8814-47c7-9ae2-4a78463f42c8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:08.158906 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-74780fa5-8814-47c7-9ae2-4a78463f42c8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:08.159367 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-74780fa5-8814-47c7-9ae2-4a78463f42c8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:08.160143 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-74780fa5-8814-47c7-9ae2-4a78463f42c8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:08.160590 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-74780fa5-8814-47c7-9ae2-4a78463f42c8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:08.188859 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-74780fa5-8814-47c7-9ae2-4a78463f42c8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041149 Mar 08 15:02:08.189409 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 916/1814] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:08 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:02:08.888623 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-9bbf5d50-7eaa-4316-a3eb-ae2d6613bf23 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:08.889229 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-9bbf5d50-7eaa-4316-a3eb-ae2d6613bf23 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:08.895527 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9bbf5d50-7eaa-4316-a3eb-ae2d6613bf23 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:08.895974 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9bbf5d50-7eaa-4316-a3eb-ae2d6613bf23 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:08.896734 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9bbf5d50-7eaa-4316-a3eb-ae2d6613bf23 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:08.897170 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9bbf5d50-7eaa-4316-a3eb-ae2d6613bf23 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:09.034770 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-9bbf5d50-7eaa-4316-a3eb-ae2d6613bf23 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:09.042514 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-412e6ae4-09bf-4fba-9768-c8fdd8bb6500 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:09.042992 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-9bbf5d50-7eaa-4316-a3eb-ae2d6613bf23 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.158067 Mar 08 15:02:09.043112 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-412e6ae4-09bf-4fba-9768-c8fdd8bb6500 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:09.043414 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 899/1815] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:08 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:09.049373 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-412e6ae4-09bf-4fba-9768-c8fdd8bb6500 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:09.049830 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-412e6ae4-09bf-4fba-9768-c8fdd8bb6500 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:09.050636 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-412e6ae4-09bf-4fba-9768-c8fdd8bb6500 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:09.051078 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-412e6ae4-09bf-4fba-9768-c8fdd8bb6500 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:09.114242 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-412e6ae4-09bf-4fba-9768-c8fdd8bb6500 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:09.121733 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-412e6ae4-09bf-4fba-9768-c8fdd8bb6500 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.083183 Mar 08 15:02:09.122322 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 917/1816] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:09 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:02:09.201839 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-a0b85f98-7bc4-4b13-8ec3-4840ef22a8de tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:09.202702 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-a0b85f98-7bc4-4b13-8ec3-4840ef22a8de tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:09.208558 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a0b85f98-7bc4-4b13-8ec3-4840ef22a8de tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:09.209385 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a0b85f98-7bc4-4b13-8ec3-4840ef22a8de tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:09.210763 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a0b85f98-7bc4-4b13-8ec3-4840ef22a8de tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:09.211551 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a0b85f98-7bc4-4b13-8ec3-4840ef22a8de tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:09.251206 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-a0b85f98-7bc4-4b13-8ec3-4840ef22a8de tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053827 Mar 08 15:02:09.251773 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 900/1817] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:09 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:02:10.060098 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-a9aca11f-f094-4027-97cb-e3e08680a766 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:10.060721 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-a9aca11f-f094-4027-97cb-e3e08680a766 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:10.066958 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a9aca11f-f094-4027-97cb-e3e08680a766 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:10.067403 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a9aca11f-f094-4027-97cb-e3e08680a766 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:10.068164 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a9aca11f-f094-4027-97cb-e3e08680a766 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:10.068597 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a9aca11f-f094-4027-97cb-e3e08680a766 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:10.138639 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-7611cc69-7d39-43bd-ae14-d25cc911a9d0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:10.139255 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-7611cc69-7d39-43bd-ae14-d25cc911a9d0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:10.145677 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7611cc69-7d39-43bd-ae14-d25cc911a9d0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:10.146176 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7611cc69-7d39-43bd-ae14-d25cc911a9d0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:10.146956 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7611cc69-7d39-43bd-ae14-d25cc911a9d0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:10.147400 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7611cc69-7d39-43bd-ae14-d25cc911a9d0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:10.204206 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-a9aca11f-f094-4027-97cb-e3e08680a766 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:10.210432 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-7611cc69-7d39-43bd-ae14-d25cc911a9d0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:10.212818 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-a9aca11f-f094-4027-97cb-e3e08680a766 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.156598 Mar 08 15:02:10.213398 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 918/1818] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:10 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:10.218593 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-7611cc69-7d39-43bd-ae14-d25cc911a9d0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.083796 Mar 08 15:02:10.219162 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 901/1819] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:10 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:02:10.262988 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-86bd22c5-caa9-4448-a167-ec56e17ae893 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:10.263898 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-86bd22c5-caa9-4448-a167-ec56e17ae893 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:10.269772 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-86bd22c5-caa9-4448-a167-ec56e17ae893 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:10.270252 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-86bd22c5-caa9-4448-a167-ec56e17ae893 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:10.271030 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-86bd22c5-caa9-4448-a167-ec56e17ae893 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:10.271459 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-86bd22c5-caa9-4448-a167-ec56e17ae893 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:10.299542 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-86bd22c5-caa9-4448-a167-ec56e17ae893 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040730 Mar 08 15:02:10.300094 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 919/1820] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:10 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:02:11.230677 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-3cb79b47-20a9-47fb-8e47-0bf365ce8cf7 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:11.231532 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-3cb79b47-20a9-47fb-8e47-0bf365ce8cf7 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:11.236541 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-656d9d38-d375-4dda-8eb8-6d4fa6433b6a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:11.237234 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-656d9d38-d375-4dda-8eb8-6d4fa6433b6a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:11.237894 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3cb79b47-20a9-47fb-8e47-0bf365ce8cf7 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:11.238333 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3cb79b47-20a9-47fb-8e47-0bf365ce8cf7 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:11.239109 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3cb79b47-20a9-47fb-8e47-0bf365ce8cf7 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:11.239540 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3cb79b47-20a9-47fb-8e47-0bf365ce8cf7 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:11.244714 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-656d9d38-d375-4dda-8eb8-6d4fa6433b6a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:11.245297 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-656d9d38-d375-4dda-8eb8-6d4fa6433b6a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:11.246187 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-656d9d38-d375-4dda-8eb8-6d4fa6433b6a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:11.246705 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-656d9d38-d375-4dda-8eb8-6d4fa6433b6a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:11.308223 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-656d9d38-d375-4dda-8eb8-6d4fa6433b6a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:11.315943 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-656d9d38-d375-4dda-8eb8-6d4fa6433b6a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.083502 Mar 08 15:02:11.316512 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 920/1821] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:11 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:11.321230 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-183ec4be-1c3d-4edc-9199-9e8b6c6d708c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:11.322235 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-183ec4be-1c3d-4edc-9199-9e8b6c6d708c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:11.327844 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-183ec4be-1c3d-4edc-9199-9e8b6c6d708c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:11.328288 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-183ec4be-1c3d-4edc-9199-9e8b6c6d708c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:11.329059 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-183ec4be-1c3d-4edc-9199-9e8b6c6d708c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:11.329492 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-183ec4be-1c3d-4edc-9199-9e8b6c6d708c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:11.358046 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-183ec4be-1c3d-4edc-9199-9e8b6c6d708c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040452 Mar 08 15:02:11.358601 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 921/1822] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:11 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:02:11.478476 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-3cb79b47-20a9-47fb-8e47-0bf365ce8cf7 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:11.485818 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-3cb79b47-20a9-47fb-8e47-0bf365ce8cf7 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.259525 Mar 08 15:02:11.486515 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 902/1823] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:11 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:12.332439 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-78ba2434-64f3-43dd-b683-0ab711b8dcd0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:12.333063 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-78ba2434-64f3-43dd-b683-0ab711b8dcd0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:12.339529 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-78ba2434-64f3-43dd-b683-0ab711b8dcd0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:12.339983 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-78ba2434-64f3-43dd-b683-0ab711b8dcd0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:12.340756 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-78ba2434-64f3-43dd-b683-0ab711b8dcd0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:12.341197 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-78ba2434-64f3-43dd-b683-0ab711b8dcd0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:12.369545 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-fed5c76c-e387-4842-b861-3f0c9f2afaa5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:12.370491 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-fed5c76c-e387-4842-b861-3f0c9f2afaa5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:12.376785 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fed5c76c-e387-4842-b861-3f0c9f2afaa5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:12.377235 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fed5c76c-e387-4842-b861-3f0c9f2afaa5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:12.378033 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fed5c76c-e387-4842-b861-3f0c9f2afaa5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:12.378478 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fed5c76c-e387-4842-b861-3f0c9f2afaa5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:12.401208 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-78ba2434-64f3-43dd-b683-0ab711b8dcd0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:12.408534 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-78ba2434-64f3-43dd-b683-0ab711b8dcd0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079918 Mar 08 15:02:12.409101 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 922/1824] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:12 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:12.409791 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-fed5c76c-e387-4842-b861-3f0c9f2afaa5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044642 Mar 08 15:02:12.410381 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 903/1825] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:12 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:02:12.502392 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-7e67c1a5-88f0-4675-91d6-fd7a9dcfc400 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:12.503002 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-7e67c1a5-88f0-4675-91d6-fd7a9dcfc400 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:12.509419 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7e67c1a5-88f0-4675-91d6-fd7a9dcfc400 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:12.509977 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7e67c1a5-88f0-4675-91d6-fd7a9dcfc400 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:12.510699 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7e67c1a5-88f0-4675-91d6-fd7a9dcfc400 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:12.511139 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7e67c1a5-88f0-4675-91d6-fd7a9dcfc400 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:12.646438 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-7e67c1a5-88f0-4675-91d6-fd7a9dcfc400 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:12.653834 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-7e67c1a5-88f0-4675-91d6-fd7a9dcfc400 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.155090 Mar 08 15:02:12.654420 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 923/1826] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:12 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:13.421993 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-2ea80148-c25f-4558-8508-5d514294be6d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:13.422916 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-2ea80148-c25f-4558-8508-5d514294be6d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:13.425265 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-4ec7e573-ef69-42b9-b9e8-207597c05346 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:13.425892 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-4ec7e573-ef69-42b9-b9e8-207597c05346 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:13.429162 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2ea80148-c25f-4558-8508-5d514294be6d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:13.429617 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2ea80148-c25f-4558-8508-5d514294be6d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:13.430416 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2ea80148-c25f-4558-8508-5d514294be6d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:13.431709 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2ea80148-c25f-4558-8508-5d514294be6d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:13.433591 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4ec7e573-ef69-42b9-b9e8-207597c05346 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:13.434076 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4ec7e573-ef69-42b9-b9e8-207597c05346 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:13.434837 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4ec7e573-ef69-42b9-b9e8-207597c05346 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:13.435343 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4ec7e573-ef69-42b9-b9e8-207597c05346 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:13.462716 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-2ea80148-c25f-4558-8508-5d514294be6d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044759 Mar 08 15:02:13.463606 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 904/1827] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:13 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:02:13.498370 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-4ec7e573-ef69-42b9-b9e8-207597c05346 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:13.505751 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-4ec7e573-ef69-42b9-b9e8-207597c05346 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.084252 Mar 08 15:02:13.506700 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 924/1828] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:13 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:02:13.672175 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-f4d6e45e-72e2-45ac-9ef0-fefe971a761f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:13.672709 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-f4d6e45e-72e2-45ac-9ef0-fefe971a761f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:13.678824 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f4d6e45e-72e2-45ac-9ef0-fefe971a761f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:13.679270 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f4d6e45e-72e2-45ac-9ef0-fefe971a761f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:13.680049 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f4d6e45e-72e2-45ac-9ef0-fefe971a761f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:13.680479 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f4d6e45e-72e2-45ac-9ef0-fefe971a761f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:13.814636 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-f4d6e45e-72e2-45ac-9ef0-fefe971a761f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:13.821889 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-f4d6e45e-72e2-45ac-9ef0-fefe971a761f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.153767 Mar 08 15:02:13.822445 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 905/1829] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:13 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:14.474596 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-125e8574-3cab-4548-8bd7-6411c683d5ca tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:14.475510 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-125e8574-3cab-4548-8bd7-6411c683d5ca tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:14.482558 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-125e8574-3cab-4548-8bd7-6411c683d5ca tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:14.483151 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-125e8574-3cab-4548-8bd7-6411c683d5ca tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:14.484083 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-125e8574-3cab-4548-8bd7-6411c683d5ca tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:14.484653 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-125e8574-3cab-4548-8bd7-6411c683d5ca tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:14.513699 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-125e8574-3cab-4548-8bd7-6411c683d5ca tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043072 Mar 08 15:02:14.514282 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 925/1830] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:14 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:02:14.522661 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-e253f10f-a0ab-431a-8573-590c143306a1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:14.523275 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-e253f10f-a0ab-431a-8573-590c143306a1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:14.529623 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e253f10f-a0ab-431a-8573-590c143306a1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:14.530112 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e253f10f-a0ab-431a-8573-590c143306a1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:14.530881 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e253f10f-a0ab-431a-8573-590c143306a1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:14.531321 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e253f10f-a0ab-431a-8573-590c143306a1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:14.590601 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-e253f10f-a0ab-431a-8573-590c143306a1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:14.597780 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-e253f10f-a0ab-431a-8573-590c143306a1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079046 Mar 08 15:02:14.598374 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 906/1831] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:14 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:14.838704 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d9f01c1e-fcb8-418b-9037-55de92b79597 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:14.839333 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d9f01c1e-fcb8-418b-9037-55de92b79597 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:14.845118 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d9f01c1e-fcb8-418b-9037-55de92b79597 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:14.845566 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d9f01c1e-fcb8-418b-9037-55de92b79597 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:14.846347 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d9f01c1e-fcb8-418b-9037-55de92b79597 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:14.846780 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d9f01c1e-fcb8-418b-9037-55de92b79597 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:14.982598 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d9f01c1e-fcb8-418b-9037-55de92b79597 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:14.989966 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d9f01c1e-fcb8-418b-9037-55de92b79597 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.155072 Mar 08 15:02:14.990527 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 926/1832] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:14 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:15.525159 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-c3f28e9f-bb2f-4a88-8f3a-24a89a2ac700 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:15.526102 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-c3f28e9f-bb2f-4a88-8f3a-24a89a2ac700 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:15.532381 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c3f28e9f-bb2f-4a88-8f3a-24a89a2ac700 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:15.532841 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c3f28e9f-bb2f-4a88-8f3a-24a89a2ac700 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:15.533613 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c3f28e9f-bb2f-4a88-8f3a-24a89a2ac700 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:15.534086 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c3f28e9f-bb2f-4a88-8f3a-24a89a2ac700 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:15.561871 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-c3f28e9f-bb2f-4a88-8f3a-24a89a2ac700 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041191 Mar 08 15:02:15.562446 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 907/1833] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:15 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:02:15.615502 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b114cca8-7237-4186-adb9-930397a250bd tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:15.616127 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b114cca8-7237-4186-adb9-930397a250bd tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:15.622635 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b114cca8-7237-4186-adb9-930397a250bd tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:15.623096 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b114cca8-7237-4186-adb9-930397a250bd tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:15.623913 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b114cca8-7237-4186-adb9-930397a250bd tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:15.624358 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b114cca8-7237-4186-adb9-930397a250bd tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:15.684602 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b114cca8-7237-4186-adb9-930397a250bd tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:15.691842 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b114cca8-7237-4186-adb9-930397a250bd tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080901 Mar 08 15:02:15.692410 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 927/1834] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:15 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:16.007342 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-2f56d282-be90-4ca7-a569-0aed15bd9668 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:16.007954 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-2f56d282-be90-4ca7-a569-0aed15bd9668 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:16.014533 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2f56d282-be90-4ca7-a569-0aed15bd9668 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:16.014987 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2f56d282-be90-4ca7-a569-0aed15bd9668 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:16.015752 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2f56d282-be90-4ca7-a569-0aed15bd9668 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:16.016194 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2f56d282-be90-4ca7-a569-0aed15bd9668 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:16.151993 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-2f56d282-be90-4ca7-a569-0aed15bd9668 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:16.159508 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-2f56d282-be90-4ca7-a569-0aed15bd9668 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.155957 Mar 08 15:02:16.160097 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 908/1835] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:16 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:16.573948 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-9a31a759-f18a-4ca8-8252-a199b2e0c8f4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:16.574858 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-9a31a759-f18a-4ca8-8252-a199b2e0c8f4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:16.580716 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9a31a759-f18a-4ca8-8252-a199b2e0c8f4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:16.581168 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9a31a759-f18a-4ca8-8252-a199b2e0c8f4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:16.581992 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9a31a759-f18a-4ca8-8252-a199b2e0c8f4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:16.582428 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9a31a759-f18a-4ca8-8252-a199b2e0c8f4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:16.609383 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-9a31a759-f18a-4ca8-8252-a199b2e0c8f4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040063 Mar 08 15:02:16.609937 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 928/1836] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:16 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:02:16.708908 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-537fc668-8d7d-4bef-adc8-6b5b83c7250e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:16.709519 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-537fc668-8d7d-4bef-adc8-6b5b83c7250e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:16.716397 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-537fc668-8d7d-4bef-adc8-6b5b83c7250e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:16.716854 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-537fc668-8d7d-4bef-adc8-6b5b83c7250e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:16.717643 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-537fc668-8d7d-4bef-adc8-6b5b83c7250e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:16.718107 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-537fc668-8d7d-4bef-adc8-6b5b83c7250e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:16.780008 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-537fc668-8d7d-4bef-adc8-6b5b83c7250e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:16.787491 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-537fc668-8d7d-4bef-adc8-6b5b83c7250e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.082454 Mar 08 15:02:16.788061 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 909/1837] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:16 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:17.176883 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5bbbcb59-86fd-4b67-b76a-77c8160f944e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:17.177491 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5bbbcb59-86fd-4b67-b76a-77c8160f944e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:17.184404 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5bbbcb59-86fd-4b67-b76a-77c8160f944e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:17.186095 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5bbbcb59-86fd-4b67-b76a-77c8160f944e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:17.186879 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5bbbcb59-86fd-4b67-b76a-77c8160f944e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:17.187319 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5bbbcb59-86fd-4b67-b76a-77c8160f944e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:17.320577 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-5bbbcb59-86fd-4b67-b76a-77c8160f944e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:17.327916 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5bbbcb59-86fd-4b67-b76a-77c8160f944e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.155187 Mar 08 15:02:17.328480 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 929/1838] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:17 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:17.621180 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-fc858775-08c8-45b7-b9da-5ae33dca9e3f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:17.622124 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-fc858775-08c8-45b7-b9da-5ae33dca9e3f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:17.627927 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fc858775-08c8-45b7-b9da-5ae33dca9e3f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:17.628376 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fc858775-08c8-45b7-b9da-5ae33dca9e3f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:17.629140 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fc858775-08c8-45b7-b9da-5ae33dca9e3f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:17.629570 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fc858775-08c8-45b7-b9da-5ae33dca9e3f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:17.657318 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-fc858775-08c8-45b7-b9da-5ae33dca9e3f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040621 Mar 08 15:02:17.657891 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 910/1839] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:17 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:02:17.804831 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-6a7f504a-6d2a-4cb6-a019-aaec8c4c8cc7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:17.805450 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-6a7f504a-6d2a-4cb6-a019-aaec8c4c8cc7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:17.811956 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6a7f504a-6d2a-4cb6-a019-aaec8c4c8cc7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:17.812413 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6a7f504a-6d2a-4cb6-a019-aaec8c4c8cc7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:17.813180 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6a7f504a-6d2a-4cb6-a019-aaec8c4c8cc7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:17.813615 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6a7f504a-6d2a-4cb6-a019-aaec8c4c8cc7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:17.873603 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-6a7f504a-6d2a-4cb6-a019-aaec8c4c8cc7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:17.882304 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-6a7f504a-6d2a-4cb6-a019-aaec8c4c8cc7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081590 Mar 08 15:02:17.882875 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 930/1840] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:17 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:18.344519 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-cef92f75-fcb0-4786-bea6-1c9c0da01a59 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:18.345159 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-cef92f75-fcb0-4786-bea6-1c9c0da01a59 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:18.351429 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cef92f75-fcb0-4786-bea6-1c9c0da01a59 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:18.351878 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cef92f75-fcb0-4786-bea6-1c9c0da01a59 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:18.353919 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cef92f75-fcb0-4786-bea6-1c9c0da01a59 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:18.354369 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cef92f75-fcb0-4786-bea6-1c9c0da01a59 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:18.486232 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-cef92f75-fcb0-4786-bea6-1c9c0da01a59 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:18.493616 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-cef92f75-fcb0-4786-bea6-1c9c0da01a59 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.152966 Mar 08 15:02:18.494259 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 911/1841] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:18 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:18.670819 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-4791559b-3fa5-4809-a1ff-b551063b9c15 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:18.671659 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-4791559b-3fa5-4809-a1ff-b551063b9c15 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:18.678102 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4791559b-3fa5-4809-a1ff-b551063b9c15 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:18.678557 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4791559b-3fa5-4809-a1ff-b551063b9c15 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:18.679319 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4791559b-3fa5-4809-a1ff-b551063b9c15 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:18.679749 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4791559b-3fa5-4809-a1ff-b551063b9c15 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:18.707008 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-4791559b-3fa5-4809-a1ff-b551063b9c15 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042062 Mar 08 15:02:18.707580 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 931/1842] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:18 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:02:18.741077 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 15:02:18.741249 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: Tue Mar 8 15:02:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 15:02:18.898231 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-653d8429-c91b-4f89-a549-bd9cdb9ba736 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:18.898857 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-653d8429-c91b-4f89-a549-bd9cdb9ba736 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:18.905311 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-653d8429-c91b-4f89-a549-bd9cdb9ba736 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:18.905737 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-653d8429-c91b-4f89-a549-bd9cdb9ba736 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:18.906527 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-653d8429-c91b-4f89-a549-bd9cdb9ba736 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:18.906960 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-653d8429-c91b-4f89-a549-bd9cdb9ba736 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:18.971511 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-653d8429-c91b-4f89-a549-bd9cdb9ba736 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:18.978874 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-653d8429-c91b-4f89-a549-bd9cdb9ba736 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.084624 Mar 08 15:02:18.979427 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 912/1843] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:18 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:19.511067 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-8712282d-28a1-4f41-9281-8dde7ce187ec tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:19.511677 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-8712282d-28a1-4f41-9281-8dde7ce187ec tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:19.517552 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8712282d-28a1-4f41-9281-8dde7ce187ec tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:19.518057 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8712282d-28a1-4f41-9281-8dde7ce187ec tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:19.518824 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8712282d-28a1-4f41-9281-8dde7ce187ec tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:19.519264 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8712282d-28a1-4f41-9281-8dde7ce187ec tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:19.656092 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-8712282d-28a1-4f41-9281-8dde7ce187ec tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:19.663403 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-8712282d-28a1-4f41-9281-8dde7ce187ec tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.156738 Mar 08 15:02:19.663968 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 932/1844] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:19 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:19.718700 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-3ec19e5a-fbb0-4208-af8e-9d6986ded9f4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:19.719646 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-3ec19e5a-fbb0-4208-af8e-9d6986ded9f4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:19.725908 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3ec19e5a-fbb0-4208-af8e-9d6986ded9f4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:19.726368 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3ec19e5a-fbb0-4208-af8e-9d6986ded9f4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:19.727130 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3ec19e5a-fbb0-4208-af8e-9d6986ded9f4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:19.728237 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3ec19e5a-fbb0-4208-af8e-9d6986ded9f4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:19.755203 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-3ec19e5a-fbb0-4208-af8e-9d6986ded9f4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040394 Mar 08 15:02:19.755749 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 913/1845] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:19 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:02:19.995579 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-63db1cd9-984b-4b02-a152-f69e8274cfcf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:19.996182 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-63db1cd9-984b-4b02-a152-f69e8274cfcf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:20.002394 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-63db1cd9-984b-4b02-a152-f69e8274cfcf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:20.002852 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-63db1cd9-984b-4b02-a152-f69e8274cfcf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:20.003614 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-63db1cd9-984b-4b02-a152-f69e8274cfcf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:20.004050 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-63db1cd9-984b-4b02-a152-f69e8274cfcf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:20.063110 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-63db1cd9-984b-4b02-a152-f69e8274cfcf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:20.070290 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-63db1cd9-984b-4b02-a152-f69e8274cfcf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078643 Mar 08 15:02:20.070841 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 933/1846] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:19 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:20.681298 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-930fbb72-dcbd-4643-9561-304107fbde10 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:20.681825 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-930fbb72-dcbd-4643-9561-304107fbde10 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:20.689536 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-930fbb72-dcbd-4643-9561-304107fbde10 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:20.690025 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-930fbb72-dcbd-4643-9561-304107fbde10 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:20.690794 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-930fbb72-dcbd-4643-9561-304107fbde10 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:20.691234 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-930fbb72-dcbd-4643-9561-304107fbde10 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:20.766536 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-cb96b97f-b43b-49ea-beb2-e653281de8f8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:20.767773 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-cb96b97f-b43b-49ea-beb2-e653281de8f8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:20.773526 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cb96b97f-b43b-49ea-beb2-e653281de8f8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:20.773979 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cb96b97f-b43b-49ea-beb2-e653281de8f8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:20.774836 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cb96b97f-b43b-49ea-beb2-e653281de8f8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:20.775337 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cb96b97f-b43b-49ea-beb2-e653281de8f8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:20.803994 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-cb96b97f-b43b-49ea-beb2-e653281de8f8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041350 Mar 08 15:02:20.804571 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 934/1847] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:20 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 15:02:20.827530 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-930fbb72-dcbd-4643-9561-304107fbde10 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:20.834809 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-930fbb72-dcbd-4643-9561-304107fbde10 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.158235 Mar 08 15:02:20.835360 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 914/1848] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:20 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:21.088180 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-7afc8a27-90b5-4db2-b137-a85628fe518f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:21.088795 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-7afc8a27-90b5-4db2-b137-a85628fe518f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:21.095088 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7afc8a27-90b5-4db2-b137-a85628fe518f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:21.095539 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7afc8a27-90b5-4db2-b137-a85628fe518f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:21.096308 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7afc8a27-90b5-4db2-b137-a85628fe518f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:21.096749 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7afc8a27-90b5-4db2-b137-a85628fe518f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:21.157933 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-7afc8a27-90b5-4db2-b137-a85628fe518f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:21.166212 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-7afc8a27-90b5-4db2-b137-a85628fe518f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081077 Mar 08 15:02:21.166769 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 935/1849] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:21 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:21.816211 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-8d7bcafd-b579-4a38-aeea-6e091141ee7b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:21.817125 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-8d7bcafd-b579-4a38-aeea-6e091141ee7b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:21.824509 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8d7bcafd-b579-4a38-aeea-6e091141ee7b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:21.824960 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8d7bcafd-b579-4a38-aeea-6e091141ee7b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:21.825722 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8d7bcafd-b579-4a38-aeea-6e091141ee7b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:21.826182 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8d7bcafd-b579-4a38-aeea-6e091141ee7b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:21.851582 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-cb7dc5bc-5c0c-45be-ac89-20c8ecbf02d3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:21.852219 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-cb7dc5bc-5c0c-45be-ac89-20c8ecbf02d3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:21.855025 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-8d7bcafd-b579-4a38-aeea-6e091141ee7b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042729 Mar 08 15:02:21.855584 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 915/1850] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:21 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:02:21.859027 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cb7dc5bc-5c0c-45be-ac89-20c8ecbf02d3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:21.859482 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cb7dc5bc-5c0c-45be-ac89-20c8ecbf02d3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:21.860287 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cb7dc5bc-5c0c-45be-ac89-20c8ecbf02d3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:21.860724 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cb7dc5bc-5c0c-45be-ac89-20c8ecbf02d3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:21.999971 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-cb7dc5bc-5c0c-45be-ac89-20c8ecbf02d3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:22.007384 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-cb7dc5bc-5c0c-45be-ac89-20c8ecbf02d3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.159640 Mar 08 15:02:22.007954 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 936/1851] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:21 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:02:22.183677 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-60f2cb8a-aefb-4ff7-86d5-2abc4fe040fa tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:22.184287 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-60f2cb8a-aefb-4ff7-86d5-2abc4fe040fa tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:22.190164 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-60f2cb8a-aefb-4ff7-86d5-2abc4fe040fa tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:22.190561 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-60f2cb8a-aefb-4ff7-86d5-2abc4fe040fa tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:22.191319 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-60f2cb8a-aefb-4ff7-86d5-2abc4fe040fa tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:22.191754 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-60f2cb8a-aefb-4ff7-86d5-2abc4fe040fa tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:22.251459 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-60f2cb8a-aefb-4ff7-86d5-2abc4fe040fa tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:22.259388 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-60f2cb8a-aefb-4ff7-86d5-2abc4fe040fa tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079830 Mar 08 15:02:22.260048 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 916/1852] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:22 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:22.866655 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-19f0fdba-4635-4d3c-a7e7-1947d0ba64c6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:22.867567 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-19f0fdba-4635-4d3c-a7e7-1947d0ba64c6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:22.874382 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-19f0fdba-4635-4d3c-a7e7-1947d0ba64c6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:22.874836 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-19f0fdba-4635-4d3c-a7e7-1947d0ba64c6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:22.875603 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-19f0fdba-4635-4d3c-a7e7-1947d0ba64c6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:22.876041 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-19f0fdba-4635-4d3c-a7e7-1947d0ba64c6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:22.903565 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-19f0fdba-4635-4d3c-a7e7-1947d0ba64c6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040894 Mar 08 15:02:22.904103 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 937/1853] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:22 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:02:23.024484 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-1c2764e6-4e7e-44dd-96f5-0b747f87543f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:23.025098 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-1c2764e6-4e7e-44dd-96f5-0b747f87543f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:23.031713 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1c2764e6-4e7e-44dd-96f5-0b747f87543f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:23.032168 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1c2764e6-4e7e-44dd-96f5-0b747f87543f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:23.032944 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1c2764e6-4e7e-44dd-96f5-0b747f87543f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:23.033413 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1c2764e6-4e7e-44dd-96f5-0b747f87543f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:23.171477 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-1c2764e6-4e7e-44dd-96f5-0b747f87543f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:23.178933 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-1c2764e6-4e7e-44dd-96f5-0b747f87543f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.158360 Mar 08 15:02:23.179493 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 917/1854] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:23 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:23.276783 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-6c58396b-1789-4484-886f-201924a8e155 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:23.277409 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-6c58396b-1789-4484-886f-201924a8e155 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:23.283829 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6c58396b-1789-4484-886f-201924a8e155 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:23.284281 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6c58396b-1789-4484-886f-201924a8e155 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:23.285072 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6c58396b-1789-4484-886f-201924a8e155 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:23.285511 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6c58396b-1789-4484-886f-201924a8e155 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:23.349157 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-6c58396b-1789-4484-886f-201924a8e155 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:23.357442 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-6c58396b-1789-4484-886f-201924a8e155 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.084742 Mar 08 15:02:23.358061 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 938/1855] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:23 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:23.915393 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-7b23507a-523b-47ba-b3af-0c861e8b55c6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:23.916199 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-7b23507a-523b-47ba-b3af-0c861e8b55c6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:23.922098 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7b23507a-523b-47ba-b3af-0c861e8b55c6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:23.922550 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7b23507a-523b-47ba-b3af-0c861e8b55c6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:23.923307 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7b23507a-523b-47ba-b3af-0c861e8b55c6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:23.923743 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7b23507a-523b-47ba-b3af-0c861e8b55c6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:23.951886 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-7b23507a-523b-47ba-b3af-0c861e8b55c6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041091 Mar 08 15:02:23.952443 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 918/1856] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:23 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:02:24.197139 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c8805332-8dc4-4fd0-baf0-bb70ca6bd3ee tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:24.197679 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-c8805332-8dc4-4fd0-baf0-bb70ca6bd3ee tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:24.204046 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c8805332-8dc4-4fd0-baf0-bb70ca6bd3ee tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:24.204493 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c8805332-8dc4-4fd0-baf0-bb70ca6bd3ee tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:24.205252 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c8805332-8dc4-4fd0-baf0-bb70ca6bd3ee tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:24.205685 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c8805332-8dc4-4fd0-baf0-bb70ca6bd3ee tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:24.337449 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-c8805332-8dc4-4fd0-baf0-bb70ca6bd3ee tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:24.344872 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-c8805332-8dc4-4fd0-baf0-bb70ca6bd3ee tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.152415 Mar 08 15:02:24.345465 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 939/1857] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:24 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:24.373984 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-2d5307be-323a-4c19-9846-bdabbb22acc8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:24.374598 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-2d5307be-323a-4c19-9846-bdabbb22acc8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:24.380824 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2d5307be-323a-4c19-9846-bdabbb22acc8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:24.381280 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2d5307be-323a-4c19-9846-bdabbb22acc8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:24.382078 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2d5307be-323a-4c19-9846-bdabbb22acc8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:24.382519 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2d5307be-323a-4c19-9846-bdabbb22acc8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:24.444651 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-2d5307be-323a-4c19-9846-bdabbb22acc8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:24.452689 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-2d5307be-323a-4c19-9846-bdabbb22acc8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.082482 Mar 08 15:02:24.453191 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 919/1858] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:24 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:02:24.963378 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-6e9c6509-a83e-4849-91ae-1988e5a0d33f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:24.964294 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-6e9c6509-a83e-4849-91ae-1988e5a0d33f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:24.970206 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6e9c6509-a83e-4849-91ae-1988e5a0d33f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:24.970656 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6e9c6509-a83e-4849-91ae-1988e5a0d33f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:24.971420 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6e9c6509-a83e-4849-91ae-1988e5a0d33f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:24.971852 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6e9c6509-a83e-4849-91ae-1988e5a0d33f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:24.999464 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-6e9c6509-a83e-4849-91ae-1988e5a0d33f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040533 Mar 08 15:02:25.000006 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 940/1859] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:24 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:02:25.362603 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-4707a713-c759-453a-bd46-2a45e44787fd tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:25.363213 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-4707a713-c759-453a-bd46-2a45e44787fd tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:25.369273 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4707a713-c759-453a-bd46-2a45e44787fd tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:25.369724 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4707a713-c759-453a-bd46-2a45e44787fd tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:25.370519 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4707a713-c759-453a-bd46-2a45e44787fd tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:25.370955 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4707a713-c759-453a-bd46-2a45e44787fd tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:25.469686 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-1b05627a-ff3d-4ac5-bf52-bdcdfde28a95 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:25.470338 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-1b05627a-ff3d-4ac5-bf52-bdcdfde28a95 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:25.476684 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1b05627a-ff3d-4ac5-bf52-bdcdfde28a95 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:25.477143 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1b05627a-ff3d-4ac5-bf52-bdcdfde28a95 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:25.478102 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1b05627a-ff3d-4ac5-bf52-bdcdfde28a95 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:25.478577 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1b05627a-ff3d-4ac5-bf52-bdcdfde28a95 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:25.504824 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-4707a713-c759-453a-bd46-2a45e44787fd tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:25.513537 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-4707a713-c759-453a-bd46-2a45e44787fd tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.154787 Mar 08 15:02:25.522841 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 920/1860] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:25 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:25.542548 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-1b05627a-ff3d-4ac5-bf52-bdcdfde28a95 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:25.549974 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-1b05627a-ff3d-4ac5-bf52-bdcdfde28a95 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.084032 Mar 08 15:02:25.550530 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 941/1861] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:25 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:02:26.011683 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-186000b1-30f9-4e48-b24c-02020245ef2a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:26.012629 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-186000b1-30f9-4e48-b24c-02020245ef2a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:26.018522 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-186000b1-30f9-4e48-b24c-02020245ef2a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:26.018981 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-186000b1-30f9-4e48-b24c-02020245ef2a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:26.019748 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-186000b1-30f9-4e48-b24c-02020245ef2a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:26.020189 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-186000b1-30f9-4e48-b24c-02020245ef2a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:26.048748 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-186000b1-30f9-4e48-b24c-02020245ef2a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042211 Mar 08 15:02:26.049295 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 921/1862] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:26 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:02:26.530941 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-e2251718-ed41-4130-8fa9-26190f34efeb tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:26.531529 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-e2251718-ed41-4130-8fa9-26190f34efeb tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:26.537698 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e2251718-ed41-4130-8fa9-26190f34efeb tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:26.538247 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e2251718-ed41-4130-8fa9-26190f34efeb tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:26.539018 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e2251718-ed41-4130-8fa9-26190f34efeb tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:26.539453 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e2251718-ed41-4130-8fa9-26190f34efeb tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:26.566280 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-da0fa2dd-f042-45d3-895c-5b5a077fd228 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:26.566885 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-da0fa2dd-f042-45d3-895c-5b5a077fd228 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:26.573374 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-da0fa2dd-f042-45d3-895c-5b5a077fd228 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:26.573826 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-da0fa2dd-f042-45d3-895c-5b5a077fd228 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:26.574638 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-da0fa2dd-f042-45d3-895c-5b5a077fd228 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:26.575078 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-da0fa2dd-f042-45d3-895c-5b5a077fd228 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:26.635158 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-da0fa2dd-f042-45d3-895c-5b5a077fd228 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:26.642517 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-da0fa2dd-f042-45d3-895c-5b5a077fd228 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080027 Mar 08 15:02:26.643156 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 922/1863] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:26 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:02:26.674479 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-e2251718-ed41-4130-8fa9-26190f34efeb tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:26.682098 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-e2251718-ed41-4130-8fa9-26190f34efeb tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.154968 Mar 08 15:02:26.682658 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 942/1864] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:26 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:27.060568 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-3b80d840-58b8-4c73-adf8-f48ec6c8f4d4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:27.061473 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-3b80d840-58b8-4c73-adf8-f48ec6c8f4d4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:27.067305 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3b80d840-58b8-4c73-adf8-f48ec6c8f4d4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:27.067754 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3b80d840-58b8-4c73-adf8-f48ec6c8f4d4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:27.068517 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3b80d840-58b8-4c73-adf8-f48ec6c8f4d4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:27.068953 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3b80d840-58b8-4c73-adf8-f48ec6c8f4d4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:27.097179 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-3b80d840-58b8-4c73-adf8-f48ec6c8f4d4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040724 Mar 08 15:02:27.097728 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 923/1865] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:27 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:02:27.659965 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3c758e68-1c4f-425b-a4d4-f0303b8aa743 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:27.660581 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-3c758e68-1c4f-425b-a4d4-f0303b8aa743 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:27.668082 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3c758e68-1c4f-425b-a4d4-f0303b8aa743 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:27.668536 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3c758e68-1c4f-425b-a4d4-f0303b8aa743 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:27.669304 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3c758e68-1c4f-425b-a4d4-f0303b8aa743 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:27.669744 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3c758e68-1c4f-425b-a4d4-f0303b8aa743 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:27.698941 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-1ae7b127-1b54-4caf-a714-ba2a1cdc46d5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:27.699580 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-1ae7b127-1b54-4caf-a714-ba2a1cdc46d5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:27.705819 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1ae7b127-1b54-4caf-a714-ba2a1cdc46d5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:27.706296 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1ae7b127-1b54-4caf-a714-ba2a1cdc46d5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:27.707066 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1ae7b127-1b54-4caf-a714-ba2a1cdc46d5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:27.707500 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1ae7b127-1b54-4caf-a714-ba2a1cdc46d5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:27.731796 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-3c758e68-1c4f-425b-a4d4-f0303b8aa743 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:27.739199 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-3c758e68-1c4f-425b-a4d4-f0303b8aa743 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.083129 Mar 08 15:02:27.739768 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 943/1866] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:27 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:27.846763 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-1ae7b127-1b54-4caf-a714-ba2a1cdc46d5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:27.854600 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-1ae7b127-1b54-4caf-a714-ba2a1cdc46d5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.159571 Mar 08 15:02:27.855154 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 924/1867] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:27 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:02:28.109249 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-12bbc2fa-14a6-4b16-a623-645161631717 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:28.110210 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-12bbc2fa-14a6-4b16-a623-645161631717 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:28.116026 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-12bbc2fa-14a6-4b16-a623-645161631717 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:28.116473 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-12bbc2fa-14a6-4b16-a623-645161631717 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:28.117230 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-12bbc2fa-14a6-4b16-a623-645161631717 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:28.117663 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-12bbc2fa-14a6-4b16-a623-645161631717 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:28.144314 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-12bbc2fa-14a6-4b16-a623-645161631717 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039052 Mar 08 15:02:28.144847 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 944/1868] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:28 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:02:28.756905 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-4bf74e87-239e-4aa2-99ff-a3c42221a880 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:28.757771 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-4bf74e87-239e-4aa2-99ff-a3c42221a880 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:28.764797 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4bf74e87-239e-4aa2-99ff-a3c42221a880 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:28.765256 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4bf74e87-239e-4aa2-99ff-a3c42221a880 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:28.766080 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4bf74e87-239e-4aa2-99ff-a3c42221a880 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:28.766530 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4bf74e87-239e-4aa2-99ff-a3c42221a880 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:28.825942 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-4bf74e87-239e-4aa2-99ff-a3c42221a880 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:28.833147 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-4bf74e87-239e-4aa2-99ff-a3c42221a880 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080374 Mar 08 15:02:28.833714 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 925/1869] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:28 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:28.871750 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-7e7ad682-4384-407e-a02b-faa1894f65f0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:28.872361 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-7e7ad682-4384-407e-a02b-faa1894f65f0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:28.878584 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7e7ad682-4384-407e-a02b-faa1894f65f0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:28.879033 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7e7ad682-4384-407e-a02b-faa1894f65f0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:28.879790 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7e7ad682-4384-407e-a02b-faa1894f65f0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:28.880219 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7e7ad682-4384-407e-a02b-faa1894f65f0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:29.018276 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-7e7ad682-4384-407e-a02b-faa1894f65f0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:29.025690 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-7e7ad682-4384-407e-a02b-faa1894f65f0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.158383 Mar 08 15:02:29.026291 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 945/1870] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:28 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:29.155871 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-95149d0a-17f6-4bc0-afaf-8470303714fa tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:29.156795 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-95149d0a-17f6-4bc0-afaf-8470303714fa tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:29.162681 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-95149d0a-17f6-4bc0-afaf-8470303714fa tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:29.163142 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-95149d0a-17f6-4bc0-afaf-8470303714fa tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:29.163917 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-95149d0a-17f6-4bc0-afaf-8470303714fa tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:29.164358 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-95149d0a-17f6-4bc0-afaf-8470303714fa tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:29.192727 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-95149d0a-17f6-4bc0-afaf-8470303714fa tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040843 Mar 08 15:02:29.193273 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 926/1871] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:29 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:02:29.849782 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-2b2e2f9b-18e3-4329-82dc-3e7cdcf3d00c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:29.850428 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-2b2e2f9b-18e3-4329-82dc-3e7cdcf3d00c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:29.856319 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2b2e2f9b-18e3-4329-82dc-3e7cdcf3d00c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:29.856768 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2b2e2f9b-18e3-4329-82dc-3e7cdcf3d00c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:29.857530 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2b2e2f9b-18e3-4329-82dc-3e7cdcf3d00c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:29.858003 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2b2e2f9b-18e3-4329-82dc-3e7cdcf3d00c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:29.919000 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-2b2e2f9b-18e3-4329-82dc-3e7cdcf3d00c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:29.926543 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-2b2e2f9b-18e3-4329-82dc-3e7cdcf3d00c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080320 Mar 08 15:02:29.927110 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 946/1872] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:29 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:30.042703 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-4e602e58-98a1-4dac-aa63-5e1a2205581d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:30.043321 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-4e602e58-98a1-4dac-aa63-5e1a2205581d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:30.049584 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4e602e58-98a1-4dac-aa63-5e1a2205581d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:30.050079 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4e602e58-98a1-4dac-aa63-5e1a2205581d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:30.050865 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4e602e58-98a1-4dac-aa63-5e1a2205581d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:30.051564 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4e602e58-98a1-4dac-aa63-5e1a2205581d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:30.190235 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-4e602e58-98a1-4dac-aa63-5e1a2205581d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:30.198227 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-4e602e58-98a1-4dac-aa63-5e1a2205581d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.159653 Mar 08 15:02:30.198804 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 927/1873] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:30 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:30.204270 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3a7d5fdc-2330-4d47-9ec5-670f163b5f61 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:30.205175 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-3a7d5fdc-2330-4d47-9ec5-670f163b5f61 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:30.210875 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3a7d5fdc-2330-4d47-9ec5-670f163b5f61 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:30.211321 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3a7d5fdc-2330-4d47-9ec5-670f163b5f61 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:30.212215 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3a7d5fdc-2330-4d47-9ec5-670f163b5f61 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:30.212553 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3a7d5fdc-2330-4d47-9ec5-670f163b5f61 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:30.239319 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-3a7d5fdc-2330-4d47-9ec5-670f163b5f61 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.038970 Mar 08 15:02:30.239859 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 947/1874] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:30 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:02:30.943894 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-bfc0ee44-8011-4f2f-a833-7cb0ecfb5432 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:30.944501 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-bfc0ee44-8011-4f2f-a833-7cb0ecfb5432 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:30.951170 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bfc0ee44-8011-4f2f-a833-7cb0ecfb5432 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:30.951626 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bfc0ee44-8011-4f2f-a833-7cb0ecfb5432 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:30.952402 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bfc0ee44-8011-4f2f-a833-7cb0ecfb5432 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:30.952843 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bfc0ee44-8011-4f2f-a833-7cb0ecfb5432 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:31.014852 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-bfc0ee44-8011-4f2f-a833-7cb0ecfb5432 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:31.021992 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-bfc0ee44-8011-4f2f-a833-7cb0ecfb5432 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081894 Mar 08 15:02:31.022548 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 928/1875] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:30 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:31.215879 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f736a5e8-3dba-4702-ab14-c01a7b1bbb23 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:31.216436 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f736a5e8-3dba-4702-ab14-c01a7b1bbb23 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:31.222711 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f736a5e8-3dba-4702-ab14-c01a7b1bbb23 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:31.223163 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f736a5e8-3dba-4702-ab14-c01a7b1bbb23 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:31.223962 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f736a5e8-3dba-4702-ab14-c01a7b1bbb23 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:31.224401 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f736a5e8-3dba-4702-ab14-c01a7b1bbb23 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:31.251380 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-ffe333df-2463-458d-b48b-40d268cbbda1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:31.252291 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-ffe333df-2463-458d-b48b-40d268cbbda1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:31.258845 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ffe333df-2463-458d-b48b-40d268cbbda1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:31.259472 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ffe333df-2463-458d-b48b-40d268cbbda1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:31.260252 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ffe333df-2463-458d-b48b-40d268cbbda1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:31.260690 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ffe333df-2463-458d-b48b-40d268cbbda1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:31.289489 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-ffe333df-2463-458d-b48b-40d268cbbda1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041901 Mar 08 15:02:31.290805 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 929/1876] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:31 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 15:02:31.361164 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f736a5e8-3dba-4702-ab14-c01a7b1bbb23 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:31.368821 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f736a5e8-3dba-4702-ab14-c01a7b1bbb23 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.157540 Mar 08 15:02:31.369389 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 948/1877] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:31 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:32.039469 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-7ef0c7a8-230e-47a4-919c-ab7b1722c895 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:32.040684 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-7ef0c7a8-230e-47a4-919c-ab7b1722c895 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:32.046614 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7ef0c7a8-230e-47a4-919c-ab7b1722c895 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:32.047064 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7ef0c7a8-230e-47a4-919c-ab7b1722c895 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:32.047822 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7ef0c7a8-230e-47a4-919c-ab7b1722c895 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:32.048255 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7ef0c7a8-230e-47a4-919c-ab7b1722c895 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:32.107373 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-7ef0c7a8-230e-47a4-919c-ab7b1722c895 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:32.114537 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-7ef0c7a8-230e-47a4-919c-ab7b1722c895 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078926 Mar 08 15:02:32.115115 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 930/1878] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:32 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:32.301977 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-67fcb686-3c92-4058-9a9f-3d9b4d222ad2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:32.302930 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-67fcb686-3c92-4058-9a9f-3d9b4d222ad2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:32.309247 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-67fcb686-3c92-4058-9a9f-3d9b4d222ad2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:32.309703 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-67fcb686-3c92-4058-9a9f-3d9b4d222ad2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:32.310518 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-67fcb686-3c92-4058-9a9f-3d9b4d222ad2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:32.310963 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-67fcb686-3c92-4058-9a9f-3d9b4d222ad2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:32.338981 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-67fcb686-3c92-4058-9a9f-3d9b4d222ad2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041175 Mar 08 15:02:32.339521 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 949/1879] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:32 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:02:32.385840 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-6562fa46-3e33-4eb8-83d5-85325b06edd3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:32.386484 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-6562fa46-3e33-4eb8-83d5-85325b06edd3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:32.392825 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6562fa46-3e33-4eb8-83d5-85325b06edd3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:32.393272 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6562fa46-3e33-4eb8-83d5-85325b06edd3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:32.394075 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6562fa46-3e33-4eb8-83d5-85325b06edd3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:32.394509 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6562fa46-3e33-4eb8-83d5-85325b06edd3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:32.528454 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-6562fa46-3e33-4eb8-83d5-85325b06edd3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:32.535658 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-6562fa46-3e33-4eb8-83d5-85325b06edd3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.154425 Mar 08 15:02:32.536220 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 931/1880] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:32 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:33.131463 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-bbc1b7e2-bb53-4c02-84ac-1e97596c6279 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:33.132077 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-bbc1b7e2-bb53-4c02-84ac-1e97596c6279 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:33.138211 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bbc1b7e2-bb53-4c02-84ac-1e97596c6279 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:33.138665 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bbc1b7e2-bb53-4c02-84ac-1e97596c6279 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:33.139433 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bbc1b7e2-bb53-4c02-84ac-1e97596c6279 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:33.139867 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bbc1b7e2-bb53-4c02-84ac-1e97596c6279 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:33.198924 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-bbc1b7e2-bb53-4c02-84ac-1e97596c6279 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:33.206382 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-bbc1b7e2-bb53-4c02-84ac-1e97596c6279 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078811 Mar 08 15:02:33.206946 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 950/1881] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:33 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:33.350484 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-4f848ea0-64ab-443f-bb3a-1445a6f46285 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:33.351411 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-4f848ea0-64ab-443f-bb3a-1445a6f46285 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:33.357975 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4f848ea0-64ab-443f-bb3a-1445a6f46285 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:33.358432 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4f848ea0-64ab-443f-bb3a-1445a6f46285 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:33.359208 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4f848ea0-64ab-443f-bb3a-1445a6f46285 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:33.359650 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4f848ea0-64ab-443f-bb3a-1445a6f46285 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:33.386638 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-4f848ea0-64ab-443f-bb3a-1445a6f46285 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040034 Mar 08 15:02:33.387259 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 932/1882] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:33 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:02:33.552737 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-61587e5a-09cb-400a-8418-907d93e05b42 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:33.553352 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-61587e5a-09cb-400a-8418-907d93e05b42 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:33.559638 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-61587e5a-09cb-400a-8418-907d93e05b42 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:33.560092 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-61587e5a-09cb-400a-8418-907d93e05b42 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:33.560866 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-61587e5a-09cb-400a-8418-907d93e05b42 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:33.561305 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-61587e5a-09cb-400a-8418-907d93e05b42 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:33.697483 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-61587e5a-09cb-400a-8418-907d93e05b42 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:33.704691 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-61587e5a-09cb-400a-8418-907d93e05b42 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.156067 Mar 08 15:02:33.705243 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 951/1883] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:33 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:34.223702 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-d720151c-105d-4449-91a2-cd2584e5a6a5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:34.224278 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-d720151c-105d-4449-91a2-cd2584e5a6a5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:34.230691 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d720151c-105d-4449-91a2-cd2584e5a6a5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:34.231170 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d720151c-105d-4449-91a2-cd2584e5a6a5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:34.231937 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d720151c-105d-4449-91a2-cd2584e5a6a5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:34.232377 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d720151c-105d-4449-91a2-cd2584e5a6a5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:34.295488 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-d720151c-105d-4449-91a2-cd2584e5a6a5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:34.303049 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-d720151c-105d-4449-91a2-cd2584e5a6a5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.083288 Mar 08 15:02:34.303610 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 933/1884] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:34 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:34.398044 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-8d17fb75-b3f3-4f23-8e8d-b76ce9e204e8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:34.399041 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-8d17fb75-b3f3-4f23-8e8d-b76ce9e204e8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:34.405405 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8d17fb75-b3f3-4f23-8e8d-b76ce9e204e8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:34.405876 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8d17fb75-b3f3-4f23-8e8d-b76ce9e204e8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:34.406644 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8d17fb75-b3f3-4f23-8e8d-b76ce9e204e8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:34.407075 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8d17fb75-b3f3-4f23-8e8d-b76ce9e204e8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:34.436627 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-8d17fb75-b3f3-4f23-8e8d-b76ce9e204e8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042503 Mar 08 15:02:34.437391 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 952/1885] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:34 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:02:34.722000 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-dcdadbd3-1117-43db-b8db-cc3d00c1914c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:34.722619 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-dcdadbd3-1117-43db-b8db-cc3d00c1914c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:34.729143 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-dcdadbd3-1117-43db-b8db-cc3d00c1914c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:34.729600 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-dcdadbd3-1117-43db-b8db-cc3d00c1914c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:34.730398 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-dcdadbd3-1117-43db-b8db-cc3d00c1914c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:34.730863 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-dcdadbd3-1117-43db-b8db-cc3d00c1914c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:34.863755 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-dcdadbd3-1117-43db-b8db-cc3d00c1914c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:34.871200 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-dcdadbd3-1117-43db-b8db-cc3d00c1914c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.153043 Mar 08 15:02:34.871764 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 934/1886] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:34 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:35.320351 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-cca8329d-a6dd-4da8-94a3-b253c91cc662 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:35.320964 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-cca8329d-a6dd-4da8-94a3-b253c91cc662 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:35.327636 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cca8329d-a6dd-4da8-94a3-b253c91cc662 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:35.328087 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cca8329d-a6dd-4da8-94a3-b253c91cc662 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:35.328856 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cca8329d-a6dd-4da8-94a3-b253c91cc662 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:35.329291 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cca8329d-a6dd-4da8-94a3-b253c91cc662 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:35.387616 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-cca8329d-a6dd-4da8-94a3-b253c91cc662 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:35.394892 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-cca8329d-a6dd-4da8-94a3-b253c91cc662 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078389 Mar 08 15:02:35.395443 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 953/1887] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:35 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:35.448791 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-32ee997c-f1d4-4049-ba80-195687e93a95 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:35.449702 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-32ee997c-f1d4-4049-ba80-195687e93a95 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:35.455886 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-32ee997c-f1d4-4049-ba80-195687e93a95 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:35.456338 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-32ee997c-f1d4-4049-ba80-195687e93a95 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:35.457110 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-32ee997c-f1d4-4049-ba80-195687e93a95 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:35.457815 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-32ee997c-f1d4-4049-ba80-195687e93a95 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:35.484591 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-32ee997c-f1d4-4049-ba80-195687e93a95 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040309 Mar 08 15:02:35.485134 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 935/1888] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:35 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:02:35.888236 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-e91d9562-0d54-4be3-804a-af3af99b62f6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:35.888812 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-e91d9562-0d54-4be3-804a-af3af99b62f6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:35.894598 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e91d9562-0d54-4be3-804a-af3af99b62f6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:35.895050 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e91d9562-0d54-4be3-804a-af3af99b62f6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:35.895808 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e91d9562-0d54-4be3-804a-af3af99b62f6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:35.896240 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e91d9562-0d54-4be3-804a-af3af99b62f6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:36.035910 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-e91d9562-0d54-4be3-804a-af3af99b62f6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:36.044149 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-e91d9562-0d54-4be3-804a-af3af99b62f6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.159808 Mar 08 15:02:36.044707 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 954/1889] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:35 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:36.412196 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-7db63a2a-931b-4cd5-a9c9-635c555c8e92 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:36.412808 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-7db63a2a-931b-4cd5-a9c9-635c555c8e92 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:36.419730 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7db63a2a-931b-4cd5-a9c9-635c555c8e92 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:36.420187 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7db63a2a-931b-4cd5-a9c9-635c555c8e92 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:36.420960 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7db63a2a-931b-4cd5-a9c9-635c555c8e92 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:36.421395 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7db63a2a-931b-4cd5-a9c9-635c555c8e92 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:36.480817 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-7db63a2a-931b-4cd5-a9c9-635c555c8e92 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:36.488094 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-7db63a2a-931b-4cd5-a9c9-635c555c8e92 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079836 Mar 08 15:02:36.488693 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 936/1890] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:36 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:36.496035 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-a4f2c1b8-3021-419c-9fec-1ec595ab8338 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:36.497038 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-a4f2c1b8-3021-419c-9fec-1ec595ab8338 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:36.503032 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a4f2c1b8-3021-419c-9fec-1ec595ab8338 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:36.503489 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a4f2c1b8-3021-419c-9fec-1ec595ab8338 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:36.504257 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a4f2c1b8-3021-419c-9fec-1ec595ab8338 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:36.504702 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a4f2c1b8-3021-419c-9fec-1ec595ab8338 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:36.533384 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-a4f2c1b8-3021-419c-9fec-1ec595ab8338 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041261 Mar 08 15:02:36.533943 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 955/1891] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:36 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:02:37.062152 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-e4d73377-722a-4484-98cb-b28b5984ede2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:37.062761 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-e4d73377-722a-4484-98cb-b28b5984ede2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:37.068634 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e4d73377-722a-4484-98cb-b28b5984ede2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:37.069084 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e4d73377-722a-4484-98cb-b28b5984ede2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:37.069841 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e4d73377-722a-4484-98cb-b28b5984ede2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:37.070299 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e4d73377-722a-4484-98cb-b28b5984ede2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:37.208622 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-e4d73377-722a-4484-98cb-b28b5984ede2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:37.216379 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-e4d73377-722a-4484-98cb-b28b5984ede2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.158122 Mar 08 15:02:37.216953 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 937/1892] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:37 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:37.505379 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d5452837-d0da-4864-8886-4dec40c30933 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:37.506031 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d5452837-d0da-4864-8886-4dec40c30933 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:37.512807 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d5452837-d0da-4864-8886-4dec40c30933 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:37.513264 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d5452837-d0da-4864-8886-4dec40c30933 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:37.514080 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d5452837-d0da-4864-8886-4dec40c30933 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:37.514524 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d5452837-d0da-4864-8886-4dec40c30933 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:37.544575 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-38dd305a-eb11-44f0-9588-508c980c1034 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:37.545487 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-38dd305a-eb11-44f0-9588-508c980c1034 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:37.552054 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-38dd305a-eb11-44f0-9588-508c980c1034 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:37.552503 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-38dd305a-eb11-44f0-9588-508c980c1034 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:37.553272 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-38dd305a-eb11-44f0-9588-508c980c1034 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:37.553703 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-38dd305a-eb11-44f0-9588-508c980c1034 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:37.573844 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d5452837-d0da-4864-8886-4dec40c30933 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:37.581324 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d5452837-d0da-4864-8886-4dec40c30933 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079832 Mar 08 15:02:37.581956 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 956/1893] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:37 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:37.584120 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-38dd305a-eb11-44f0-9588-508c980c1034 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043403 Mar 08 15:02:37.584700 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 938/1894] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:37 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 15:02:38.232499 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-6a78a35c-fe92-46da-8b42-a88a90e9c764 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:38.233128 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-6a78a35c-fe92-46da-8b42-a88a90e9c764 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:38.238924 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6a78a35c-fe92-46da-8b42-a88a90e9c764 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:38.239371 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6a78a35c-fe92-46da-8b42-a88a90e9c764 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:38.240132 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6a78a35c-fe92-46da-8b42-a88a90e9c764 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:38.240562 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6a78a35c-fe92-46da-8b42-a88a90e9c764 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:38.373002 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-6a78a35c-fe92-46da-8b42-a88a90e9c764 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:38.380343 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-6a78a35c-fe92-46da-8b42-a88a90e9c764 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.151762 Mar 08 15:02:38.380925 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 957/1895] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:38 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:38.596188 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-be3b38e9-a24a-484a-a627-22bd8883ea9b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:38.597059 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-be3b38e9-a24a-484a-a627-22bd8883ea9b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:38.598934 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b0cba7ac-c88c-49eb-b175-794201ee1a6c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:38.599545 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b0cba7ac-c88c-49eb-b175-794201ee1a6c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:38.603816 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-be3b38e9-a24a-484a-a627-22bd8883ea9b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:38.604272 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-be3b38e9-a24a-484a-a627-22bd8883ea9b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:38.605051 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-be3b38e9-a24a-484a-a627-22bd8883ea9b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:38.605493 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-be3b38e9-a24a-484a-a627-22bd8883ea9b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:38.606572 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b0cba7ac-c88c-49eb-b175-794201ee1a6c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:38.607027 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b0cba7ac-c88c-49eb-b175-794201ee1a6c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:38.607798 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b0cba7ac-c88c-49eb-b175-794201ee1a6c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:38.608234 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b0cba7ac-c88c-49eb-b175-794201ee1a6c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:38.634112 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-be3b38e9-a24a-484a-a627-22bd8883ea9b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041355 Mar 08 15:02:38.634677 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 939/1896] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:38 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:02:38.670194 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b0cba7ac-c88c-49eb-b175-794201ee1a6c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:38.677829 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b0cba7ac-c88c-49eb-b175-794201ee1a6c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.082656 Mar 08 15:02:38.678410 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 958/1897] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:38 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:02:39.397924 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b283bac0-055b-487a-87b6-5463d6e373bc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:39.398540 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-b283bac0-055b-487a-87b6-5463d6e373bc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:39.404729 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b283bac0-055b-487a-87b6-5463d6e373bc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:39.405180 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b283bac0-055b-487a-87b6-5463d6e373bc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:39.405971 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b283bac0-055b-487a-87b6-5463d6e373bc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:39.406412 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b283bac0-055b-487a-87b6-5463d6e373bc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:39.538358 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-b283bac0-055b-487a-87b6-5463d6e373bc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:39.546400 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-b283bac0-055b-487a-87b6-5463d6e373bc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.152395 Mar 08 15:02:39.546960 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 940/1898] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:39 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:39.645287 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-e229e7d7-4fa9-478f-9554-d0a7864486ad tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:39.646218 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-e229e7d7-4fa9-478f-9554-d0a7864486ad tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:39.652915 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e229e7d7-4fa9-478f-9554-d0a7864486ad tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:39.653306 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e229e7d7-4fa9-478f-9554-d0a7864486ad tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:39.654094 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e229e7d7-4fa9-478f-9554-d0a7864486ad tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:39.654529 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e229e7d7-4fa9-478f-9554-d0a7864486ad tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:39.682242 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-e229e7d7-4fa9-478f-9554-d0a7864486ad tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040890 Mar 08 15:02:39.682777 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 959/1899] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:39 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:02:39.695342 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-7a39df84-9251-4d83-9eb2-42f5c615ff3f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:39.696164 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-7a39df84-9251-4d83-9eb2-42f5c615ff3f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:39.702392 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7a39df84-9251-4d83-9eb2-42f5c615ff3f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:39.702843 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7a39df84-9251-4d83-9eb2-42f5c615ff3f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:39.703604 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7a39df84-9251-4d83-9eb2-42f5c615ff3f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:39.704036 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7a39df84-9251-4d83-9eb2-42f5c615ff3f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:39.762724 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-7a39df84-9251-4d83-9eb2-42f5c615ff3f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:39.769736 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-7a39df84-9251-4d83-9eb2-42f5c615ff3f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078218 Mar 08 15:02:39.770331 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 941/1900] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:39 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:40.564269 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-02363d8e-b6be-4737-9a9f-701670ed65d6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:40.564891 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-02363d8e-b6be-4737-9a9f-701670ed65d6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:40.571401 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-02363d8e-b6be-4737-9a9f-701670ed65d6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:40.571855 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-02363d8e-b6be-4737-9a9f-701670ed65d6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:40.572624 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-02363d8e-b6be-4737-9a9f-701670ed65d6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:40.573085 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-02363d8e-b6be-4737-9a9f-701670ed65d6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:40.693692 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-560763fb-fc80-4897-b61d-2af6c6852a26 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:40.694734 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-560763fb-fc80-4897-b61d-2af6c6852a26 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:40.701739 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-560763fb-fc80-4897-b61d-2af6c6852a26 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:40.702360 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-560763fb-fc80-4897-b61d-2af6c6852a26 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:40.702988 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-560763fb-fc80-4897-b61d-2af6c6852a26 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:40.703429 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-560763fb-fc80-4897-b61d-2af6c6852a26 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:40.709961 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-02363d8e-b6be-4737-9a9f-701670ed65d6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:40.717689 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-02363d8e-b6be-4737-9a9f-701670ed65d6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.157278 Mar 08 15:02:40.718297 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 960/1901] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:40 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:40.730844 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-560763fb-fc80-4897-b61d-2af6c6852a26 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041111 Mar 08 15:02:40.731394 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 942/1902] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:40 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 15:02:40.786694 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-21b2746b-d51e-4883-b0d0-347af9bd8d65 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:40.787309 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-21b2746b-d51e-4883-b0d0-347af9bd8d65 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:40.793422 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-21b2746b-d51e-4883-b0d0-347af9bd8d65 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:40.793907 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-21b2746b-d51e-4883-b0d0-347af9bd8d65 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:40.794691 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-21b2746b-d51e-4883-b0d0-347af9bd8d65 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:40.795132 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-21b2746b-d51e-4883-b0d0-347af9bd8d65 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:40.854311 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-21b2746b-d51e-4883-b0d0-347af9bd8d65 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:40.861575 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-21b2746b-d51e-4883-b0d0-347af9bd8d65 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078707 Mar 08 15:02:40.862204 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 961/1903] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:40 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:41.734497 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-ff31d4d2-e506-4ea5-aa2e-5b9e1814d7f6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:41.735205 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-ff31d4d2-e506-4ea5-aa2e-5b9e1814d7f6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:41.741352 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-a23021db-40fc-4d02-8fdb-ef7aa95cdcc6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:41.741819 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ff31d4d2-e506-4ea5-aa2e-5b9e1814d7f6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:41.742209 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ff31d4d2-e506-4ea5-aa2e-5b9e1814d7f6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:41.742337 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-a23021db-40fc-4d02-8fdb-ef7aa95cdcc6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:41.743135 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ff31d4d2-e506-4ea5-aa2e-5b9e1814d7f6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:41.743745 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ff31d4d2-e506-4ea5-aa2e-5b9e1814d7f6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:41.748438 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a23021db-40fc-4d02-8fdb-ef7aa95cdcc6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:41.748888 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a23021db-40fc-4d02-8fdb-ef7aa95cdcc6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:41.749652 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a23021db-40fc-4d02-8fdb-ef7aa95cdcc6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:41.750115 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a23021db-40fc-4d02-8fdb-ef7aa95cdcc6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:41.778457 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-a23021db-40fc-4d02-8fdb-ef7aa95cdcc6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040877 Mar 08 15:02:41.779020 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 962/1904] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:41 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 15:02:41.879269 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-cdd1a35a-5b90-44c4-a172-42604d5ae11d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:41.879882 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-cdd1a35a-5b90-44c4-a172-42604d5ae11d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:41.881275 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-ff31d4d2-e506-4ea5-aa2e-5b9e1814d7f6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:41.886449 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cdd1a35a-5b90-44c4-a172-42604d5ae11d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:41.886898 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cdd1a35a-5b90-44c4-a172-42604d5ae11d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:41.887665 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cdd1a35a-5b90-44c4-a172-42604d5ae11d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:41.888103 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cdd1a35a-5b90-44c4-a172-42604d5ae11d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:41.889229 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-ff31d4d2-e506-4ea5-aa2e-5b9e1814d7f6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.158806 Mar 08 15:02:41.889804 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 943/1905] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:41 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:41.947359 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-cdd1a35a-5b90-44c4-a172-42604d5ae11d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:41.955135 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-cdd1a35a-5b90-44c4-a172-42604d5ae11d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079704 Mar 08 15:02:41.955740 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 963/1906] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:41 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:02:42.790530 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-cc2cdc60-15af-4a3d-9e42-0c005d4ab956 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:42.791472 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-cc2cdc60-15af-4a3d-9e42-0c005d4ab956 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:42.797730 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cc2cdc60-15af-4a3d-9e42-0c005d4ab956 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:42.798218 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cc2cdc60-15af-4a3d-9e42-0c005d4ab956 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:42.798984 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cc2cdc60-15af-4a3d-9e42-0c005d4ab956 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:42.799425 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cc2cdc60-15af-4a3d-9e42-0c005d4ab956 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:42.827078 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-cc2cdc60-15af-4a3d-9e42-0c005d4ab956 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041077 Mar 08 15:02:42.827633 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 944/1907] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:42 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:02:42.906880 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-39c4fa53-ee7c-4d3a-8cb7-49127d73b6a3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:42.907493 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-39c4fa53-ee7c-4d3a-8cb7-49127d73b6a3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:42.913811 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-39c4fa53-ee7c-4d3a-8cb7-49127d73b6a3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:42.914289 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-39c4fa53-ee7c-4d3a-8cb7-49127d73b6a3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:42.915849 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-39c4fa53-ee7c-4d3a-8cb7-49127d73b6a3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:42.916281 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-39c4fa53-ee7c-4d3a-8cb7-49127d73b6a3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:42.972421 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-02348083-85af-4527-a4ab-83418eaec7f1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:42.973028 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-02348083-85af-4527-a4ab-83418eaec7f1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:42.979543 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-02348083-85af-4527-a4ab-83418eaec7f1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:42.979988 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-02348083-85af-4527-a4ab-83418eaec7f1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:42.980759 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-02348083-85af-4527-a4ab-83418eaec7f1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:42.981191 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-02348083-85af-4527-a4ab-83418eaec7f1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:43.047693 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-02348083-85af-4527-a4ab-83418eaec7f1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:43.055687 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-02348083-85af-4527-a4ab-83418eaec7f1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.086822 Mar 08 15:02:43.056429 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 945/1908] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:42 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:02:43.056782 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-39c4fa53-ee7c-4d3a-8cb7-49127d73b6a3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:43.066671 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-39c4fa53-ee7c-4d3a-8cb7-49127d73b6a3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.163582 Mar 08 15:02:43.067228 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 964/1909] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:42 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:43.838477 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-3d49e823-e105-4f2a-a812-a34bef7d1f60 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:43.839389 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-3d49e823-e105-4f2a-a812-a34bef7d1f60 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:43.845372 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3d49e823-e105-4f2a-a812-a34bef7d1f60 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:43.845828 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3d49e823-e105-4f2a-a812-a34bef7d1f60 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:43.846622 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3d49e823-e105-4f2a-a812-a34bef7d1f60 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:43.847061 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3d49e823-e105-4f2a-a812-a34bef7d1f60 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:43.874681 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-3d49e823-e105-4f2a-a812-a34bef7d1f60 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040082 Mar 08 15:02:43.875162 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 946/1910] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:43 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:02:44.073134 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c4cf891f-8e13-46b4-86e1-fd6f94dfba66 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:44.073771 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-c4cf891f-8e13-46b4-86e1-fd6f94dfba66 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:44.080116 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c4cf891f-8e13-46b4-86e1-fd6f94dfba66 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:44.080572 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c4cf891f-8e13-46b4-86e1-fd6f94dfba66 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:44.081347 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c4cf891f-8e13-46b4-86e1-fd6f94dfba66 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:44.081816 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c4cf891f-8e13-46b4-86e1-fd6f94dfba66 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:44.083184 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-10945411-f172-464a-98b3-fde27237448c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:44.083800 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-10945411-f172-464a-98b3-fde27237448c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:44.090081 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-10945411-f172-464a-98b3-fde27237448c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:44.090540 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-10945411-f172-464a-98b3-fde27237448c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:44.091318 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-10945411-f172-464a-98b3-fde27237448c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:44.091759 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-10945411-f172-464a-98b3-fde27237448c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:44.142048 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-c4cf891f-8e13-46b4-86e1-fd6f94dfba66 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:44.149908 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-c4cf891f-8e13-46b4-86e1-fd6f94dfba66 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080643 Mar 08 15:02:44.150485 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 965/1911] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:44 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:44.227789 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-10945411-f172-464a-98b3-fde27237448c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:44.235160 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-10945411-f172-464a-98b3-fde27237448c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.155775 Mar 08 15:02:44.235760 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 947/1912] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:44 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:02:44.886842 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-85097b24-d70b-4464-aa23-0edc6de35102 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:44.887753 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-85097b24-d70b-4464-aa23-0edc6de35102 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:44.893531 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-85097b24-d70b-4464-aa23-0edc6de35102 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:44.894009 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-85097b24-d70b-4464-aa23-0edc6de35102 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:44.894772 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-85097b24-d70b-4464-aa23-0edc6de35102 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:44.895206 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-85097b24-d70b-4464-aa23-0edc6de35102 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:44.924179 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-85097b24-d70b-4464-aa23-0edc6de35102 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042008 Mar 08 15:02:44.924932 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 966/1913] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:44 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:02:45.167465 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-7cf7cf7f-870b-48af-99d7-dcdbb60e7519 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:45.167999 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-7cf7cf7f-870b-48af-99d7-dcdbb60e7519 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:45.174300 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7cf7cf7f-870b-48af-99d7-dcdbb60e7519 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:45.174758 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7cf7cf7f-870b-48af-99d7-dcdbb60e7519 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:45.175529 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7cf7cf7f-870b-48af-99d7-dcdbb60e7519 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:45.175976 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7cf7cf7f-870b-48af-99d7-dcdbb60e7519 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:45.239242 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-7cf7cf7f-870b-48af-99d7-dcdbb60e7519 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:45.246985 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-7cf7cf7f-870b-48af-99d7-dcdbb60e7519 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.083727 Mar 08 15:02:45.247557 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 948/1914] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:45 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:45.252521 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-56c47e7a-28d6-463b-a4b5-063dc927f6a0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:45.253130 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-56c47e7a-28d6-463b-a4b5-063dc927f6a0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:45.260043 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-56c47e7a-28d6-463b-a4b5-063dc927f6a0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:45.260488 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-56c47e7a-28d6-463b-a4b5-063dc927f6a0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:45.261282 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-56c47e7a-28d6-463b-a4b5-063dc927f6a0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:45.261715 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-56c47e7a-28d6-463b-a4b5-063dc927f6a0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:45.394911 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-56c47e7a-28d6-463b-a4b5-063dc927f6a0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:45.402244 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-56c47e7a-28d6-463b-a4b5-063dc927f6a0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.153494 Mar 08 15:02:45.402802 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 967/1915] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:45 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:02:45.936287 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-54a60762-7b14-48f2-9f25-aa78aba8d38c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:45.937115 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-54a60762-7b14-48f2-9f25-aa78aba8d38c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:45.942988 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-54a60762-7b14-48f2-9f25-aa78aba8d38c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:45.943446 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-54a60762-7b14-48f2-9f25-aa78aba8d38c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:45.944222 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-54a60762-7b14-48f2-9f25-aa78aba8d38c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:45.944643 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-54a60762-7b14-48f2-9f25-aa78aba8d38c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:45.972817 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-54a60762-7b14-48f2-9f25-aa78aba8d38c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040579 Mar 08 15:02:45.973362 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 949/1916] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:45 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:02:46.263537 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-0907e555-98ec-46f1-a27c-84e15e31669e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:46.264144 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-0907e555-98ec-46f1-a27c-84e15e31669e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:46.270344 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0907e555-98ec-46f1-a27c-84e15e31669e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:46.270793 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0907e555-98ec-46f1-a27c-84e15e31669e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:46.271557 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0907e555-98ec-46f1-a27c-84e15e31669e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:46.271992 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0907e555-98ec-46f1-a27c-84e15e31669e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:46.333974 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-0907e555-98ec-46f1-a27c-84e15e31669e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:46.341948 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-0907e555-98ec-46f1-a27c-84e15e31669e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.082256 Mar 08 15:02:46.342510 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 968/1917] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:46 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:46.419604 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-8ea8d54b-d65a-4275-8939-ffe10c81e1c5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:46.420201 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-8ea8d54b-d65a-4275-8939-ffe10c81e1c5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:46.426637 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8ea8d54b-d65a-4275-8939-ffe10c81e1c5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:46.427086 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8ea8d54b-d65a-4275-8939-ffe10c81e1c5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:46.427843 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8ea8d54b-d65a-4275-8939-ffe10c81e1c5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:46.428277 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8ea8d54b-d65a-4275-8939-ffe10c81e1c5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:46.560818 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-8ea8d54b-d65a-4275-8939-ffe10c81e1c5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:46.568090 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-8ea8d54b-d65a-4275-8939-ffe10c81e1c5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.152755 Mar 08 15:02:46.568646 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 950/1918] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:46 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:46.984342 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f476cecd-bfde-4393-8169-1baf3a395fc6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:46.985259 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f476cecd-bfde-4393-8169-1baf3a395fc6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:46.991179 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f476cecd-bfde-4393-8169-1baf3a395fc6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:46.991632 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f476cecd-bfde-4393-8169-1baf3a395fc6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:46.992405 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f476cecd-bfde-4393-8169-1baf3a395fc6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:46.993438 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f476cecd-bfde-4393-8169-1baf3a395fc6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:47.021649 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f476cecd-bfde-4393-8169-1baf3a395fc6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041271 Mar 08 15:02:47.022228 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 969/1919] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:46 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:02:47.358886 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-c46607bf-1ed2-453c-9918-f5af62b683de tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:47.359494 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-c46607bf-1ed2-453c-9918-f5af62b683de tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:47.365610 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c46607bf-1ed2-453c-9918-f5af62b683de tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:47.366092 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c46607bf-1ed2-453c-9918-f5af62b683de tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:47.366852 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c46607bf-1ed2-453c-9918-f5af62b683de tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:47.367284 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c46607bf-1ed2-453c-9918-f5af62b683de tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:47.427246 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-c46607bf-1ed2-453c-9918-f5af62b683de tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:47.434977 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-c46607bf-1ed2-453c-9918-f5af62b683de tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079940 Mar 08 15:02:47.435533 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 951/1920] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:47 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:47.585668 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-690ff22b-0fc9-416e-9395-0eb34463fd1a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:47.586533 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-690ff22b-0fc9-416e-9395-0eb34463fd1a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:47.592553 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-690ff22b-0fc9-416e-9395-0eb34463fd1a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:47.593010 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-690ff22b-0fc9-416e-9395-0eb34463fd1a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:47.593783 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-690ff22b-0fc9-416e-9395-0eb34463fd1a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:47.594255 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-690ff22b-0fc9-416e-9395-0eb34463fd1a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:47.725297 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-690ff22b-0fc9-416e-9395-0eb34463fd1a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:47.733010 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-690ff22b-0fc9-416e-9395-0eb34463fd1a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.151183 Mar 08 15:02:47.733572 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 970/1921] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:47 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:48.033035 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-5d1b4419-6b8d-48f4-a0c1-34d36fbc0eb5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:48.033994 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-5d1b4419-6b8d-48f4-a0c1-34d36fbc0eb5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:48.040626 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5d1b4419-6b8d-48f4-a0c1-34d36fbc0eb5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:48.041086 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5d1b4419-6b8d-48f4-a0c1-34d36fbc0eb5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:48.041898 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5d1b4419-6b8d-48f4-a0c1-34d36fbc0eb5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:48.042404 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5d1b4419-6b8d-48f4-a0c1-34d36fbc0eb5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:48.080178 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-5d1b4419-6b8d-48f4-a0c1-34d36fbc0eb5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051064 Mar 08 15:02:48.084687 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 952/1922] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:48 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:02:48.451882 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-384763e3-b7d4-4220-b24c-3cbcee0a7d6f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:48.452518 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-384763e3-b7d4-4220-b24c-3cbcee0a7d6f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:48.458353 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-384763e3-b7d4-4220-b24c-3cbcee0a7d6f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:48.458803 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-384763e3-b7d4-4220-b24c-3cbcee0a7d6f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:48.459558 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-384763e3-b7d4-4220-b24c-3cbcee0a7d6f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:48.459990 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-384763e3-b7d4-4220-b24c-3cbcee0a7d6f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:48.518511 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-384763e3-b7d4-4220-b24c-3cbcee0a7d6f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:48.526413 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-384763e3-b7d4-4220-b24c-3cbcee0a7d6f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078409 Mar 08 15:02:48.526966 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 971/1923] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:48 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:48.749969 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-6321b244-23c8-4882-8de5-158a397193e0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:48.750617 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-6321b244-23c8-4882-8de5-158a397193e0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:48.757463 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6321b244-23c8-4882-8de5-158a397193e0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:48.758600 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6321b244-23c8-4882-8de5-158a397193e0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:48.759448 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6321b244-23c8-4882-8de5-158a397193e0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:48.760026 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6321b244-23c8-4882-8de5-158a397193e0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:48.903280 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-6321b244-23c8-4882-8de5-158a397193e0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:48.910841 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-6321b244-23c8-4882-8de5-158a397193e0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.164850 Mar 08 15:02:48.911400 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 953/1924] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:48 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:02:49.095861 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-516fb6c4-4691-466c-a9c9-c616599fdb80 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:49.096713 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-516fb6c4-4691-466c-a9c9-c616599fdb80 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:49.103249 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-516fb6c4-4691-466c-a9c9-c616599fdb80 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:49.103710 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-516fb6c4-4691-466c-a9c9-c616599fdb80 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:49.104469 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-516fb6c4-4691-466c-a9c9-c616599fdb80 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:49.104904 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-516fb6c4-4691-466c-a9c9-c616599fdb80 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:49.135075 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-516fb6c4-4691-466c-a9c9-c616599fdb80 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043207 Mar 08 15:02:49.135644 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 972/1925] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:49 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:02:49.543843 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-7b555d60-f30c-4e29-bedc-638f48f19528 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:49.544462 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-7b555d60-f30c-4e29-bedc-638f48f19528 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:49.550352 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7b555d60-f30c-4e29-bedc-638f48f19528 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:49.550805 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7b555d60-f30c-4e29-bedc-638f48f19528 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:49.551836 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7b555d60-f30c-4e29-bedc-638f48f19528 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:49.552277 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7b555d60-f30c-4e29-bedc-638f48f19528 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:49.611754 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-7b555d60-f30c-4e29-bedc-638f48f19528 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:49.619911 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-7b555d60-f30c-4e29-bedc-638f48f19528 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080518 Mar 08 15:02:49.620479 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 954/1926] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:49 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:49.928511 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-84ce50cb-63b8-4057-b744-80fbec51f831 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:49.929082 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-84ce50cb-63b8-4057-b744-80fbec51f831 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:49.935234 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-84ce50cb-63b8-4057-b744-80fbec51f831 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:49.935694 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-84ce50cb-63b8-4057-b744-80fbec51f831 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:49.936469 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-84ce50cb-63b8-4057-b744-80fbec51f831 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:49.936913 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-84ce50cb-63b8-4057-b744-80fbec51f831 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:50.072859 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-84ce50cb-63b8-4057-b744-80fbec51f831 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:50.080404 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-84ce50cb-63b8-4057-b744-80fbec51f831 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.156078 Mar 08 15:02:50.080973 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 973/1927] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:49 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:50.146671 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-946a2975-5b2a-4881-b5d1-bf68a0baaf69 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:50.147613 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-946a2975-5b2a-4881-b5d1-bf68a0baaf69 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:50.153822 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-946a2975-5b2a-4881-b5d1-bf68a0baaf69 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:50.154303 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-946a2975-5b2a-4881-b5d1-bf68a0baaf69 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:50.155065 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-946a2975-5b2a-4881-b5d1-bf68a0baaf69 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:50.155500 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-946a2975-5b2a-4881-b5d1-bf68a0baaf69 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:50.183746 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-946a2975-5b2a-4881-b5d1-bf68a0baaf69 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040962 Mar 08 15:02:50.184218 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 955/1928] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:50 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:02:50.636965 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d2615652-7ffe-4d17-b841-b0c0a7733f88 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:50.637572 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d2615652-7ffe-4d17-b841-b0c0a7733f88 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:50.643761 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d2615652-7ffe-4d17-b841-b0c0a7733f88 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:50.644211 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d2615652-7ffe-4d17-b841-b0c0a7733f88 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:50.644969 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d2615652-7ffe-4d17-b841-b0c0a7733f88 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:50.645401 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d2615652-7ffe-4d17-b841-b0c0a7733f88 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:50.704977 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d2615652-7ffe-4d17-b841-b0c0a7733f88 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:50.712959 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d2615652-7ffe-4d17-b841-b0c0a7733f88 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080018 Mar 08 15:02:50.713513 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 974/1929] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:50 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:51.098171 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-faa24698-7ffc-49da-a7de-39004dda6500 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:51.098778 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-faa24698-7ffc-49da-a7de-39004dda6500 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:51.104800 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-faa24698-7ffc-49da-a7de-39004dda6500 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:51.105250 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-faa24698-7ffc-49da-a7de-39004dda6500 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:51.106036 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-faa24698-7ffc-49da-a7de-39004dda6500 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:51.106469 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-faa24698-7ffc-49da-a7de-39004dda6500 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:51.195169 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ae8bc30c-0f87-4340-96d7-23a1e10bca26 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:51.197386 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ae8bc30c-0f87-4340-96d7-23a1e10bca26 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:51.203303 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ae8bc30c-0f87-4340-96d7-23a1e10bca26 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:51.203937 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ae8bc30c-0f87-4340-96d7-23a1e10bca26 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:51.204727 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ae8bc30c-0f87-4340-96d7-23a1e10bca26 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:51.205189 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ae8bc30c-0f87-4340-96d7-23a1e10bca26 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:51.233875 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ae8bc30c-0f87-4340-96d7-23a1e10bca26 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042607 Mar 08 15:02:51.234440 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 975/1930] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:51 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 15:02:51.245466 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-faa24698-7ffc-49da-a7de-39004dda6500 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:51.252645 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-faa24698-7ffc-49da-a7de-39004dda6500 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.158359 Mar 08 15:02:51.253198 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 956/1931] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:51 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:51.730707 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-2477d841-3d16-443e-a301-e9587c12ed32 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:51.731324 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-2477d841-3d16-443e-a301-e9587c12ed32 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:51.737518 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2477d841-3d16-443e-a301-e9587c12ed32 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:51.738014 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2477d841-3d16-443e-a301-e9587c12ed32 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:51.738783 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2477d841-3d16-443e-a301-e9587c12ed32 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:51.739221 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2477d841-3d16-443e-a301-e9587c12ed32 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:51.798518 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-2477d841-3d16-443e-a301-e9587c12ed32 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:51.806606 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-2477d841-3d16-443e-a301-e9587c12ed32 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080788 Mar 08 15:02:51.807170 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 976/1932] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:51 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:52.245510 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-ab40ffc8-d2f0-40b9-8030-c5bf6274e53a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:52.247292 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-ab40ffc8-d2f0-40b9-8030-c5bf6274e53a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:52.253959 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ab40ffc8-d2f0-40b9-8030-c5bf6274e53a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:52.254533 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ab40ffc8-d2f0-40b9-8030-c5bf6274e53a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:52.255314 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ab40ffc8-d2f0-40b9-8030-c5bf6274e53a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:52.255750 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ab40ffc8-d2f0-40b9-8030-c5bf6274e53a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:52.269579 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-2af7e6a2-3e8d-47c3-8f81-2b1bcca38d03 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:52.270224 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-2af7e6a2-3e8d-47c3-8f81-2b1bcca38d03 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:52.276560 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2af7e6a2-3e8d-47c3-8f81-2b1bcca38d03 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:52.277012 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2af7e6a2-3e8d-47c3-8f81-2b1bcca38d03 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:52.277785 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2af7e6a2-3e8d-47c3-8f81-2b1bcca38d03 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:52.278262 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2af7e6a2-3e8d-47c3-8f81-2b1bcca38d03 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:52.285469 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-ab40ffc8-d2f0-40b9-8030-c5bf6274e53a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044279 Mar 08 15:02:52.286059 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 957/1933] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:52 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:02:52.415285 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-2af7e6a2-3e8d-47c3-8f81-2b1bcca38d03 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:52.422636 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-2af7e6a2-3e8d-47c3-8f81-2b1bcca38d03 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.156893 Mar 08 15:02:52.423228 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 977/1934] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:52 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:02:52.824048 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-896c22a6-d42e-445f-802b-353e7879986f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:52.824661 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-896c22a6-d42e-445f-802b-353e7879986f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:52.830530 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-896c22a6-d42e-445f-802b-353e7879986f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:52.830975 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-896c22a6-d42e-445f-802b-353e7879986f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:52.831741 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-896c22a6-d42e-445f-802b-353e7879986f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:52.832177 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-896c22a6-d42e-445f-802b-353e7879986f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:52.891562 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-896c22a6-d42e-445f-802b-353e7879986f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:52.898835 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-896c22a6-d42e-445f-802b-353e7879986f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079345 Mar 08 15:02:52.899478 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 958/1935] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:52 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:53.296846 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3ddb0fee-6b46-4561-96c8-598cbcd83e60 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:53.297802 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-3ddb0fee-6b46-4561-96c8-598cbcd83e60 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:53.304323 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3ddb0fee-6b46-4561-96c8-598cbcd83e60 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:53.304774 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3ddb0fee-6b46-4561-96c8-598cbcd83e60 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:53.306331 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3ddb0fee-6b46-4561-96c8-598cbcd83e60 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:53.306773 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3ddb0fee-6b46-4561-96c8-598cbcd83e60 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:53.333983 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-3ddb0fee-6b46-4561-96c8-598cbcd83e60 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041133 Mar 08 15:02:53.334522 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 978/1936] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:53 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:02:53.441162 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-e9341445-ad06-4825-8cd1-2b1b451b96bc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:53.441776 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-e9341445-ad06-4825-8cd1-2b1b451b96bc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:53.448663 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e9341445-ad06-4825-8cd1-2b1b451b96bc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:53.449113 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e9341445-ad06-4825-8cd1-2b1b451b96bc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:53.449898 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e9341445-ad06-4825-8cd1-2b1b451b96bc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:53.450341 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e9341445-ad06-4825-8cd1-2b1b451b96bc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:53.587218 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-e9341445-ad06-4825-8cd1-2b1b451b96bc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:53.594495 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-e9341445-ad06-4825-8cd1-2b1b451b96bc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.157438 Mar 08 15:02:53.595052 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 959/1937] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:53 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:53.915961 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b0deebd3-8bab-4475-bf6f-f045c3cf83d2 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:53.916495 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b0deebd3-8bab-4475-bf6f-f045c3cf83d2 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:53.922366 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b0deebd3-8bab-4475-bf6f-f045c3cf83d2 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:53.922821 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b0deebd3-8bab-4475-bf6f-f045c3cf83d2 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:53.923588 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b0deebd3-8bab-4475-bf6f-f045c3cf83d2 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:53.924028 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b0deebd3-8bab-4475-bf6f-f045c3cf83d2 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:53.982885 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b0deebd3-8bab-4475-bf6f-f045c3cf83d2 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:53.990104 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b0deebd3-8bab-4475-bf6f-f045c3cf83d2 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078146 Mar 08 15:02:53.990666 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 979/1938] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:53 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:54.345424 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-89075b46-f65a-4727-8c0b-c0c2d89a0e1c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:54.346379 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-89075b46-f65a-4727-8c0b-c0c2d89a0e1c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:54.352783 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-89075b46-f65a-4727-8c0b-c0c2d89a0e1c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:54.353339 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-89075b46-f65a-4727-8c0b-c0c2d89a0e1c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:54.354170 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-89075b46-f65a-4727-8c0b-c0c2d89a0e1c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:54.354627 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-89075b46-f65a-4727-8c0b-c0c2d89a0e1c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:54.386422 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-89075b46-f65a-4727-8c0b-c0c2d89a0e1c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045234 Mar 08 15:02:54.386996 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 960/1939] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:54 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:02:54.611913 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-6737a2e2-af4f-45f4-adbf-ea467d476b71 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:54.612452 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-6737a2e2-af4f-45f4-adbf-ea467d476b71 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:54.619468 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6737a2e2-af4f-45f4-adbf-ea467d476b71 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:54.619922 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6737a2e2-af4f-45f4-adbf-ea467d476b71 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:54.620687 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6737a2e2-af4f-45f4-adbf-ea467d476b71 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:54.621127 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6737a2e2-af4f-45f4-adbf-ea467d476b71 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:54.753480 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-6737a2e2-af4f-45f4-adbf-ea467d476b71 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:54.761376 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-6737a2e2-af4f-45f4-adbf-ea467d476b71 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.153399 Mar 08 15:02:54.761968 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 980/1940] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:54 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:55.007200 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b80f1606-4396-4818-b02a-bd03bc2c07df tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:55.007822 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-b80f1606-4396-4818-b02a-bd03bc2c07df tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:55.014958 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b80f1606-4396-4818-b02a-bd03bc2c07df tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:55.015416 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b80f1606-4396-4818-b02a-bd03bc2c07df tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:55.016187 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b80f1606-4396-4818-b02a-bd03bc2c07df tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:55.016629 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b80f1606-4396-4818-b02a-bd03bc2c07df tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:55.075738 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-b80f1606-4396-4818-b02a-bd03bc2c07df tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:55.082995 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-b80f1606-4396-4818-b02a-bd03bc2c07df tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079739 Mar 08 15:02:55.083558 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 961/1941] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:55 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:55.397840 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b5dfba1a-6a05-4c46-9c0a-1d09f800fe07 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:55.399390 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b5dfba1a-6a05-4c46-9c0a-1d09f800fe07 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:55.405275 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b5dfba1a-6a05-4c46-9c0a-1d09f800fe07 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:55.405729 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b5dfba1a-6a05-4c46-9c0a-1d09f800fe07 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:55.406540 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b5dfba1a-6a05-4c46-9c0a-1d09f800fe07 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:55.406979 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b5dfba1a-6a05-4c46-9c0a-1d09f800fe07 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:55.435157 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b5dfba1a-6a05-4c46-9c0a-1d09f800fe07 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041353 Mar 08 15:02:55.435719 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 981/1942] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:55 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:02:55.778199 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-f06c9396-f029-4f1e-9cbb-1fef20e5bf1f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:55.778809 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-f06c9396-f029-4f1e-9cbb-1fef20e5bf1f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:55.784610 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f06c9396-f029-4f1e-9cbb-1fef20e5bf1f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:55.785061 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f06c9396-f029-4f1e-9cbb-1fef20e5bf1f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:55.785819 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f06c9396-f029-4f1e-9cbb-1fef20e5bf1f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:55.786357 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f06c9396-f029-4f1e-9cbb-1fef20e5bf1f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:55.923456 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-f06c9396-f029-4f1e-9cbb-1fef20e5bf1f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:55.931494 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-f06c9396-f029-4f1e-9cbb-1fef20e5bf1f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.157254 Mar 08 15:02:55.932061 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 962/1943] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:55 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:56.099139 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-2a16172b-d78e-416b-8c5b-2da14d98e42e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:56.099682 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-2a16172b-d78e-416b-8c5b-2da14d98e42e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:56.106146 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2a16172b-d78e-416b-8c5b-2da14d98e42e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:56.106601 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2a16172b-d78e-416b-8c5b-2da14d98e42e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:56.107367 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2a16172b-d78e-416b-8c5b-2da14d98e42e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:56.107809 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2a16172b-d78e-416b-8c5b-2da14d98e42e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:56.178396 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-2a16172b-d78e-416b-8c5b-2da14d98e42e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:56.185661 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-2a16172b-d78e-416b-8c5b-2da14d98e42e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.090446 Mar 08 15:02:56.186256 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 982/1944] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:56 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:56.448001 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-c70fcdf3-346b-41dd-842f-d2485a83eaab tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:56.448879 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-c70fcdf3-346b-41dd-842f-d2485a83eaab tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:56.455105 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c70fcdf3-346b-41dd-842f-d2485a83eaab tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:56.455557 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c70fcdf3-346b-41dd-842f-d2485a83eaab tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:56.456323 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c70fcdf3-346b-41dd-842f-d2485a83eaab tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:56.456757 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c70fcdf3-346b-41dd-842f-d2485a83eaab tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:56.484047 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-c70fcdf3-346b-41dd-842f-d2485a83eaab tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041280 Mar 08 15:02:56.484582 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 963/1945] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:56 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:02:56.948583 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-32b66a7c-9ec7-443f-94f0-d86442569112 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:56.949201 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-32b66a7c-9ec7-443f-94f0-d86442569112 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:56.955034 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-32b66a7c-9ec7-443f-94f0-d86442569112 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:56.955484 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-32b66a7c-9ec7-443f-94f0-d86442569112 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:56.956247 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-32b66a7c-9ec7-443f-94f0-d86442569112 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:56.956678 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-32b66a7c-9ec7-443f-94f0-d86442569112 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:57.091660 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-32b66a7c-9ec7-443f-94f0-d86442569112 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:57.098866 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-32b66a7c-9ec7-443f-94f0-d86442569112 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.154420 Mar 08 15:02:57.099429 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 983/1946] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:56 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:57.202923 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-e544de05-182f-4b99-882e-75995bcfce2c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:57.203483 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-e544de05-182f-4b99-882e-75995bcfce2c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:57.209276 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e544de05-182f-4b99-882e-75995bcfce2c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:57.209747 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e544de05-182f-4b99-882e-75995bcfce2c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:57.210543 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e544de05-182f-4b99-882e-75995bcfce2c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:57.210965 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e544de05-182f-4b99-882e-75995bcfce2c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:57.269534 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-e544de05-182f-4b99-882e-75995bcfce2c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:57.277602 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-e544de05-182f-4b99-882e-75995bcfce2c tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078924 Mar 08 15:02:57.278199 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 964/1947] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:57 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:57.495794 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f09601c6-2300-4661-914e-6d6ed807032a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:57.496705 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f09601c6-2300-4661-914e-6d6ed807032a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:57.502970 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f09601c6-2300-4661-914e-6d6ed807032a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:57.503417 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f09601c6-2300-4661-914e-6d6ed807032a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:57.504177 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f09601c6-2300-4661-914e-6d6ed807032a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:57.504612 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f09601c6-2300-4661-914e-6d6ed807032a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:57.532241 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f09601c6-2300-4661-914e-6d6ed807032a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040557 Mar 08 15:02:57.532782 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 984/1948] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:57 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:02:58.116327 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-5bed55ea-ac7b-4726-bd8b-016e18b53b5c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:58.116943 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-5bed55ea-ac7b-4726-bd8b-016e18b53b5c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:58.123982 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5bed55ea-ac7b-4726-bd8b-016e18b53b5c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:58.124431 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5bed55ea-ac7b-4726-bd8b-016e18b53b5c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:58.125194 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5bed55ea-ac7b-4726-bd8b-016e18b53b5c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:58.125633 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5bed55ea-ac7b-4726-bd8b-016e18b53b5c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:58.263531 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-5bed55ea-ac7b-4726-bd8b-016e18b53b5c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:58.270798 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-5bed55ea-ac7b-4726-bd8b-016e18b53b5c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.158522 Mar 08 15:02:58.271351 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 965/1949] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:58 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:58.295907 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3bf9efe6-44ae-4cd0-92bc-36bd20c89a0e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:58.296514 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-3bf9efe6-44ae-4cd0-92bc-36bd20c89a0e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:58.302546 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3bf9efe6-44ae-4cd0-92bc-36bd20c89a0e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:58.302995 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3bf9efe6-44ae-4cd0-92bc-36bd20c89a0e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:58.303756 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3bf9efe6-44ae-4cd0-92bc-36bd20c89a0e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:58.304192 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3bf9efe6-44ae-4cd0-92bc-36bd20c89a0e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:58.361985 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-3bf9efe6-44ae-4cd0-92bc-36bd20c89a0e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:58.370028 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-3bf9efe6-44ae-4cd0-92bc-36bd20c89a0e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078323 Mar 08 15:02:58.370575 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 985/1950] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:58 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:58.544357 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-eb4b9a3a-ab74-4e32-9ed6-a6aad78ec67b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:58.545270 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-eb4b9a3a-ab74-4e32-9ed6-a6aad78ec67b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:58.551179 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-eb4b9a3a-ab74-4e32-9ed6-a6aad78ec67b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:58.551921 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-eb4b9a3a-ab74-4e32-9ed6-a6aad78ec67b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:58.552682 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-eb4b9a3a-ab74-4e32-9ed6-a6aad78ec67b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:58.553117 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-eb4b9a3a-ab74-4e32-9ed6-a6aad78ec67b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:58.580895 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-eb4b9a3a-ab74-4e32-9ed6-a6aad78ec67b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040536 Mar 08 15:02:58.581430 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 966/1951] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:58 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:02:59.287667 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5db1725b-72d7-4eb8-871a-1f344e5d3568 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:59.288300 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5db1725b-72d7-4eb8-871a-1f344e5d3568 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:59.296043 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5db1725b-72d7-4eb8-871a-1f344e5d3568 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:59.296602 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5db1725b-72d7-4eb8-871a-1f344e5d3568 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:59.297238 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5db1725b-72d7-4eb8-871a-1f344e5d3568 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:59.297672 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5db1725b-72d7-4eb8-871a-1f344e5d3568 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:59.387312 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-3380d51a-d32e-4129-8fc7-4f222f3ea686 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:59.387921 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-3380d51a-d32e-4129-8fc7-4f222f3ea686 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:59.394245 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3380d51a-d32e-4129-8fc7-4f222f3ea686 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:59.394701 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3380d51a-d32e-4129-8fc7-4f222f3ea686 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:59.395470 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3380d51a-d32e-4129-8fc7-4f222f3ea686 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:59.395906 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3380d51a-d32e-4129-8fc7-4f222f3ea686 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:59.432475 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-5db1725b-72d7-4eb8-871a-1f344e5d3568 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:59.439795 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5db1725b-72d7-4eb8-871a-1f344e5d3568 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.155915 Mar 08 15:02:59.440353 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 986/1952] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:59 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:02:59.457296 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-3380d51a-d32e-4129-8fc7-4f222f3ea686 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:02:59.465439 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-3380d51a-d32e-4129-8fc7-4f222f3ea686 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.082015 Mar 08 15:02:59.466028 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 967/1953] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:02:59 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:02:59.593184 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-abd8d8a5-5030-4288-9152-54f8cf903709 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:02:59.594058 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-abd8d8a5-5030-4288-9152-54f8cf903709 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:02:59.599856 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-abd8d8a5-5030-4288-9152-54f8cf903709 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:59.600302 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-abd8d8a5-5030-4288-9152-54f8cf903709 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:59.601061 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-abd8d8a5-5030-4288-9152-54f8cf903709 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:02:59.601490 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-abd8d8a5-5030-4288-9152-54f8cf903709 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:02:59.628692 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-abd8d8a5-5030-4288-9152-54f8cf903709 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039522 Mar 08 15:02:59.629234 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 987/1954] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:02:59 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:03:00.457039 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-ff5e472c-8ac0-459d-96b7-a5e7883224ba tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:00.457641 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-ff5e472c-8ac0-459d-96b7-a5e7883224ba tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:00.463977 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ff5e472c-8ac0-459d-96b7-a5e7883224ba tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:00.464423 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ff5e472c-8ac0-459d-96b7-a5e7883224ba tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:00.465178 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ff5e472c-8ac0-459d-96b7-a5e7883224ba tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:00.465612 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ff5e472c-8ac0-459d-96b7-a5e7883224ba tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:00.482412 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-0e1b7ea4-660a-4963-8014-537f61e752bf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:00.483032 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-0e1b7ea4-660a-4963-8014-537f61e752bf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:00.489206 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0e1b7ea4-660a-4963-8014-537f61e752bf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:00.489664 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0e1b7ea4-660a-4963-8014-537f61e752bf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:00.490480 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0e1b7ea4-660a-4963-8014-537f61e752bf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:00.490923 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0e1b7ea4-660a-4963-8014-537f61e752bf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:00.555652 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-0e1b7ea4-660a-4963-8014-537f61e752bf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:00.563171 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-0e1b7ea4-660a-4963-8014-537f61e752bf tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.084628 Mar 08 15:03:00.563745 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 988/1955] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:00 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:03:00.604671 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-ff5e472c-8ac0-459d-96b7-a5e7883224ba tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:00.611902 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-ff5e472c-8ac0-459d-96b7-a5e7883224ba tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.158672 Mar 08 15:03:00.612468 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 968/1956] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:00 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:03:00.639339 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b62feafd-5077-4c76-8918-7572d41b5625 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:00.640278 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b62feafd-5077-4c76-8918-7572d41b5625 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:00.646098 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b62feafd-5077-4c76-8918-7572d41b5625 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:00.646547 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b62feafd-5077-4c76-8918-7572d41b5625 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:00.647311 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b62feafd-5077-4c76-8918-7572d41b5625 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:00.647744 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b62feafd-5077-4c76-8918-7572d41b5625 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:00.675251 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b62feafd-5077-4c76-8918-7572d41b5625 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039817 Mar 08 15:03:00.675783 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 989/1957] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:03:00 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:03:00.931074 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 15:03:00.931292 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: Tue Mar 8 15:03:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 15:03:01.580370 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-40576a1a-007e-4dc2-8594-1a7c36ecc824 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:01.580984 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-40576a1a-007e-4dc2-8594-1a7c36ecc824 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:01.588373 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-40576a1a-007e-4dc2-8594-1a7c36ecc824 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:01.588830 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-40576a1a-007e-4dc2-8594-1a7c36ecc824 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:01.589601 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-40576a1a-007e-4dc2-8594-1a7c36ecc824 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:01.590080 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-40576a1a-007e-4dc2-8594-1a7c36ecc824 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:01.628353 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-2e30261f-97ab-4149-bd82-31fced503da3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:01.628959 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-2e30261f-97ab-4149-bd82-31fced503da3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:01.636302 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2e30261f-97ab-4149-bd82-31fced503da3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:01.636685 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2e30261f-97ab-4149-bd82-31fced503da3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:01.637455 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2e30261f-97ab-4149-bd82-31fced503da3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:01.637912 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2e30261f-97ab-4149-bd82-31fced503da3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:01.650373 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-40576a1a-007e-4dc2-8594-1a7c36ecc824 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:01.657774 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-40576a1a-007e-4dc2-8594-1a7c36ecc824 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081244 Mar 08 15:03:01.658538 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 969/1958] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:01 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:03:01.686745 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-918f245b-afe4-41f1-bd74-7d4655908920 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:01.687653 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-918f245b-afe4-41f1-bd74-7d4655908920 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:01.693528 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-918f245b-afe4-41f1-bd74-7d4655908920 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:01.694004 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-918f245b-afe4-41f1-bd74-7d4655908920 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:01.694772 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-918f245b-afe4-41f1-bd74-7d4655908920 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:01.695206 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-918f245b-afe4-41f1-bd74-7d4655908920 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:01.723143 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-918f245b-afe4-41f1-bd74-7d4655908920 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040219 Mar 08 15:03:01.723703 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 970/1959] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:03:01 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 15:03:01.772826 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-2e30261f-97ab-4149-bd82-31fced503da3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:01.780151 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-2e30261f-97ab-4149-bd82-31fced503da3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.155649 Mar 08 15:03:01.780717 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 990/1960] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:01 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:03:02.675489 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-ba27f835-3d4c-4aa5-bacc-09cf9f278eb4 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:02.676096 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-ba27f835-3d4c-4aa5-bacc-09cf9f278eb4 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:02.682674 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ba27f835-3d4c-4aa5-bacc-09cf9f278eb4 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:02.683130 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ba27f835-3d4c-4aa5-bacc-09cf9f278eb4 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:02.683889 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ba27f835-3d4c-4aa5-bacc-09cf9f278eb4 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:02.684323 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ba27f835-3d4c-4aa5-bacc-09cf9f278eb4 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:02.734816 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-732a7d5d-4dd2-47d6-aae6-a9d5454e6d10 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:02.735736 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-732a7d5d-4dd2-47d6-aae6-a9d5454e6d10 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:02.742042 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-732a7d5d-4dd2-47d6-aae6-a9d5454e6d10 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:02.742652 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-732a7d5d-4dd2-47d6-aae6-a9d5454e6d10 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:02.743003 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-ba27f835-3d4c-4aa5-bacc-09cf9f278eb4 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:02.743429 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-732a7d5d-4dd2-47d6-aae6-a9d5454e6d10 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:02.743866 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-732a7d5d-4dd2-47d6-aae6-a9d5454e6d10 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:02.750488 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-ba27f835-3d4c-4aa5-bacc-09cf9f278eb4 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078840 Mar 08 15:03:02.751054 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 971/1961] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:02 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:03:02.771159 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-732a7d5d-4dd2-47d6-aae6-a9d5454e6d10 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040290 Mar 08 15:03:02.771692 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 991/1962] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:03:02 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 15:03:02.796255 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-77b2e331-fcc1-477f-9259-3e78f11ac0b2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:02.796875 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-77b2e331-fcc1-477f-9259-3e78f11ac0b2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:02.802993 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-77b2e331-fcc1-477f-9259-3e78f11ac0b2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:02.803452 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-77b2e331-fcc1-477f-9259-3e78f11ac0b2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:02.804224 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-77b2e331-fcc1-477f-9259-3e78f11ac0b2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:02.804671 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-77b2e331-fcc1-477f-9259-3e78f11ac0b2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:02.938203 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-77b2e331-fcc1-477f-9259-3e78f11ac0b2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:02.946034 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-77b2e331-fcc1-477f-9259-3e78f11ac0b2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.153005 Mar 08 15:03:02.946702 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 972/1963] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:02 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:03:03.767209 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-7a881535-2c11-4b45-8377-7555cd637450 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:03.767913 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-7a881535-2c11-4b45-8377-7555cd637450 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:03.774804 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7a881535-2c11-4b45-8377-7555cd637450 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:03.775265 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7a881535-2c11-4b45-8377-7555cd637450 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:03.776036 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7a881535-2c11-4b45-8377-7555cd637450 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:03.776476 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7a881535-2c11-4b45-8377-7555cd637450 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:03.783284 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-5fa94fb2-a2f9-4ad9-afa4-a66ba2d18695 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:03.784321 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-5fa94fb2-a2f9-4ad9-afa4-a66ba2d18695 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:03.791276 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5fa94fb2-a2f9-4ad9-afa4-a66ba2d18695 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:03.792298 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5fa94fb2-a2f9-4ad9-afa4-a66ba2d18695 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:03.792519 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5fa94fb2-a2f9-4ad9-afa4-a66ba2d18695 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:03.792964 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5fa94fb2-a2f9-4ad9-afa4-a66ba2d18695 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:03.822150 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-5fa94fb2-a2f9-4ad9-afa4-a66ba2d18695 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042754 Mar 08 15:03:03.822732 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 973/1964] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:03:03 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 15:03:03.837594 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-7a881535-2c11-4b45-8377-7555cd637450 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:03.844905 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-7a881535-2c11-4b45-8377-7555cd637450 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081575 Mar 08 15:03:03.845466 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 992/1965] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:03 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:03:03.963524 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-3793f71b-672f-4ac1-b2e2-804a037b6aa8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:03.964141 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-3793f71b-672f-4ac1-b2e2-804a037b6aa8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:03.970078 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3793f71b-672f-4ac1-b2e2-804a037b6aa8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:03.970533 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3793f71b-672f-4ac1-b2e2-804a037b6aa8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:03.971305 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3793f71b-672f-4ac1-b2e2-804a037b6aa8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:03.971857 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3793f71b-672f-4ac1-b2e2-804a037b6aa8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:04.105742 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-3793f71b-672f-4ac1-b2e2-804a037b6aa8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:04.113013 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-3793f71b-672f-4ac1-b2e2-804a037b6aa8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.154004 Mar 08 15:03:04.113574 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 974/1966] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:03 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:03:04.833662 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c4a6316d-1d95-4662-a7bd-bffa82148f6a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:04.834596 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-c4a6316d-1d95-4662-a7bd-bffa82148f6a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:04.840897 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c4a6316d-1d95-4662-a7bd-bffa82148f6a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:04.841344 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c4a6316d-1d95-4662-a7bd-bffa82148f6a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:04.842133 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c4a6316d-1d95-4662-a7bd-bffa82148f6a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:04.842572 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c4a6316d-1d95-4662-a7bd-bffa82148f6a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:04.862372 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-9ff62cd1-4623-41cb-884e-75815494c838 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:04.863006 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-9ff62cd1-4623-41cb-884e-75815494c838 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:04.869701 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9ff62cd1-4623-41cb-884e-75815494c838 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:04.869992 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-c4a6316d-1d95-4662-a7bd-bffa82148f6a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040277 Mar 08 15:03:04.870177 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9ff62cd1-4623-41cb-884e-75815494c838 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:04.870543 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 993/1967] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:03:04 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:03:04.870944 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9ff62cd1-4623-41cb-884e-75815494c838 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:04.871381 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9ff62cd1-4623-41cb-884e-75815494c838 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:04.931631 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-9ff62cd1-4623-41cb-884e-75815494c838 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:04.938991 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-9ff62cd1-4623-41cb-884e-75815494c838 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080374 Mar 08 15:03:04.939547 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 975/1968] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:04 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:03:05.130179 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-09438310-6eac-4e88-935b-3a0fea64d362 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:05.130751 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-09438310-6eac-4e88-935b-3a0fea64d362 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:05.137085 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-09438310-6eac-4e88-935b-3a0fea64d362 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:05.137535 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-09438310-6eac-4e88-935b-3a0fea64d362 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:05.138332 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-09438310-6eac-4e88-935b-3a0fea64d362 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:05.138763 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-09438310-6eac-4e88-935b-3a0fea64d362 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:05.276029 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-09438310-6eac-4e88-935b-3a0fea64d362 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:05.283179 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-09438310-6eac-4e88-935b-3a0fea64d362 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.157053 Mar 08 15:03:05.283735 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 994/1969] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:05 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:03:05.881380 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-91c1941f-bcf9-4ca8-8eb1-79b02d4165d9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:05.882312 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-91c1941f-bcf9-4ca8-8eb1-79b02d4165d9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:05.888617 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-91c1941f-bcf9-4ca8-8eb1-79b02d4165d9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:05.889008 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-91c1941f-bcf9-4ca8-8eb1-79b02d4165d9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:05.889766 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-91c1941f-bcf9-4ca8-8eb1-79b02d4165d9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:05.890268 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-91c1941f-bcf9-4ca8-8eb1-79b02d4165d9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:05.917406 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-91c1941f-bcf9-4ca8-8eb1-79b02d4165d9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040006 Mar 08 15:03:05.917955 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 976/1970] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:03:05 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:03:05.956427 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-81b86374-c2c2-46f8-bdae-b7c2ea6778b7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:05.957045 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-81b86374-c2c2-46f8-bdae-b7c2ea6778b7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:05.963759 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-81b86374-c2c2-46f8-bdae-b7c2ea6778b7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:05.964219 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-81b86374-c2c2-46f8-bdae-b7c2ea6778b7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:05.964995 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-81b86374-c2c2-46f8-bdae-b7c2ea6778b7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:05.965440 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-81b86374-c2c2-46f8-bdae-b7c2ea6778b7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:06.024183 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-81b86374-c2c2-46f8-bdae-b7c2ea6778b7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:06.031492 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-81b86374-c2c2-46f8-bdae-b7c2ea6778b7 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078974 Mar 08 15:03:06.032057 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 995/1971] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:05 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:03:06.299529 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-a0bc93ff-6474-4621-a680-2970168287ad tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:06.300152 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-a0bc93ff-6474-4621-a680-2970168287ad tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:06.306853 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a0bc93ff-6474-4621-a680-2970168287ad tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:06.307313 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a0bc93ff-6474-4621-a680-2970168287ad tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:06.308085 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a0bc93ff-6474-4621-a680-2970168287ad tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:06.308529 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a0bc93ff-6474-4621-a680-2970168287ad tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:06.443856 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-a0bc93ff-6474-4621-a680-2970168287ad tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:06.452295 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-a0bc93ff-6474-4621-a680-2970168287ad tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.156637 Mar 08 15:03:06.452859 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 977/1972] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:06 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:03:06.929110 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-0c73174a-94d7-498e-b80e-02aa42aa5f87 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:06.930598 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-0c73174a-94d7-498e-b80e-02aa42aa5f87 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:06.936662 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0c73174a-94d7-498e-b80e-02aa42aa5f87 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:06.937108 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0c73174a-94d7-498e-b80e-02aa42aa5f87 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:06.937904 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0c73174a-94d7-498e-b80e-02aa42aa5f87 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:06.938338 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0c73174a-94d7-498e-b80e-02aa42aa5f87 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:06.966647 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-0c73174a-94d7-498e-b80e-02aa42aa5f87 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041738 Mar 08 15:03:06.967268 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 996/1973] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:03:06 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:03:07.048916 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b54ab818-e531-44ea-968c-07d4681d021d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:07.049523 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-b54ab818-e531-44ea-968c-07d4681d021d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:07.057288 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b54ab818-e531-44ea-968c-07d4681d021d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:07.057745 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b54ab818-e531-44ea-968c-07d4681d021d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:07.058541 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b54ab818-e531-44ea-968c-07d4681d021d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:07.058983 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b54ab818-e531-44ea-968c-07d4681d021d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:07.119132 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-b54ab818-e531-44ea-968c-07d4681d021d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:07.126347 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-b54ab818-e531-44ea-968c-07d4681d021d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081317 Mar 08 15:03:07.126909 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 978/1974] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:07 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:03:07.469729 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f07dec52-6241-4e7f-917f-d933cdde8940 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:07.470355 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f07dec52-6241-4e7f-917f-d933cdde8940 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:07.476276 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f07dec52-6241-4e7f-917f-d933cdde8940 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:07.477421 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f07dec52-6241-4e7f-917f-d933cdde8940 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:07.478214 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f07dec52-6241-4e7f-917f-d933cdde8940 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:07.478648 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f07dec52-6241-4e7f-917f-d933cdde8940 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:07.609256 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f07dec52-6241-4e7f-917f-d933cdde8940 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:07.616673 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f07dec52-6241-4e7f-917f-d933cdde8940 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.150746 Mar 08 15:03:07.617944 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 997/1975] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:07 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:03:07.978438 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-007e1f91-92de-4134-b321-393fc2f655c4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:07.979358 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-007e1f91-92de-4134-b321-393fc2f655c4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:07.985199 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-007e1f91-92de-4134-b321-393fc2f655c4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:07.985659 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-007e1f91-92de-4134-b321-393fc2f655c4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:07.986454 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-007e1f91-92de-4134-b321-393fc2f655c4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:07.986897 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-007e1f91-92de-4134-b321-393fc2f655c4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:08.015204 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-007e1f91-92de-4134-b321-393fc2f655c4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041614 Mar 08 15:03:08.015741 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 979/1976] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:03:07 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:03:08.143491 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d8583af5-3429-4163-b61e-e2d273cb2ecb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:08.144096 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d8583af5-3429-4163-b61e-e2d273cb2ecb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:08.150446 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d8583af5-3429-4163-b61e-e2d273cb2ecb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:08.150894 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d8583af5-3429-4163-b61e-e2d273cb2ecb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:08.151661 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d8583af5-3429-4163-b61e-e2d273cb2ecb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:08.152096 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d8583af5-3429-4163-b61e-e2d273cb2ecb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:08.216223 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d8583af5-3429-4163-b61e-e2d273cb2ecb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:08.223416 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d8583af5-3429-4163-b61e-e2d273cb2ecb tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.083779 Mar 08 15:03:08.223965 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 998/1977] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:08 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:03:08.635300 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-bf893244-2b50-471f-9246-e212b7e26cad tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:08.635919 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-bf893244-2b50-471f-9246-e212b7e26cad tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:08.642232 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bf893244-2b50-471f-9246-e212b7e26cad tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:08.642694 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bf893244-2b50-471f-9246-e212b7e26cad tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:08.643467 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bf893244-2b50-471f-9246-e212b7e26cad tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:08.643909 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bf893244-2b50-471f-9246-e212b7e26cad tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:08.779097 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-bf893244-2b50-471f-9246-e212b7e26cad tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:08.786447 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-bf893244-2b50-471f-9246-e212b7e26cad tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.155081 Mar 08 15:03:08.787011 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 980/1978] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:08 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:03:09.028272 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-e09fb510-4854-41b5-9754-117d18da0a29 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:09.029192 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-e09fb510-4854-41b5-9754-117d18da0a29 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:09.035116 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e09fb510-4854-41b5-9754-117d18da0a29 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:09.035564 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e09fb510-4854-41b5-9754-117d18da0a29 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:09.036328 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e09fb510-4854-41b5-9754-117d18da0a29 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:09.036757 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e09fb510-4854-41b5-9754-117d18da0a29 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:09.063758 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-e09fb510-4854-41b5-9754-117d18da0a29 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040788 Mar 08 15:03:09.064296 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 999/1979] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:03:09 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:03:09.243154 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-7060614b-d1cb-4e67-9b9d-569437dd1a67 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:09.244004 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-7060614b-d1cb-4e67-9b9d-569437dd1a67 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:09.249924 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7060614b-d1cb-4e67-9b9d-569437dd1a67 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:09.250383 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7060614b-d1cb-4e67-9b9d-569437dd1a67 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:09.251146 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7060614b-d1cb-4e67-9b9d-569437dd1a67 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:09.251584 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7060614b-d1cb-4e67-9b9d-569437dd1a67 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:09.313784 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-7060614b-d1cb-4e67-9b9d-569437dd1a67 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:09.321918 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-7060614b-d1cb-4e67-9b9d-569437dd1a67 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.083206 Mar 08 15:03:09.322487 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 981/1980] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:09 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:03:09.804490 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-00470ebf-eaa6-4c3c-8c0a-027e947b2e34 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:09.805836 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-00470ebf-eaa6-4c3c-8c0a-027e947b2e34 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:09.812803 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-00470ebf-eaa6-4c3c-8c0a-027e947b2e34 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:09.813251 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-00470ebf-eaa6-4c3c-8c0a-027e947b2e34 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:09.814169 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-00470ebf-eaa6-4c3c-8c0a-027e947b2e34 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:09.814607 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-00470ebf-eaa6-4c3c-8c0a-027e947b2e34 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:09.955294 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-00470ebf-eaa6-4c3c-8c0a-027e947b2e34 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:09.963626 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-00470ebf-eaa6-4c3c-8c0a-027e947b2e34 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.163182 Mar 08 15:03:09.964188 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1000/1981] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:09 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:03:10.076290 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-59b18c87-ba54-4353-ab3b-a570f3e1f1c2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:10.077232 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-59b18c87-ba54-4353-ab3b-a570f3e1f1c2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:10.083541 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-59b18c87-ba54-4353-ab3b-a570f3e1f1c2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:10.084008 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-59b18c87-ba54-4353-ab3b-a570f3e1f1c2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:10.084769 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-59b18c87-ba54-4353-ab3b-a570f3e1f1c2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:10.085211 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-59b18c87-ba54-4353-ab3b-a570f3e1f1c2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:10.120207 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-59b18c87-ba54-4353-ab3b-a570f3e1f1c2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047820 Mar 08 15:03:10.120769 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 982/1982] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:03:10 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:03:10.339051 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-77794d5f-c50e-42c0-ac75-e3976f266149 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:10.339664 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-77794d5f-c50e-42c0-ac75-e3976f266149 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:10.345562 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-77794d5f-c50e-42c0-ac75-e3976f266149 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:10.346063 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-77794d5f-c50e-42c0-ac75-e3976f266149 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:10.346835 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-77794d5f-c50e-42c0-ac75-e3976f266149 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:10.347273 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-77794d5f-c50e-42c0-ac75-e3976f266149 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:10.405595 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-77794d5f-c50e-42c0-ac75-e3976f266149 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:10.413012 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-77794d5f-c50e-42c0-ac75-e3976f266149 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078519 Mar 08 15:03:10.413618 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1001/1983] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:10 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:03:10.981153 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-61472101-d0ad-41d6-bae3-fc5606925af8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:10.981756 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-61472101-d0ad-41d6-bae3-fc5606925af8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:10.987618 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-61472101-d0ad-41d6-bae3-fc5606925af8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:10.988073 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-61472101-d0ad-41d6-bae3-fc5606925af8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:10.988829 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-61472101-d0ad-41d6-bae3-fc5606925af8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:10.989265 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-61472101-d0ad-41d6-bae3-fc5606925af8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:11.122662 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-61472101-d0ad-41d6-bae3-fc5606925af8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:11.129935 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-61472101-d0ad-41d6-bae3-fc5606925af8 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1566 microversion: 2.1 time: 0.153287 Mar 08 15:03:11.130499 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 983/1984] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:10 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:03:11.131657 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-7b71993e-9cae-4fcc-93a2-089073b2bcf7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:11.133255 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-7b71993e-9cae-4fcc-93a2-089073b2bcf7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:11.139724 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7b71993e-9cae-4fcc-93a2-089073b2bcf7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:11.140184 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7b71993e-9cae-4fcc-93a2-089073b2bcf7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:11.140967 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7b71993e-9cae-4fcc-93a2-089073b2bcf7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:11.141410 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7b71993e-9cae-4fcc-93a2-089073b2bcf7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:11.169924 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-7b71993e-9cae-4fcc-93a2-089073b2bcf7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042097 Mar 08 15:03:11.170497 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1002/1985] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:03:11 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 15:03:11.431312 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-7d546367-0f7e-44a2-b1ca-f52d5998a4ae tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:11.431916 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-7d546367-0f7e-44a2-b1ca-f52d5998a4ae tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:11.437598 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7d546367-0f7e-44a2-b1ca-f52d5998a4ae tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:11.438094 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7d546367-0f7e-44a2-b1ca-f52d5998a4ae tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:11.438855 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7d546367-0f7e-44a2-b1ca-f52d5998a4ae tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:11.439288 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7d546367-0f7e-44a2-b1ca-f52d5998a4ae tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:11.499450 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-7d546367-0f7e-44a2-b1ca-f52d5998a4ae tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:11.506605 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-7d546367-0f7e-44a2-b1ca-f52d5998a4ae tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080021 Mar 08 15:03:11.507164 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 984/1986] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:11 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:03:12.181804 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ec538b5e-88c2-496f-a31e-9cb7a67906e2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:12.182673 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ec538b5e-88c2-496f-a31e-9cb7a67906e2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:12.189195 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ec538b5e-88c2-496f-a31e-9cb7a67906e2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:12.189649 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ec538b5e-88c2-496f-a31e-9cb7a67906e2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:12.190452 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ec538b5e-88c2-496f-a31e-9cb7a67906e2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:12.190893 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ec538b5e-88c2-496f-a31e-9cb7a67906e2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:12.219668 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ec538b5e-88c2-496f-a31e-9cb7a67906e2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042132 Mar 08 15:03:12.219808 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1003/1987] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:03:12 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:03:12.271780 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-0fb0dc2f-7895-4698-a7b5-f3735b151776 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:12.272264 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-0fb0dc2f-7895-4698-a7b5-f3735b151776 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:12.280349 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0fb0dc2f-7895-4698-a7b5-f3735b151776 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:12.280878 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0fb0dc2f-7895-4698-a7b5-f3735b151776 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:12.281775 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0fb0dc2f-7895-4698-a7b5-f3735b151776 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:12.282295 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0fb0dc2f-7895-4698-a7b5-f3735b151776 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:12.309259 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-0fb0dc2f-7895-4698-a7b5-f3735b151776 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Going to try to terminate instance {{(pid=128351) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 15:03:12.332714 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [req-05b0124c-1c8b-4ed7-a6d2-2b5e1f695a48 req-3768c391-01af-4cf3-8e35-6cac30fe191b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c488812-68f5-41d9-9d25-7f0fb61125f5", "tag": "ab17bc28-ab3f-46b1-be9d-d202c3e9d04f"}]} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:03:12.342156 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-05b0124c-1c8b-4ed7-a6d2-2b5e1f695a48 req-3768c391-01af-4cf3-8e35-6cac30fe191b service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:12.342966 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-05b0124c-1c8b-4ed7-a6d2-2b5e1f695a48 req-3768c391-01af-4cf3-8e35-6cac30fe191b service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:12.356218 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.compute.server_external_events [req-05b0124c-1c8b-4ed7-a6d2-2b5e1f695a48 req-3768c391-01af-4cf3-8e35-6cac30fe191b service nova] Creating event network-changed:ab17bc28-ab3f-46b1-be9d-d202c3e9d04f for instance 1c488812-68f5-41d9-9d25-7f0fb61125f5 on hv-cinder-83009 Mar 08 15:03:12.363210 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [req-05b0124c-1c8b-4ed7-a6d2-2b5e1f695a48 req-3768c391-01af-4cf3-8e35-6cac30fe191b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092379 Mar 08 15:03:12.364105 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1004/1988] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 15:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 15:03:12.370618 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0fb0dc2f-7895-4698-a7b5-f3735b151776 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [191e1baa-5623-4958-a32e-7027860d8783] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 08 15:03:12.525753 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-402204d3-d840-41cd-9da2-82458cf79258 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:12.526527 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-402204d3-d840-41cd-9da2-82458cf79258 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:12.532551 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-402204d3-d840-41cd-9da2-82458cf79258 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:12.533010 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-402204d3-d840-41cd-9da2-82458cf79258 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:12.533791 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-402204d3-d840-41cd-9da2-82458cf79258 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:12.534253 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-402204d3-d840-41cd-9da2-82458cf79258 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:12.596993 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-402204d3-d840-41cd-9da2-82458cf79258 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:12.605314 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-402204d3-d840-41cd-9da2-82458cf79258 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.084856 Mar 08 15:03:12.606265 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1005/1989] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:12 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:03:13.231256 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-bc342bc6-bd35-4fe0-ab33-2abe0a799772 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:03:13.232121 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-bc342bc6-bd35-4fe0-ab33-2abe0a799772 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:13.238962 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bc342bc6-bd35-4fe0-ab33-2abe0a799772 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:13.239613 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bc342bc6-bd35-4fe0-ab33-2abe0a799772 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:13.240411 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bc342bc6-bd35-4fe0-ab33-2abe0a799772 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:13.241078 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bc342bc6-bd35-4fe0-ab33-2abe0a799772 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:13.344139 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-bc342bc6-bd35-4fe0-ab33-2abe0a799772 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "POST /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/action" status: 200 len: 84775 microversion: 2.1 time: 0.116980 Mar 08 15:03:13.345407 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1006/1990] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Mar 8 15:03:13 2022] POST /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/action => generated 84775 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 15:03:13.370229 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d27da657-244c-45d4-8481-d5c8d7bae5c6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:13.370850 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d27da657-244c-45d4-8481-d5c8d7bae5c6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:13.379432 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO oslo.messaging._drivers.impl_rabbit [None req-0fb0dc2f-7895-4698-a7b5-f3735b151776 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [191e1baa-5623-4958-a32e-7027860d8783] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 43966. Mar 08 15:03:13.383372 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d27da657-244c-45d4-8481-d5c8d7bae5c6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:13.383798 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d27da657-244c-45d4-8481-d5c8d7bae5c6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:13.385228 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d27da657-244c-45d4-8481-d5c8d7bae5c6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:13.385685 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d27da657-244c-45d4-8481-d5c8d7bae5c6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:13.409659 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-0fb0dc2f-7895-4698-a7b5-f3735b151776 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 204 len: 0 microversion: 2.1 time: 1.142090 Mar 08 15:03:13.410288 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 985/1991] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 15:03:12 2022] DELETE /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 0 bytes in 1144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 15:03:13.420714 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-d7c9b157-0c44-4c6a-b7fc-9213959265f5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:13.421589 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-d7c9b157-0c44-4c6a-b7fc-9213959265f5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:13.428783 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d7c9b157-0c44-4c6a-b7fc-9213959265f5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:13.429341 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d7c9b157-0c44-4c6a-b7fc-9213959265f5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:13.430638 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d7c9b157-0c44-4c6a-b7fc-9213959265f5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:13.431167 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d7c9b157-0c44-4c6a-b7fc-9213959265f5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:13.792666 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-d7c9b157-0c44-4c6a-b7fc-9213959265f5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:13.799945 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-d7c9b157-0c44-4c6a-b7fc-9213959265f5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.384425 Mar 08 15:03:13.800513 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 986/1992] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:13 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:03:13.805966 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-018741ce-5444-4756-b170-5665bac04fda tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:13.806571 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-018741ce-5444-4756-b170-5665bac04fda tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:13.812103 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-018741ce-5444-4756-b170-5665bac04fda tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:13.812552 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-018741ce-5444-4756-b170-5665bac04fda tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:13.813316 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-018741ce-5444-4756-b170-5665bac04fda tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:13.813752 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-018741ce-5444-4756-b170-5665bac04fda tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:13.875387 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-018741ce-5444-4756-b170-5665bac04fda tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:13.882866 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-018741ce-5444-4756-b170-5665bac04fda tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081351 Mar 08 15:03:13.883426 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 987/1993] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:13 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:03:14.817562 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-32d85271-ff3f-44b4-adf3-4cf0feeb5e8b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:14.818289 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-32d85271-ff3f-44b4-adf3-4cf0feeb5e8b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:14.825003 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-32d85271-ff3f-44b4-adf3-4cf0feeb5e8b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:14.825454 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-32d85271-ff3f-44b4-adf3-4cf0feeb5e8b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:14.826245 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-32d85271-ff3f-44b4-adf3-4cf0feeb5e8b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:14.826681 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-32d85271-ff3f-44b4-adf3-4cf0feeb5e8b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:14.960426 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-32d85271-ff3f-44b4-adf3-4cf0feeb5e8b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:14.968119 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-32d85271-ff3f-44b4-adf3-4cf0feeb5e8b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.154341 Mar 08 15:03:14.968692 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 988/1994] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:14 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:03:14.973016 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-cd4e47e9-2274-49b3-b227-756766597c3b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:14.973623 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-cd4e47e9-2274-49b3-b227-756766597c3b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:14.979070 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cd4e47e9-2274-49b3-b227-756766597c3b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:14.979516 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cd4e47e9-2274-49b3-b227-756766597c3b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:14.980280 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cd4e47e9-2274-49b3-b227-756766597c3b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:14.980716 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cd4e47e9-2274-49b3-b227-756766597c3b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:15.039023 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-cd4e47e9-2274-49b3-b227-756766597c3b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:15.046495 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-cd4e47e9-2274-49b3-b227-756766597c3b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.076872 Mar 08 15:03:15.047063 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 989/1995] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:14 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:03:15.985068 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-9a3c7a1a-bfb2-4872-b264-a946afe740e3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:15.985688 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-9a3c7a1a-bfb2-4872-b264-a946afe740e3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:15.991857 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9a3c7a1a-bfb2-4872-b264-a946afe740e3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:15.992306 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9a3c7a1a-bfb2-4872-b264-a946afe740e3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:15.993061 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9a3c7a1a-bfb2-4872-b264-a946afe740e3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:15.994317 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9a3c7a1a-bfb2-4872-b264-a946afe740e3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:16.132050 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-9a3c7a1a-bfb2-4872-b264-a946afe740e3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:16.139418 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-9a3c7a1a-bfb2-4872-b264-a946afe740e3 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.158199 Mar 08 15:03:16.140032 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 990/1996] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:15 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:03:16.144299 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-d96f2cd3-f664-452f-bc82-7bd7d3c38326 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:16.144892 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-d96f2cd3-f664-452f-bc82-7bd7d3c38326 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:16.151198 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d96f2cd3-f664-452f-bc82-7bd7d3c38326 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:16.151644 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d96f2cd3-f664-452f-bc82-7bd7d3c38326 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:16.152404 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d96f2cd3-f664-452f-bc82-7bd7d3c38326 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:16.152840 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d96f2cd3-f664-452f-bc82-7bd7d3c38326 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:16.219432 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-d96f2cd3-f664-452f-bc82-7bd7d3c38326 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:16.227115 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-d96f2cd3-f664-452f-bc82-7bd7d3c38326 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.086172 Mar 08 15:03:16.227685 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 991/1997] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:16 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:03:16.686612 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-3f089f41-5082-4ac0-b985-e86918033567 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:16.687106 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-3f089f41-5082-4ac0-b985-e86918033567 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:16.692838 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3f089f41-5082-4ac0-b985-e86918033567 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:16.693288 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3f089f41-5082-4ac0-b985-e86918033567 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:16.694080 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3f089f41-5082-4ac0-b985-e86918033567 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:16.694520 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3f089f41-5082-4ac0-b985-e86918033567 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:16.718252 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-3f089f41-5082-4ac0-b985-e86918033567 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Going to try to terminate instance {{(pid=128351) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 15:03:16.762376 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.compute.api [None req-3f089f41-5082-4ac0-b985-e86918033567 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Instance is already in deleting state, ignoring this request Mar 08 15:03:16.763179 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-3f089f41-5082-4ac0-b985-e86918033567 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 204 len: 0 microversion: 2.1 time: 0.080410 Mar 08 15:03:16.763733 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 992/1998] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 15:03:16 2022] DELETE /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 08 15:03:16.771310 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-3bdb493a-0794-420c-a913-06e1e99e8454 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:16.771910 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-3bdb493a-0794-420c-a913-06e1e99e8454 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:16.778127 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3bdb493a-0794-420c-a913-06e1e99e8454 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:16.778579 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3bdb493a-0794-420c-a913-06e1e99e8454 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:16.779343 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3bdb493a-0794-420c-a913-06e1e99e8454 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:16.779777 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3bdb493a-0794-420c-a913-06e1e99e8454 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:16.837942 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-3bdb493a-0794-420c-a913-06e1e99e8454 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:16.845407 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-3bdb493a-0794-420c-a913-06e1e99e8454 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.077564 Mar 08 15:03:16.845985 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 993/1999] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:16 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:03:17.156484 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-891302ce-02e4-4ec6-8360-efa5d6648794 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:17.157229 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-891302ce-02e4-4ec6-8360-efa5d6648794 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:17.163599 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-891302ce-02e4-4ec6-8360-efa5d6648794 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:17.164052 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-891302ce-02e4-4ec6-8360-efa5d6648794 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:17.164814 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-891302ce-02e4-4ec6-8360-efa5d6648794 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:17.165256 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-891302ce-02e4-4ec6-8360-efa5d6648794 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:17.300745 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-891302ce-02e4-4ec6-8360-efa5d6648794 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:17.309004 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-891302ce-02e4-4ec6-8360-efa5d6648794 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.156347 Mar 08 15:03:17.309561 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 994/2000] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:17 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:03:17.863092 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-f3aff8ae-c4dd-4e18-8bba-84fc42910c40 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:17.863840 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-f3aff8ae-c4dd-4e18-8bba-84fc42910c40 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:17.871436 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f3aff8ae-c4dd-4e18-8bba-84fc42910c40 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:17.871894 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f3aff8ae-c4dd-4e18-8bba-84fc42910c40 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:17.872668 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f3aff8ae-c4dd-4e18-8bba-84fc42910c40 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:17.873104 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f3aff8ae-c4dd-4e18-8bba-84fc42910c40 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:17.933122 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-f3aff8ae-c4dd-4e18-8bba-84fc42910c40 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:17.940578 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-f3aff8ae-c4dd-4e18-8bba-84fc42910c40 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081466 Mar 08 15:03:17.941028 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 995/2001] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:17 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:03:18.326523 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-ccd12356-fdb0-4225-9cdb-c0d149fb87fc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:18.327158 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-ccd12356-fdb0-4225-9cdb-c0d149fb87fc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:18.333299 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ccd12356-fdb0-4225-9cdb-c0d149fb87fc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:18.333754 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ccd12356-fdb0-4225-9cdb-c0d149fb87fc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:18.334551 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ccd12356-fdb0-4225-9cdb-c0d149fb87fc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:18.334990 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ccd12356-fdb0-4225-9cdb-c0d149fb87fc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:18.467357 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-ccd12356-fdb0-4225-9cdb-c0d149fb87fc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:18.474609 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-ccd12356-fdb0-4225-9cdb-c0d149fb87fc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.152497 Mar 08 15:03:18.475174 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 996/2002] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:18 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:03:18.957901 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-76c3945b-965a-4acd-8076-e5d0f3c790c0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:18.958542 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-76c3945b-965a-4acd-8076-e5d0f3c790c0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:18.964513 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-76c3945b-965a-4acd-8076-e5d0f3c790c0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:18.964966 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-76c3945b-965a-4acd-8076-e5d0f3c790c0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:18.965734 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-76c3945b-965a-4acd-8076-e5d0f3c790c0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:18.966210 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-76c3945b-965a-4acd-8076-e5d0f3c790c0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:19.027837 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-76c3945b-965a-4acd-8076-e5d0f3c790c0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:19.035083 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-76c3945b-965a-4acd-8076-e5d0f3c790c0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081070 Mar 08 15:03:19.035643 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 997/2003] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:18 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:03:19.491884 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-8d36a752-be29-46ac-bc6f-3ca53b54b82b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:19.492642 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-8d36a752-be29-46ac-bc6f-3ca53b54b82b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:19.499318 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8d36a752-be29-46ac-bc6f-3ca53b54b82b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:19.499770 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8d36a752-be29-46ac-bc6f-3ca53b54b82b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:19.500533 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8d36a752-be29-46ac-bc6f-3ca53b54b82b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:19.500968 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8d36a752-be29-46ac-bc6f-3ca53b54b82b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:19.634298 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-8d36a752-be29-46ac-bc6f-3ca53b54b82b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:19.642390 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-8d36a752-be29-46ac-bc6f-3ca53b54b82b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.154282 Mar 08 15:03:19.643116 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 998/2004] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:19 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:03:20.051873 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-afb290e0-3905-4761-8bb7-0f8d479f3221 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:20.052514 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-afb290e0-3905-4761-8bb7-0f8d479f3221 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:20.058811 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-afb290e0-3905-4761-8bb7-0f8d479f3221 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:20.059265 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-afb290e0-3905-4761-8bb7-0f8d479f3221 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:20.060031 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-afb290e0-3905-4761-8bb7-0f8d479f3221 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:20.060470 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-afb290e0-3905-4761-8bb7-0f8d479f3221 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:20.121546 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-afb290e0-3905-4761-8bb7-0f8d479f3221 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:20.128861 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-afb290e0-3905-4761-8bb7-0f8d479f3221 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081180 Mar 08 15:03:20.129458 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 999/2005] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:20 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:03:20.659612 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-0d83c872-a55f-4a14-83b8-7cd7cc70d4df tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:20.660308 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-0d83c872-a55f-4a14-83b8-7cd7cc70d4df tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:20.666397 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0d83c872-a55f-4a14-83b8-7cd7cc70d4df tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:20.667361 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0d83c872-a55f-4a14-83b8-7cd7cc70d4df tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:20.668210 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0d83c872-a55f-4a14-83b8-7cd7cc70d4df tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:20.668646 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0d83c872-a55f-4a14-83b8-7cd7cc70d4df tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:20.806460 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-0d83c872-a55f-4a14-83b8-7cd7cc70d4df tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:20.813706 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-0d83c872-a55f-4a14-83b8-7cd7cc70d4df tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.157934 Mar 08 15:03:20.814320 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1000/2006] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:20 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:03:21.146288 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-cfb71532-2ef9-4e87-93d2-850df292cd88 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:21.146905 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-cfb71532-2ef9-4e87-93d2-850df292cd88 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:21.153500 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cfb71532-2ef9-4e87-93d2-850df292cd88 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:21.153982 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cfb71532-2ef9-4e87-93d2-850df292cd88 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:21.154758 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cfb71532-2ef9-4e87-93d2-850df292cd88 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:21.155200 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cfb71532-2ef9-4e87-93d2-850df292cd88 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:21.213137 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-cfb71532-2ef9-4e87-93d2-850df292cd88 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:21.221197 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-cfb71532-2ef9-4e87-93d2-850df292cd88 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078711 Mar 08 15:03:21.221763 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1001/2007] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:21 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:03:21.830387 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-c9342501-532f-40f8-a283-cec89bd2fe81 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:21.831013 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-c9342501-532f-40f8-a283-cec89bd2fe81 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:21.837372 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c9342501-532f-40f8-a283-cec89bd2fe81 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:21.837829 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c9342501-532f-40f8-a283-cec89bd2fe81 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:21.838839 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c9342501-532f-40f8-a283-cec89bd2fe81 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:21.839397 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c9342501-532f-40f8-a283-cec89bd2fe81 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:21.972195 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-c9342501-532f-40f8-a283-cec89bd2fe81 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:21.979909 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-c9342501-532f-40f8-a283-cec89bd2fe81 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.153343 Mar 08 15:03:21.980456 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1002/2008] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:21 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:03:22.238240 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-3d4fa84a-e425-4430-9eb9-ee8b087c0966 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:22.238848 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-3d4fa84a-e425-4430-9eb9-ee8b087c0966 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:22.245236 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3d4fa84a-e425-4430-9eb9-ee8b087c0966 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:22.245807 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3d4fa84a-e425-4430-9eb9-ee8b087c0966 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:22.246604 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3d4fa84a-e425-4430-9eb9-ee8b087c0966 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:22.247045 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3d4fa84a-e425-4430-9eb9-ee8b087c0966 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:22.316813 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-3d4fa84a-e425-4430-9eb9-ee8b087c0966 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:22.324108 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-3d4fa84a-e425-4430-9eb9-ee8b087c0966 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.089738 Mar 08 15:03:22.324669 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1003/2009] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:22 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:03:22.997534 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-9715894a-69c9-4454-a4ab-7969a17d72ed tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:22.998184 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-9715894a-69c9-4454-a4ab-7969a17d72ed tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:23.004445 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9715894a-69c9-4454-a4ab-7969a17d72ed tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:23.004899 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9715894a-69c9-4454-a4ab-7969a17d72ed tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:23.005669 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9715894a-69c9-4454-a4ab-7969a17d72ed tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:23.006135 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9715894a-69c9-4454-a4ab-7969a17d72ed tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:23.138676 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-9715894a-69c9-4454-a4ab-7969a17d72ed tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:23.145869 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-9715894a-69c9-4454-a4ab-7969a17d72ed tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.153166 Mar 08 15:03:23.146437 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1004/2010] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:22 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:03:23.341054 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-6276df5e-3a88-4940-9cd8-db0e1ae4b330 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:23.341669 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-6276df5e-3a88-4940-9cd8-db0e1ae4b330 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:23.347793 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6276df5e-3a88-4940-9cd8-db0e1ae4b330 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:23.348283 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6276df5e-3a88-4940-9cd8-db0e1ae4b330 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:23.349096 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6276df5e-3a88-4940-9cd8-db0e1ae4b330 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:23.349539 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6276df5e-3a88-4940-9cd8-db0e1ae4b330 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:23.409127 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-6276df5e-3a88-4940-9cd8-db0e1ae4b330 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:23.416458 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-6276df5e-3a88-4940-9cd8-db0e1ae4b330 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079910 Mar 08 15:03:23.417047 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1005/2011] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:23 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:03:24.163185 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-33a33fb0-8e68-4ffb-bce7-32a1d3f8a4db tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:24.163860 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-33a33fb0-8e68-4ffb-bce7-32a1d3f8a4db tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:24.170971 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-33a33fb0-8e68-4ffb-bce7-32a1d3f8a4db tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:24.171421 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-33a33fb0-8e68-4ffb-bce7-32a1d3f8a4db tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:24.172180 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-33a33fb0-8e68-4ffb-bce7-32a1d3f8a4db tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:24.172619 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-33a33fb0-8e68-4ffb-bce7-32a1d3f8a4db tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:24.316041 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-33a33fb0-8e68-4ffb-bce7-32a1d3f8a4db tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:24.323612 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-33a33fb0-8e68-4ffb-bce7-32a1d3f8a4db tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.164280 Mar 08 15:03:24.324190 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1006/2012] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:24 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:03:24.433727 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b3c2a2d3-0602-40ac-8cd0-cd519043beed tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:24.434361 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-b3c2a2d3-0602-40ac-8cd0-cd519043beed tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:24.440141 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b3c2a2d3-0602-40ac-8cd0-cd519043beed tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:24.440599 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b3c2a2d3-0602-40ac-8cd0-cd519043beed tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:24.441372 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b3c2a2d3-0602-40ac-8cd0-cd519043beed tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:24.441815 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b3c2a2d3-0602-40ac-8cd0-cd519043beed tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:24.503185 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-b3c2a2d3-0602-40ac-8cd0-cd519043beed tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:24.510689 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-b3c2a2d3-0602-40ac-8cd0-cd519043beed tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081262 Mar 08 15:03:24.511329 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1007/2013] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:24 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:03:25.340743 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-939d2e6b-0d11-421a-bca9-ec0a07dfff32 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:25.341399 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-939d2e6b-0d11-421a-bca9-ec0a07dfff32 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:25.347775 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-939d2e6b-0d11-421a-bca9-ec0a07dfff32 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:25.348232 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-939d2e6b-0d11-421a-bca9-ec0a07dfff32 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:25.349004 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-939d2e6b-0d11-421a-bca9-ec0a07dfff32 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:25.349446 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-939d2e6b-0d11-421a-bca9-ec0a07dfff32 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:25.482973 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-939d2e6b-0d11-421a-bca9-ec0a07dfff32 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:25.490293 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-939d2e6b-0d11-421a-bca9-ec0a07dfff32 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.153595 Mar 08 15:03:25.490860 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1008/2014] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:25 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:03:25.527129 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-8bc186ab-f13c-4a39-9a7c-32759a0ce229 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:25.527730 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-8bc186ab-f13c-4a39-9a7c-32759a0ce229 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:25.533205 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8bc186ab-f13c-4a39-9a7c-32759a0ce229 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:25.533652 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8bc186ab-f13c-4a39-9a7c-32759a0ce229 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:25.534443 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8bc186ab-f13c-4a39-9a7c-32759a0ce229 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:25.534878 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8bc186ab-f13c-4a39-9a7c-32759a0ce229 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:25.592990 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-8bc186ab-f13c-4a39-9a7c-32759a0ce229 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:25.600098 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-8bc186ab-f13c-4a39-9a7c-32759a0ce229 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.076629 Mar 08 15:03:25.600647 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1009/2015] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:25 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:03:26.507426 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-8623831b-8ec8-4435-95fa-98b71423c01d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:26.508111 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-8623831b-8ec8-4435-95fa-98b71423c01d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:26.514804 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8623831b-8ec8-4435-95fa-98b71423c01d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:26.515255 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8623831b-8ec8-4435-95fa-98b71423c01d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:26.516014 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8623831b-8ec8-4435-95fa-98b71423c01d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:26.516445 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8623831b-8ec8-4435-95fa-98b71423c01d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:26.652492 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-8623831b-8ec8-4435-95fa-98b71423c01d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:26.659860 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-8623831b-8ec8-4435-95fa-98b71423c01d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.156251 Mar 08 15:03:26.660430 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1010/2016] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:26 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:03:26.664825 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b752f180-10c5-4327-a9ea-434fb0ded21e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:26.665430 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-b752f180-10c5-4327-a9ea-434fb0ded21e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:26.670935 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b752f180-10c5-4327-a9ea-434fb0ded21e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:26.671396 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b752f180-10c5-4327-a9ea-434fb0ded21e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:26.672165 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b752f180-10c5-4327-a9ea-434fb0ded21e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:26.672607 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b752f180-10c5-4327-a9ea-434fb0ded21e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:26.731572 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-b752f180-10c5-4327-a9ea-434fb0ded21e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:26.738806 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-b752f180-10c5-4327-a9ea-434fb0ded21e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.077382 Mar 08 15:03:26.739368 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1011/2017] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:26 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:03:27.676809 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-6a4e5ff7-c07f-422a-b8c3-54c44edf9cf5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:27.677452 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-6a4e5ff7-c07f-422a-b8c3-54c44edf9cf5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:27.684274 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6a4e5ff7-c07f-422a-b8c3-54c44edf9cf5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:27.684729 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6a4e5ff7-c07f-422a-b8c3-54c44edf9cf5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:27.685494 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6a4e5ff7-c07f-422a-b8c3-54c44edf9cf5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:27.685945 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6a4e5ff7-c07f-422a-b8c3-54c44edf9cf5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:27.821822 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-6a4e5ff7-c07f-422a-b8c3-54c44edf9cf5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:27.830196 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-6a4e5ff7-c07f-422a-b8c3-54c44edf9cf5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.157512 Mar 08 15:03:27.830757 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1012/2018] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:27 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:03:27.835086 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-8250c7b8-3b3c-45c7-96e3-57ba4c001d13 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:27.835686 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-8250c7b8-3b3c-45c7-96e3-57ba4c001d13 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:27.841093 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8250c7b8-3b3c-45c7-96e3-57ba4c001d13 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:27.841540 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8250c7b8-3b3c-45c7-96e3-57ba4c001d13 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:27.842331 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8250c7b8-3b3c-45c7-96e3-57ba4c001d13 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:27.842775 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8250c7b8-3b3c-45c7-96e3-57ba4c001d13 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:27.902001 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-8250c7b8-3b3c-45c7-96e3-57ba4c001d13 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:27.909218 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-8250c7b8-3b3c-45c7-96e3-57ba4c001d13 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.077503 Mar 08 15:03:27.909782 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1013/2019] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:27 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:03:28.847094 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-d9954dd7-f791-479a-aa2e-8ee9564eb095 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:28.847769 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-d9954dd7-f791-479a-aa2e-8ee9564eb095 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:28.853830 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d9954dd7-f791-479a-aa2e-8ee9564eb095 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:28.854306 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d9954dd7-f791-479a-aa2e-8ee9564eb095 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:28.855203 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d9954dd7-f791-479a-aa2e-8ee9564eb095 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:28.855595 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d9954dd7-f791-479a-aa2e-8ee9564eb095 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:28.988021 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-d9954dd7-f791-479a-aa2e-8ee9564eb095 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:28.995252 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-d9954dd7-f791-479a-aa2e-8ee9564eb095 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.152036 Mar 08 15:03:28.996356 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1014/2020] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:28 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:03:29.000678 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-236c7955-9711-4f04-8718-0e28bdc321bc tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:29.001270 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-236c7955-9711-4f04-8718-0e28bdc321bc tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:29.006702 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-236c7955-9711-4f04-8718-0e28bdc321bc tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:29.007149 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-236c7955-9711-4f04-8718-0e28bdc321bc tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:29.007906 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-236c7955-9711-4f04-8718-0e28bdc321bc tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:29.008341 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-236c7955-9711-4f04-8718-0e28bdc321bc tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:29.067497 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-236c7955-9711-4f04-8718-0e28bdc321bc tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:29.075335 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-236c7955-9711-4f04-8718-0e28bdc321bc tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078051 Mar 08 15:03:29.075908 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1015/2021] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:28 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:03:30.013513 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-13ac615b-1b1a-4574-a539-658714e03c45 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:30.014151 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-13ac615b-1b1a-4574-a539-658714e03c45 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:30.020411 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-13ac615b-1b1a-4574-a539-658714e03c45 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:30.020869 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-13ac615b-1b1a-4574-a539-658714e03c45 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:30.021635 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-13ac615b-1b1a-4574-a539-658714e03c45 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:30.022105 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-13ac615b-1b1a-4574-a539-658714e03c45 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:30.161487 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-13ac615b-1b1a-4574-a539-658714e03c45 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:30.169145 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-13ac615b-1b1a-4574-a539-658714e03c45 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.159989 Mar 08 15:03:30.169724 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1016/2022] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:30 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:03:30.174074 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b3e28c19-54ab-4c97-8db1-e4452f8f3e30 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:30.174672 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-b3e28c19-54ab-4c97-8db1-e4452f8f3e30 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:30.180304 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b3e28c19-54ab-4c97-8db1-e4452f8f3e30 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:30.180752 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b3e28c19-54ab-4c97-8db1-e4452f8f3e30 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:30.181525 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b3e28c19-54ab-4c97-8db1-e4452f8f3e30 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:30.181994 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b3e28c19-54ab-4c97-8db1-e4452f8f3e30 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:30.240557 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-b3e28c19-54ab-4c97-8db1-e4452f8f3e30 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:30.247743 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-b3e28c19-54ab-4c97-8db1-e4452f8f3e30 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.077072 Mar 08 15:03:30.248296 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1017/2023] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:30 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:03:31.186150 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-697d9dd4-2cc0-4fd6-b51b-9c578cb8c719 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:31.186803 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-697d9dd4-2cc0-4fd6-b51b-9c578cb8c719 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:31.192999 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-697d9dd4-2cc0-4fd6-b51b-9c578cb8c719 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:31.193401 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-697d9dd4-2cc0-4fd6-b51b-9c578cb8c719 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:31.194180 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-697d9dd4-2cc0-4fd6-b51b-9c578cb8c719 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:31.194614 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-697d9dd4-2cc0-4fd6-b51b-9c578cb8c719 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:31.328728 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-697d9dd4-2cc0-4fd6-b51b-9c578cb8c719 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:31.336030 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-697d9dd4-2cc0-4fd6-b51b-9c578cb8c719 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.154415 Mar 08 15:03:31.336592 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1018/2024] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:31 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:03:31.341560 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-23dc0118-32f8-4a49-959b-6a4417b36d85 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:31.342198 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-23dc0118-32f8-4a49-959b-6a4417b36d85 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:31.347682 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-23dc0118-32f8-4a49-959b-6a4417b36d85 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:31.348141 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-23dc0118-32f8-4a49-959b-6a4417b36d85 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:31.348910 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-23dc0118-32f8-4a49-959b-6a4417b36d85 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:31.349359 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-23dc0118-32f8-4a49-959b-6a4417b36d85 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:31.411439 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-23dc0118-32f8-4a49-959b-6a4417b36d85 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:31.419421 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-23dc0118-32f8-4a49-959b-6a4417b36d85 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081883 Mar 08 15:03:31.419976 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1019/2025] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:31 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:03:32.354059 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-a72ac66a-4210-4349-a9dc-0f27e5edafc9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:32.354730 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-a72ac66a-4210-4349-a9dc-0f27e5edafc9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:32.360916 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a72ac66a-4210-4349-a9dc-0f27e5edafc9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:32.361397 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a72ac66a-4210-4349-a9dc-0f27e5edafc9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:32.362212 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a72ac66a-4210-4349-a9dc-0f27e5edafc9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:32.362657 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a72ac66a-4210-4349-a9dc-0f27e5edafc9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:32.496837 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-a72ac66a-4210-4349-a9dc-0f27e5edafc9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:32.504085 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-a72ac66a-4210-4349-a9dc-0f27e5edafc9 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.153975 Mar 08 15:03:32.504648 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1020/2026] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:32 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:03:32.508951 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-c49dc325-c4ec-4fb4-a9a2-8e7b9e280bc8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:32.509553 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-c49dc325-c4ec-4fb4-a9a2-8e7b9e280bc8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:32.515404 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c49dc325-c4ec-4fb4-a9a2-8e7b9e280bc8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:32.515866 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c49dc325-c4ec-4fb4-a9a2-8e7b9e280bc8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:32.516630 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c49dc325-c4ec-4fb4-a9a2-8e7b9e280bc8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:32.517071 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c49dc325-c4ec-4fb4-a9a2-8e7b9e280bc8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:32.576167 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-c49dc325-c4ec-4fb4-a9a2-8e7b9e280bc8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:32.583272 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-c49dc325-c4ec-4fb4-a9a2-8e7b9e280bc8 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.077689 Mar 08 15:03:32.583834 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1021/2027] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:32 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:03:33.521227 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-46e3e9c2-a3af-4abf-b7da-78417b4bd1aa tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:33.521939 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-46e3e9c2-a3af-4abf-b7da-78417b4bd1aa tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:33.528034 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-46e3e9c2-a3af-4abf-b7da-78417b4bd1aa tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:33.528481 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-46e3e9c2-a3af-4abf-b7da-78417b4bd1aa tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:33.529248 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-46e3e9c2-a3af-4abf-b7da-78417b4bd1aa tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:33.529681 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-46e3e9c2-a3af-4abf-b7da-78417b4bd1aa tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:33.667926 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-46e3e9c2-a3af-4abf-b7da-78417b4bd1aa tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:33.675381 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-46e3e9c2-a3af-4abf-b7da-78417b4bd1aa tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.158042 Mar 08 15:03:33.675943 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1022/2028] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:33 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:03:33.680526 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-1eb7ce0a-241e-4bcc-8419-903dbec5a30b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:33.681166 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-1eb7ce0a-241e-4bcc-8419-903dbec5a30b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:33.687223 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1eb7ce0a-241e-4bcc-8419-903dbec5a30b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:33.687681 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1eb7ce0a-241e-4bcc-8419-903dbec5a30b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:33.688502 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1eb7ce0a-241e-4bcc-8419-903dbec5a30b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:33.688897 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1eb7ce0a-241e-4bcc-8419-903dbec5a30b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:33.748630 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-1eb7ce0a-241e-4bcc-8419-903dbec5a30b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:33.755935 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-1eb7ce0a-241e-4bcc-8419-903dbec5a30b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078801 Mar 08 15:03:33.756496 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1023/2029] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:33 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:03:34.692530 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-9379c2a9-8d97-45dd-a0a2-b7c049e76618 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:34.693209 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-9379c2a9-8d97-45dd-a0a2-b7c049e76618 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:34.699454 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9379c2a9-8d97-45dd-a0a2-b7c049e76618 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:34.699904 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9379c2a9-8d97-45dd-a0a2-b7c049e76618 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:34.700673 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9379c2a9-8d97-45dd-a0a2-b7c049e76618 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:34.701144 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9379c2a9-8d97-45dd-a0a2-b7c049e76618 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:34.832180 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-9379c2a9-8d97-45dd-a0a2-b7c049e76618 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:34.839526 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-9379c2a9-8d97-45dd-a0a2-b7c049e76618 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.150836 Mar 08 15:03:34.840111 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1024/2030] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:34 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:03:34.844521 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-1fba6032-c61b-4735-ab64-4768ad57bb7f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:34.845121 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-1fba6032-c61b-4735-ab64-4768ad57bb7f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:34.850483 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1fba6032-c61b-4735-ab64-4768ad57bb7f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:34.850927 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1fba6032-c61b-4735-ab64-4768ad57bb7f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:34.851684 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1fba6032-c61b-4735-ab64-4768ad57bb7f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:34.852119 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1fba6032-c61b-4735-ab64-4768ad57bb7f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:34.913725 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-1fba6032-c61b-4735-ab64-4768ad57bb7f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:34.921439 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-1fba6032-c61b-4735-ab64-4768ad57bb7f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080405 Mar 08 15:03:34.922012 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1025/2031] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:34 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:03:35.856403 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-dc1c9e34-bba1-48b4-8804-0bcac4bc03bf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:35.857669 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-dc1c9e34-bba1-48b4-8804-0bcac4bc03bf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:35.863971 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-dc1c9e34-bba1-48b4-8804-0bcac4bc03bf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:35.864418 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-dc1c9e34-bba1-48b4-8804-0bcac4bc03bf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:35.865177 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-dc1c9e34-bba1-48b4-8804-0bcac4bc03bf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:35.865628 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-dc1c9e34-bba1-48b4-8804-0bcac4bc03bf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:35.998357 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-dc1c9e34-bba1-48b4-8804-0bcac4bc03bf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:36.005527 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-dc1c9e34-bba1-48b4-8804-0bcac4bc03bf tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.152930 Mar 08 15:03:36.006116 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1026/2032] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:35 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:03:36.010436 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-39a1eba9-9435-43fd-abe3-7a33942a6e21 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:36.011028 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-39a1eba9-9435-43fd-abe3-7a33942a6e21 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:36.016858 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-39a1eba9-9435-43fd-abe3-7a33942a6e21 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:36.017308 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-39a1eba9-9435-43fd-abe3-7a33942a6e21 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:36.018106 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-39a1eba9-9435-43fd-abe3-7a33942a6e21 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:36.018566 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-39a1eba9-9435-43fd-abe3-7a33942a6e21 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:36.078046 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-39a1eba9-9435-43fd-abe3-7a33942a6e21 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:36.085100 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-39a1eba9-9435-43fd-abe3-7a33942a6e21 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078074 Mar 08 15:03:36.085657 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1027/2033] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:36 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:03:37.022798 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-671881f7-ce51-4ddc-8a85-fc9c2f1654c1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:37.023416 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-671881f7-ce51-4ddc-8a85-fc9c2f1654c1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:37.029583 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-671881f7-ce51-4ddc-8a85-fc9c2f1654c1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:37.030057 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-671881f7-ce51-4ddc-8a85-fc9c2f1654c1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:37.031230 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-671881f7-ce51-4ddc-8a85-fc9c2f1654c1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:37.031670 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-671881f7-ce51-4ddc-8a85-fc9c2f1654c1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:37.172198 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-671881f7-ce51-4ddc-8a85-fc9c2f1654c1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:37.179687 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-671881f7-ce51-4ddc-8a85-fc9c2f1654c1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.160712 Mar 08 15:03:37.180254 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1028/2034] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:37 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:03:37.184502 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-1aa34988-22f5-4968-8da4-fd45b29a1738 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:37.185118 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-1aa34988-22f5-4968-8da4-fd45b29a1738 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:37.191374 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1aa34988-22f5-4968-8da4-fd45b29a1738 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:37.191760 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1aa34988-22f5-4968-8da4-fd45b29a1738 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:37.192523 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1aa34988-22f5-4968-8da4-fd45b29a1738 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:37.192982 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1aa34988-22f5-4968-8da4-fd45b29a1738 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:37.253098 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-1aa34988-22f5-4968-8da4-fd45b29a1738 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:37.260336 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-1aa34988-22f5-4968-8da4-fd45b29a1738 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079166 Mar 08 15:03:37.261091 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1029/2035] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:37 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:03:38.196521 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-9f0d99e9-5e0d-4453-970e-d5add75b6560 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:38.197143 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-9f0d99e9-5e0d-4453-970e-d5add75b6560 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:38.204131 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9f0d99e9-5e0d-4453-970e-d5add75b6560 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:38.204575 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9f0d99e9-5e0d-4453-970e-d5add75b6560 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:38.205340 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9f0d99e9-5e0d-4453-970e-d5add75b6560 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:38.205771 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9f0d99e9-5e0d-4453-970e-d5add75b6560 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:38.337321 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-9f0d99e9-5e0d-4453-970e-d5add75b6560 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:38.344666 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-9f0d99e9-5e0d-4453-970e-d5add75b6560 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.152024 Mar 08 15:03:38.345216 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1030/2036] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:38 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:03:38.349537 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b323c994-6026-491d-8761-9ae718cbae03 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:38.350156 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-b323c994-6026-491d-8761-9ae718cbae03 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:38.355443 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b323c994-6026-491d-8761-9ae718cbae03 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:38.355890 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b323c994-6026-491d-8761-9ae718cbae03 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:38.356650 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b323c994-6026-491d-8761-9ae718cbae03 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:38.357673 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b323c994-6026-491d-8761-9ae718cbae03 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:38.416608 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-b323c994-6026-491d-8761-9ae718cbae03 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:38.424458 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-b323c994-6026-491d-8761-9ae718cbae03 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078325 Mar 08 15:03:38.425019 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1031/2037] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:38 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:03:39.361719 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-891cbe43-01cf-469d-bfa2-b73bbd6267bc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:39.362543 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-891cbe43-01cf-469d-bfa2-b73bbd6267bc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:39.368992 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-891cbe43-01cf-469d-bfa2-b73bbd6267bc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:39.369439 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-891cbe43-01cf-469d-bfa2-b73bbd6267bc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:39.370231 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-891cbe43-01cf-469d-bfa2-b73bbd6267bc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:39.370667 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-891cbe43-01cf-469d-bfa2-b73bbd6267bc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:39.507405 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-891cbe43-01cf-469d-bfa2-b73bbd6267bc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:39.515496 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-891cbe43-01cf-469d-bfa2-b73bbd6267bc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.157702 Mar 08 15:03:39.516065 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1032/2038] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:39 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:03:39.520446 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-d93aafd0-3aad-4228-b303-0c1dbb824553 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:39.521049 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-d93aafd0-3aad-4228-b303-0c1dbb824553 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:39.526416 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d93aafd0-3aad-4228-b303-0c1dbb824553 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:39.526870 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d93aafd0-3aad-4228-b303-0c1dbb824553 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:39.527633 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d93aafd0-3aad-4228-b303-0c1dbb824553 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:39.528073 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d93aafd0-3aad-4228-b303-0c1dbb824553 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:39.586155 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-d93aafd0-3aad-4228-b303-0c1dbb824553 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:39.593537 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-d93aafd0-3aad-4228-b303-0c1dbb824553 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.076545 Mar 08 15:03:39.594133 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1033/2039] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:39 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:03:40.533119 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-5ede7b76-2729-4b5a-9092-a27d706a30e0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:40.533798 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-5ede7b76-2729-4b5a-9092-a27d706a30e0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:40.540075 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5ede7b76-2729-4b5a-9092-a27d706a30e0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:40.540529 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5ede7b76-2729-4b5a-9092-a27d706a30e0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:40.541302 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5ede7b76-2729-4b5a-9092-a27d706a30e0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:40.541741 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5ede7b76-2729-4b5a-9092-a27d706a30e0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:40.679169 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-5ede7b76-2729-4b5a-9092-a27d706a30e0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:40.686695 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-5ede7b76-2729-4b5a-9092-a27d706a30e0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.158419 Mar 08 15:03:40.687256 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1034/2040] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:40 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:03:40.691519 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-70321d1c-adc9-4ba6-a796-4c1e63d6654e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:40.692150 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-70321d1c-adc9-4ba6-a796-4c1e63d6654e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:40.697445 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-70321d1c-adc9-4ba6-a796-4c1e63d6654e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:40.697932 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-70321d1c-adc9-4ba6-a796-4c1e63d6654e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:40.698695 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-70321d1c-adc9-4ba6-a796-4c1e63d6654e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:40.699131 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-70321d1c-adc9-4ba6-a796-4c1e63d6654e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:40.757314 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-70321d1c-adc9-4ba6-a796-4c1e63d6654e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:40.765205 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-70321d1c-adc9-4ba6-a796-4c1e63d6654e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.077026 Mar 08 15:03:40.765759 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1035/2041] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:40 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:03:41.703289 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-690ca054-4af1-47d7-b559-f20e8aadbfde tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:41.703901 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-690ca054-4af1-47d7-b559-f20e8aadbfde tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:41.710203 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-690ca054-4af1-47d7-b559-f20e8aadbfde tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:41.710657 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-690ca054-4af1-47d7-b559-f20e8aadbfde tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:41.711431 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-690ca054-4af1-47d7-b559-f20e8aadbfde tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:41.711875 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-690ca054-4af1-47d7-b559-f20e8aadbfde tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:41.846343 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-690ca054-4af1-47d7-b559-f20e8aadbfde tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:41.853587 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-690ca054-4af1-47d7-b559-f20e8aadbfde tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.154382 Mar 08 15:03:41.854177 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1036/2042] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:41 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:03:41.859099 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-eb346b34-7d36-474f-97ce-40cfde78b31d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:41.859724 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-eb346b34-7d36-474f-97ce-40cfde78b31d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:41.864992 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-eb346b34-7d36-474f-97ce-40cfde78b31d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:41.865439 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-eb346b34-7d36-474f-97ce-40cfde78b31d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:41.866226 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-eb346b34-7d36-474f-97ce-40cfde78b31d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:41.866662 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-eb346b34-7d36-474f-97ce-40cfde78b31d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:41.924887 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-eb346b34-7d36-474f-97ce-40cfde78b31d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:41.932204 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-eb346b34-7d36-474f-97ce-40cfde78b31d tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.077111 Mar 08 15:03:41.932759 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1037/2043] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:41 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:03:42.871324 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-60627761-1ecc-44ac-a0c0-96b2145ef7b1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:42.872010 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-60627761-1ecc-44ac-a0c0-96b2145ef7b1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:42.879018 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-60627761-1ecc-44ac-a0c0-96b2145ef7b1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:42.879470 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-60627761-1ecc-44ac-a0c0-96b2145ef7b1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:42.880237 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-60627761-1ecc-44ac-a0c0-96b2145ef7b1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:42.880668 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-60627761-1ecc-44ac-a0c0-96b2145ef7b1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:43.018334 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-60627761-1ecc-44ac-a0c0-96b2145ef7b1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:43.025590 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-60627761-1ecc-44ac-a0c0-96b2145ef7b1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.158077 Mar 08 15:03:43.026187 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1038/2044] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:42 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:03:43.030553 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-48dd52ab-a1bf-4c82-907a-b5388c590b4b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:43.031160 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-48dd52ab-a1bf-4c82-907a-b5388c590b4b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:43.036519 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-48dd52ab-a1bf-4c82-907a-b5388c590b4b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:43.036973 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-48dd52ab-a1bf-4c82-907a-b5388c590b4b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:43.037747 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-48dd52ab-a1bf-4c82-907a-b5388c590b4b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:43.038226 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-48dd52ab-a1bf-4c82-907a-b5388c590b4b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:43.098413 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-48dd52ab-a1bf-4c82-907a-b5388c590b4b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:43.105642 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-48dd52ab-a1bf-4c82-907a-b5388c590b4b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078508 Mar 08 15:03:43.106248 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1039/2045] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:43 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:03:44.042505 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-ee089de7-122b-4368-a268-af99829cac7b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:44.043143 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-ee089de7-122b-4368-a268-af99829cac7b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:44.049698 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ee089de7-122b-4368-a268-af99829cac7b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:44.050193 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ee089de7-122b-4368-a268-af99829cac7b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:44.050967 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ee089de7-122b-4368-a268-af99829cac7b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:44.051675 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ee089de7-122b-4368-a268-af99829cac7b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:44.184728 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-ee089de7-122b-4368-a268-af99829cac7b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:44.192590 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-ee089de7-122b-4368-a268-af99829cac7b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.154048 Mar 08 15:03:44.193101 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1040/2046] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:44 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:03:44.197378 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-46415753-cc64-41c9-b8b0-f3d84d41f534 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:44.198004 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-46415753-cc64-41c9-b8b0-f3d84d41f534 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:44.203727 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-46415753-cc64-41c9-b8b0-f3d84d41f534 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:44.204183 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-46415753-cc64-41c9-b8b0-f3d84d41f534 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:44.204945 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-46415753-cc64-41c9-b8b0-f3d84d41f534 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:44.205386 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-46415753-cc64-41c9-b8b0-f3d84d41f534 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:44.267942 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-46415753-cc64-41c9-b8b0-f3d84d41f534 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:44.275321 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-46415753-cc64-41c9-b8b0-f3d84d41f534 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081265 Mar 08 15:03:44.275883 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1041/2047] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:44 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:03:45.208727 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-286894f3-81be-412a-b31a-b8114364b1d0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:45.209342 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-286894f3-81be-412a-b31a-b8114364b1d0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:45.215869 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-286894f3-81be-412a-b31a-b8114364b1d0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:45.216492 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-286894f3-81be-412a-b31a-b8114364b1d0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:45.217375 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-286894f3-81be-412a-b31a-b8114364b1d0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:45.217911 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-286894f3-81be-412a-b31a-b8114364b1d0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:45.355073 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-286894f3-81be-412a-b31a-b8114364b1d0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:45.362524 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-286894f3-81be-412a-b31a-b8114364b1d0 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.157723 Mar 08 15:03:45.363094 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1042/2048] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:45 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:03:45.367435 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-616f390a-daf4-44bf-84c4-edd88767627e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:45.368041 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-616f390a-daf4-44bf-84c4-edd88767627e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:45.375412 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-616f390a-daf4-44bf-84c4-edd88767627e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:45.375877 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-616f390a-daf4-44bf-84c4-edd88767627e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:45.376664 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-616f390a-daf4-44bf-84c4-edd88767627e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:45.377172 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-616f390a-daf4-44bf-84c4-edd88767627e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:45.436536 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-616f390a-daf4-44bf-84c4-edd88767627e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:45.443846 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-616f390a-daf4-44bf-84c4-edd88767627e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079818 Mar 08 15:03:45.444410 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1043/2049] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:45 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:03:46.379483 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-0baac79b-3cf4-4654-ad8d-78df34ef7204 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:46.380119 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-0baac79b-3cf4-4654-ad8d-78df34ef7204 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:46.386382 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0baac79b-3cf4-4654-ad8d-78df34ef7204 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:46.386836 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0baac79b-3cf4-4654-ad8d-78df34ef7204 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:46.387597 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0baac79b-3cf4-4654-ad8d-78df34ef7204 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:46.388629 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0baac79b-3cf4-4654-ad8d-78df34ef7204 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:46.527802 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-0baac79b-3cf4-4654-ad8d-78df34ef7204 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:46.535568 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-0baac79b-3cf4-4654-ad8d-78df34ef7204 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.159942 Mar 08 15:03:46.536129 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1044/2050] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:46 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:03:46.540403 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-8fae5fc7-44ba-44f3-8286-133bbb488ff1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:46.541002 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-8fae5fc7-44ba-44f3-8286-133bbb488ff1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:46.547056 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8fae5fc7-44ba-44f3-8286-133bbb488ff1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:46.547582 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8fae5fc7-44ba-44f3-8286-133bbb488ff1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:46.548354 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8fae5fc7-44ba-44f3-8286-133bbb488ff1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:46.548814 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8fae5fc7-44ba-44f3-8286-133bbb488ff1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:46.609040 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-8fae5fc7-44ba-44f3-8286-133bbb488ff1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:46.616306 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-8fae5fc7-44ba-44f3-8286-133bbb488ff1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079260 Mar 08 15:03:46.616869 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1045/2051] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:46 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:03:47.553098 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-9f351c8c-6aea-4595-8633-27cf5fa9c85a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:47.553741 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-9f351c8c-6aea-4595-8633-27cf5fa9c85a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:47.559988 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9f351c8c-6aea-4595-8633-27cf5fa9c85a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:47.560524 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9f351c8c-6aea-4595-8633-27cf5fa9c85a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:47.561243 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9f351c8c-6aea-4595-8633-27cf5fa9c85a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:47.561675 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9f351c8c-6aea-4595-8633-27cf5fa9c85a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:47.696666 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-9f351c8c-6aea-4595-8633-27cf5fa9c85a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:47.704655 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-9f351c8c-6aea-4595-8633-27cf5fa9c85a tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.155670 Mar 08 15:03:47.705231 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1046/2052] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:47 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:03:47.709541 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-c71e9a90-1cb5-4bfb-ab93-c34817d6b3b0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:47.710158 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-c71e9a90-1cb5-4bfb-ab93-c34817d6b3b0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:47.715836 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c71e9a90-1cb5-4bfb-ab93-c34817d6b3b0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:47.716344 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c71e9a90-1cb5-4bfb-ab93-c34817d6b3b0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:47.717129 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c71e9a90-1cb5-4bfb-ab93-c34817d6b3b0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:47.717573 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c71e9a90-1cb5-4bfb-ab93-c34817d6b3b0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:47.779076 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-c71e9a90-1cb5-4bfb-ab93-c34817d6b3b0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:47.786303 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-c71e9a90-1cb5-4bfb-ab93-c34817d6b3b0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.080097 Mar 08 15:03:47.786860 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1047/2053] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:47 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:03:48.721535 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-6a93bf24-bfaf-4f1a-85c7-1cf99a97d9dc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:48.722236 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-6a93bf24-bfaf-4f1a-85c7-1cf99a97d9dc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:48.728337 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6a93bf24-bfaf-4f1a-85c7-1cf99a97d9dc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:48.728785 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6a93bf24-bfaf-4f1a-85c7-1cf99a97d9dc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:48.729538 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6a93bf24-bfaf-4f1a-85c7-1cf99a97d9dc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:48.730000 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6a93bf24-bfaf-4f1a-85c7-1cf99a97d9dc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:48.866762 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-6a93bf24-bfaf-4f1a-85c7-1cf99a97d9dc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:48.874755 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-6a93bf24-bfaf-4f1a-85c7-1cf99a97d9dc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.157117 Mar 08 15:03:48.875315 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1048/2054] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:48 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:03:48.879593 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-2ac30e2c-77dc-4607-891f-bdd8cdeb0d94 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:48.880219 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-2ac30e2c-77dc-4607-891f-bdd8cdeb0d94 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:48.885528 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2ac30e2c-77dc-4607-891f-bdd8cdeb0d94 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:48.886021 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2ac30e2c-77dc-4607-891f-bdd8cdeb0d94 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:48.886788 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2ac30e2c-77dc-4607-891f-bdd8cdeb0d94 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:48.887224 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2ac30e2c-77dc-4607-891f-bdd8cdeb0d94 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:48.945938 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-2ac30e2c-77dc-4607-891f-bdd8cdeb0d94 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:48.953543 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-2ac30e2c-77dc-4607-891f-bdd8cdeb0d94 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.077273 Mar 08 15:03:48.954156 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1049/2055] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:48 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:03:49.891607 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-dd7ed303-4b92-4183-b236-b001bd27e82d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:49.892232 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-dd7ed303-4b92-4183-b236-b001bd27e82d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:49.898505 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-dd7ed303-4b92-4183-b236-b001bd27e82d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:49.898975 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-dd7ed303-4b92-4183-b236-b001bd27e82d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:49.899723 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-dd7ed303-4b92-4183-b236-b001bd27e82d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:49.900166 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-dd7ed303-4b92-4183-b236-b001bd27e82d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:50.038872 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-dd7ed303-4b92-4183-b236-b001bd27e82d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:50.046963 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-dd7ed303-4b92-4183-b236-b001bd27e82d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.159254 Mar 08 15:03:50.047523 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1050/2056] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:49 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:03:50.052107 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-d32095b1-be24-49da-a8dd-b79912d45ca0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:50.052739 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-d32095b1-be24-49da-a8dd-b79912d45ca0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:50.058113 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d32095b1-be24-49da-a8dd-b79912d45ca0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:50.058568 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d32095b1-be24-49da-a8dd-b79912d45ca0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:50.059331 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d32095b1-be24-49da-a8dd-b79912d45ca0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:50.059769 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d32095b1-be24-49da-a8dd-b79912d45ca0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:50.122396 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-d32095b1-be24-49da-a8dd-b79912d45ca0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:50.130017 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-d32095b1-be24-49da-a8dd-b79912d45ca0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081538 Mar 08 15:03:50.130578 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1051/2057] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:50 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:03:51.064400 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-1234f354-6aaa-43ce-a3a2-12658ddf6a8e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:51.065012 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-1234f354-6aaa-43ce-a3a2-12658ddf6a8e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:51.071193 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1234f354-6aaa-43ce-a3a2-12658ddf6a8e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:51.071643 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1234f354-6aaa-43ce-a3a2-12658ddf6a8e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:51.072400 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1234f354-6aaa-43ce-a3a2-12658ddf6a8e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:51.072837 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1234f354-6aaa-43ce-a3a2-12658ddf6a8e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:51.205063 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-1234f354-6aaa-43ce-a3a2-12658ddf6a8e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:51.212235 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-1234f354-6aaa-43ce-a3a2-12658ddf6a8e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.152323 Mar 08 15:03:51.212787 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1052/2058] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:51 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:03:51.217053 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-6b2ff50b-a5da-4b02-8bb1-6b5214435359 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:51.217738 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-6b2ff50b-a5da-4b02-8bb1-6b5214435359 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:51.223066 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6b2ff50b-a5da-4b02-8bb1-6b5214435359 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:51.223518 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6b2ff50b-a5da-4b02-8bb1-6b5214435359 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:51.224273 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6b2ff50b-a5da-4b02-8bb1-6b5214435359 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:51.224708 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6b2ff50b-a5da-4b02-8bb1-6b5214435359 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:51.282806 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-6b2ff50b-a5da-4b02-8bb1-6b5214435359 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:51.289931 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-6b2ff50b-a5da-4b02-8bb1-6b5214435359 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.076206 Mar 08 15:03:51.290489 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1053/2059] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:51 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:03:52.229379 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-66d85fd7-9836-453f-8e24-641d5a4f16d1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:52.230050 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-66d85fd7-9836-453f-8e24-641d5a4f16d1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:52.236299 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-66d85fd7-9836-453f-8e24-641d5a4f16d1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:52.236752 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-66d85fd7-9836-453f-8e24-641d5a4f16d1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:52.237510 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-66d85fd7-9836-453f-8e24-641d5a4f16d1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:52.237970 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-66d85fd7-9836-453f-8e24-641d5a4f16d1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:52.381954 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-66d85fd7-9836-453f-8e24-641d5a4f16d1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:52.389824 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-66d85fd7-9836-453f-8e24-641d5a4f16d1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.164306 Mar 08 15:03:52.390420 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1054/2060] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:52 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:03:52.394728 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-64a96a4d-6a07-4673-ad61-8ffa64996da3 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:52.395357 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-64a96a4d-6a07-4673-ad61-8ffa64996da3 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:52.400765 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-64a96a4d-6a07-4673-ad61-8ffa64996da3 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:52.401222 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-64a96a4d-6a07-4673-ad61-8ffa64996da3 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:52.402015 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-64a96a4d-6a07-4673-ad61-8ffa64996da3 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:52.402456 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-64a96a4d-6a07-4673-ad61-8ffa64996da3 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:52.466404 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-64a96a4d-6a07-4673-ad61-8ffa64996da3 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:52.473943 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-64a96a4d-6a07-4673-ad61-8ffa64996da3 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.082562 Mar 08 15:03:52.474501 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1055/2061] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:52 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:03:53.407406 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-73ebed9f-3145-4b3e-8b80-55f443eed746 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:53.408086 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-73ebed9f-3145-4b3e-8b80-55f443eed746 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:53.414265 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-73ebed9f-3145-4b3e-8b80-55f443eed746 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:53.414711 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-73ebed9f-3145-4b3e-8b80-55f443eed746 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:53.415471 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-73ebed9f-3145-4b3e-8b80-55f443eed746 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:53.415905 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-73ebed9f-3145-4b3e-8b80-55f443eed746 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:53.553128 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-73ebed9f-3145-4b3e-8b80-55f443eed746 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:53.561126 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-73ebed9f-3145-4b3e-8b80-55f443eed746 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.157512 Mar 08 15:03:53.561703 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1056/2062] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:53 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:03:53.566033 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-8c5a8987-b696-4ca6-993c-d5ce13a05d51 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:53.566632 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-8c5a8987-b696-4ca6-993c-d5ce13a05d51 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:53.572040 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8c5a8987-b696-4ca6-993c-d5ce13a05d51 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:53.572487 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8c5a8987-b696-4ca6-993c-d5ce13a05d51 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:53.573250 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8c5a8987-b696-4ca6-993c-d5ce13a05d51 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:53.573687 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8c5a8987-b696-4ca6-993c-d5ce13a05d51 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:53.632685 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-8c5a8987-b696-4ca6-993c-d5ce13a05d51 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:53.640806 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-8c5a8987-b696-4ca6-993c-d5ce13a05d51 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078146 Mar 08 15:03:53.641364 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1057/2063] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:53 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:03:54.577641 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-011f2b69-c9f4-4d4e-a6d4-f067cc6af996 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:54.578363 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-011f2b69-c9f4-4d4e-a6d4-f067cc6af996 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:54.584678 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-011f2b69-c9f4-4d4e-a6d4-f067cc6af996 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:54.585135 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-011f2b69-c9f4-4d4e-a6d4-f067cc6af996 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:54.585981 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-011f2b69-c9f4-4d4e-a6d4-f067cc6af996 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:54.586428 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-011f2b69-c9f4-4d4e-a6d4-f067cc6af996 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:54.719989 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-011f2b69-c9f4-4d4e-a6d4-f067cc6af996 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:54.727319 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-011f2b69-c9f4-4d4e-a6d4-f067cc6af996 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.153703 Mar 08 15:03:54.727880 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1058/2064] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:54 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:03:54.733314 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-213cff39-5693-44ae-9d22-f472e01e8af6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:54.733960 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-213cff39-5693-44ae-9d22-f472e01e8af6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:54.739347 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-213cff39-5693-44ae-9d22-f472e01e8af6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:54.739803 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-213cff39-5693-44ae-9d22-f472e01e8af6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:54.740569 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-213cff39-5693-44ae-9d22-f472e01e8af6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:54.741007 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-213cff39-5693-44ae-9d22-f472e01e8af6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:54.800095 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-213cff39-5693-44ae-9d22-f472e01e8af6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:54.807487 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-213cff39-5693-44ae-9d22-f472e01e8af6 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078687 Mar 08 15:03:54.808041 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1059/2065] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:54 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:03:55.745183 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-c71b4458-d878-4faa-b1bf-f723fd40e8a2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:55.745846 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-c71b4458-d878-4faa-b1bf-f723fd40e8a2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:55.752824 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c71b4458-d878-4faa-b1bf-f723fd40e8a2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:55.753274 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c71b4458-d878-4faa-b1bf-f723fd40e8a2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:55.754070 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c71b4458-d878-4faa-b1bf-f723fd40e8a2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:55.754749 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c71b4458-d878-4faa-b1bf-f723fd40e8a2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:55.891179 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-c71b4458-d878-4faa-b1bf-f723fd40e8a2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:55.898578 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-c71b4458-d878-4faa-b1bf-f723fd40e8a2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.157002 Mar 08 15:03:55.899140 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1060/2066] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:55 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:03:55.903512 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-abbd36f4-da46-445b-9c19-6e8cb999aa98 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:55.904614 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-abbd36f4-da46-445b-9c19-6e8cb999aa98 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:55.909899 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-abbd36f4-da46-445b-9c19-6e8cb999aa98 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:55.910348 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-abbd36f4-da46-445b-9c19-6e8cb999aa98 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:55.911148 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-abbd36f4-da46-445b-9c19-6e8cb999aa98 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:55.911534 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-abbd36f4-da46-445b-9c19-6e8cb999aa98 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:55.970397 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-abbd36f4-da46-445b-9c19-6e8cb999aa98 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:55.977567 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-abbd36f4-da46-445b-9c19-6e8cb999aa98 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.077419 Mar 08 15:03:55.978154 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1061/2067] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:55 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:03:56.915612 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-7fb3db83-5d4f-4bf4-b6d9-ffad404d87bb tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:56.916303 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-7fb3db83-5d4f-4bf4-b6d9-ffad404d87bb tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:56.927792 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7fb3db83-5d4f-4bf4-b6d9-ffad404d87bb tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:56.928240 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7fb3db83-5d4f-4bf4-b6d9-ffad404d87bb tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:56.928996 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7fb3db83-5d4f-4bf4-b6d9-ffad404d87bb tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:56.929433 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7fb3db83-5d4f-4bf4-b6d9-ffad404d87bb tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:57.061799 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-7fb3db83-5d4f-4bf4-b6d9-ffad404d87bb tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:57.068995 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-7fb3db83-5d4f-4bf4-b6d9-ffad404d87bb tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.157238 Mar 08 15:03:57.069550 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1062/2068] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:56 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:03:57.074114 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-6788384f-d686-4d57-922e-92b4620beafc tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:57.074713 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-6788384f-d686-4d57-922e-92b4620beafc tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:57.080545 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6788384f-d686-4d57-922e-92b4620beafc tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:57.081009 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6788384f-d686-4d57-922e-92b4620beafc tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:57.081772 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6788384f-d686-4d57-922e-92b4620beafc tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:57.082235 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6788384f-d686-4d57-922e-92b4620beafc tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:57.142923 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-6788384f-d686-4d57-922e-92b4620beafc tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:57.150051 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-6788384f-d686-4d57-922e-92b4620beafc tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.079522 Mar 08 15:03:57.150608 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1063/2069] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:57 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:03:58.086780 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-78892aad-0b1d-4143-84e8-96e49189ec1d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:58.087400 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-78892aad-0b1d-4143-84e8-96e49189ec1d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:58.094182 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-78892aad-0b1d-4143-84e8-96e49189ec1d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:58.094639 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-78892aad-0b1d-4143-84e8-96e49189ec1d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:58.095402 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-78892aad-0b1d-4143-84e8-96e49189ec1d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:58.095844 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-78892aad-0b1d-4143-84e8-96e49189ec1d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:58.230619 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-78892aad-0b1d-4143-84e8-96e49189ec1d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:58.238494 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-78892aad-0b1d-4143-84e8-96e49189ec1d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.155592 Mar 08 15:03:58.239052 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1064/2070] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:58 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:03:58.338849 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-c0dec9ea-419b-4a5f-a178-b5619df31b49 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:58.339478 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-c0dec9ea-419b-4a5f-a178-b5619df31b49 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:58.346265 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c0dec9ea-419b-4a5f-a178-b5619df31b49 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:58.346725 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c0dec9ea-419b-4a5f-a178-b5619df31b49 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:58.347496 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c0dec9ea-419b-4a5f-a178-b5619df31b49 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:58.347938 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c0dec9ea-419b-4a5f-a178-b5619df31b49 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:58.407185 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-c0dec9ea-419b-4a5f-a178-b5619df31b49 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:58.414363 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-c0dec9ea-419b-4a5f-a178-b5619df31b49 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.174395 Mar 08 15:03:58.414920 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1065/2071] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:58 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:03:59.255535 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-5a986bff-f156-4512-8a22-40a31e09a417 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:59.256214 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-5a986bff-f156-4512-8a22-40a31e09a417 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:59.262404 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5a986bff-f156-4512-8a22-40a31e09a417 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:59.262859 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5a986bff-f156-4512-8a22-40a31e09a417 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:59.264568 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5a986bff-f156-4512-8a22-40a31e09a417 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:59.265013 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5a986bff-f156-4512-8a22-40a31e09a417 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:59.401860 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-5a986bff-f156-4512-8a22-40a31e09a417 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:59.409418 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-5a986bff-f156-4512-8a22-40a31e09a417 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.157737 Mar 08 15:03:59.410001 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1066/2072] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:59 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:03:59.431308 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-8017a13a-ab04-4d91-ac3b-ef0ad64a148a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:03:59.431907 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-8017a13a-ab04-4d91-ac3b-ef0ad64a148a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:03:59.438246 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8017a13a-ab04-4d91-ac3b-ef0ad64a148a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:59.438697 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8017a13a-ab04-4d91-ac3b-ef0ad64a148a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:59.439450 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8017a13a-ab04-4d91-ac3b-ef0ad64a148a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:03:59.439886 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8017a13a-ab04-4d91-ac3b-ef0ad64a148a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:03:59.498672 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-8017a13a-ab04-4d91-ac3b-ef0ad64a148a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:03:59.505728 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-8017a13a-ab04-4d91-ac3b-ef0ad64a148a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.077833 Mar 08 15:03:59.506251 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1067/2073] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:03:59 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:04:00.537252 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-19e415b0-2769-4c6e-a3d7-8ecc4ccedaea tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:04:00.537887 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-19e415b0-2769-4c6e-a3d7-8ecc4ccedaea tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:04:00.543621 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-19e415b0-2769-4c6e-a3d7-8ecc4ccedaea tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:04:00.544070 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-19e415b0-2769-4c6e-a3d7-8ecc4ccedaea tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:04:00.545431 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-19e415b0-2769-4c6e-a3d7-8ecc4ccedaea tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:04:00.545890 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-19e415b0-2769-4c6e-a3d7-8ecc4ccedaea tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:04:00.676854 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-19e415b0-2769-4c6e-a3d7-8ecc4ccedaea tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:04:00.684111 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-19e415b0-2769-4c6e-a3d7-8ecc4ccedaea tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.261219 Mar 08 15:04:00.684622 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1068/2074] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:04:00 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:04:00.690237 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-95c7d035-8a5c-4d56-b388-c1217ef23151 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:04:00.690845 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-95c7d035-8a5c-4d56-b388-c1217ef23151 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:04:00.696237 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-95c7d035-8a5c-4d56-b388-c1217ef23151 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:04:00.696692 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-95c7d035-8a5c-4d56-b388-c1217ef23151 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:04:00.697456 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-95c7d035-8a5c-4d56-b388-c1217ef23151 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:04:00.697919 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-95c7d035-8a5c-4d56-b388-c1217ef23151 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:04:00.759953 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-95c7d035-8a5c-4d56-b388-c1217ef23151 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:04:00.767678 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-95c7d035-8a5c-4d56-b388-c1217ef23151 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081482 Mar 08 15:04:00.768271 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1069/2075] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:04:00 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:04:01.702024 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-eb0d25b3-dd1b-4d21-96bb-c4c394f7c83d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:04:01.702659 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-eb0d25b3-dd1b-4d21-96bb-c4c394f7c83d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:04:01.708974 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-eb0d25b3-dd1b-4d21-96bb-c4c394f7c83d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:04:01.709421 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-eb0d25b3-dd1b-4d21-96bb-c4c394f7c83d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:04:01.710217 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-eb0d25b3-dd1b-4d21-96bb-c4c394f7c83d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:04:01.710651 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-eb0d25b3-dd1b-4d21-96bb-c4c394f7c83d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:04:01.849203 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-eb0d25b3-dd1b-4d21-96bb-c4c394f7c83d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:04:01.856853 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-eb0d25b3-dd1b-4d21-96bb-c4c394f7c83d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.159151 Mar 08 15:04:01.857569 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1070/2076] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:04:01 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:04:01.861913 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-08327147-8770-416e-9ec9-92846e44a340 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:04:01.862570 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-08327147-8770-416e-9ec9-92846e44a340 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:04:01.867951 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-08327147-8770-416e-9ec9-92846e44a340 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:04:01.868397 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-08327147-8770-416e-9ec9-92846e44a340 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:04:01.869155 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-08327147-8770-416e-9ec9-92846e44a340 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:04:01.869588 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-08327147-8770-416e-9ec9-92846e44a340 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:04:01.928667 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-08327147-8770-416e-9ec9-92846e44a340 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:04:01.936462 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-08327147-8770-416e-9ec9-92846e44a340 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.077936 Mar 08 15:04:01.937019 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1071/2077] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:04:01 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:04:02.874134 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-afb97734-af9d-42dc-aff1-9cfaacf3f7de tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:04:02.874835 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-afb97734-af9d-42dc-aff1-9cfaacf3f7de tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:04:02.880902 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-afb97734-af9d-42dc-aff1-9cfaacf3f7de tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:04:02.881347 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-afb97734-af9d-42dc-aff1-9cfaacf3f7de tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:04:02.882141 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-afb97734-af9d-42dc-aff1-9cfaacf3f7de tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:04:02.882574 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-afb97734-af9d-42dc-aff1-9cfaacf3f7de tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:04:03.018331 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-afb97734-af9d-42dc-aff1-9cfaacf3f7de tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:04:03.025708 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-afb97734-af9d-42dc-aff1-9cfaacf3f7de tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.155516 Mar 08 15:04:03.026310 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1072/2078] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:04:02 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:04:03.031278 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-2361e6ff-52a0-47f1-8102-8ffb883ff1a4 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:04:03.031879 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-2361e6ff-52a0-47f1-8102-8ffb883ff1a4 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:04:03.037196 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2361e6ff-52a0-47f1-8102-8ffb883ff1a4 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:04:03.037646 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2361e6ff-52a0-47f1-8102-8ffb883ff1a4 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:04:03.038451 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2361e6ff-52a0-47f1-8102-8ffb883ff1a4 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:04:03.038889 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2361e6ff-52a0-47f1-8102-8ffb883ff1a4 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:04:03.097910 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-2361e6ff-52a0-47f1-8102-8ffb883ff1a4 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:04:03.105472 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-2361e6ff-52a0-47f1-8102-8ffb883ff1a4 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078233 Mar 08 15:04:03.106064 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1073/2079] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:04:03 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:04:04.042831 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-3170a70f-45c6-4aca-90b2-77a5fbe865c5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:04:04.043448 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-3170a70f-45c6-4aca-90b2-77a5fbe865c5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:04:04.050691 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3170a70f-45c6-4aca-90b2-77a5fbe865c5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:04:04.051408 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3170a70f-45c6-4aca-90b2-77a5fbe865c5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:04:04.052171 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3170a70f-45c6-4aca-90b2-77a5fbe865c5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:04:04.052638 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3170a70f-45c6-4aca-90b2-77a5fbe865c5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:04:04.186743 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-3170a70f-45c6-4aca-90b2-77a5fbe865c5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:04:04.194016 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-3170a70f-45c6-4aca-90b2-77a5fbe865c5 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.155247 Mar 08 15:04:04.194527 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1074/2080] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:04:04 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:04:04.198860 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-4c8816a6-0d9f-40c9-885d-cd8577568115 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:04:04.199458 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-4c8816a6-0d9f-40c9-885d-cd8577568115 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:04:04.205483 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4c8816a6-0d9f-40c9-885d-cd8577568115 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:04:04.205974 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4c8816a6-0d9f-40c9-885d-cd8577568115 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:04:04.206739 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4c8816a6-0d9f-40c9-885d-cd8577568115 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:04:04.207177 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4c8816a6-0d9f-40c9-885d-cd8577568115 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:04:04.265633 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-4c8816a6-0d9f-40c9-885d-cd8577568115 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:04:04.272732 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-4c8816a6-0d9f-40c9-885d-cd8577568115 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.077280 Mar 08 15:04:04.273290 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1075/2081] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:04:04 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:04:04.564548 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.objects.instance [None req-d27da657-244c-45d4-8481-d5c8d7bae5c6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lazy-loading 'services' on Instance uuid 251780d0-025f-4a29-b292-9a73dce671e6 {{(pid=128352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 15:04:05.211322 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-53d0113a-1ba1-4038-96ae-c77a6fedd9bc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:04:05.211906 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-53d0113a-1ba1-4038-96ae-c77a6fedd9bc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:04:05.219758 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-53d0113a-1ba1-4038-96ae-c77a6fedd9bc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:04:05.220212 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-53d0113a-1ba1-4038-96ae-c77a6fedd9bc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:04:05.220985 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-53d0113a-1ba1-4038-96ae-c77a6fedd9bc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:04:05.221422 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-53d0113a-1ba1-4038-96ae-c77a6fedd9bc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:04:05.362127 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-53d0113a-1ba1-4038-96ae-c77a6fedd9bc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:04:05.369279 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-53d0113a-1ba1-4038-96ae-c77a6fedd9bc tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.161942 Mar 08 15:04:05.369842 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1076/2082] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:04:05 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:04:05.374373 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-3bd4f61a-65f9-41cc-8e03-1673743ee119 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:04:05.374971 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-3bd4f61a-65f9-41cc-8e03-1673743ee119 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:04:05.380323 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3bd4f61a-65f9-41cc-8e03-1673743ee119 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:04:05.380781 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3bd4f61a-65f9-41cc-8e03-1673743ee119 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:04:05.381538 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3bd4f61a-65f9-41cc-8e03-1673743ee119 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:04:05.382021 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3bd4f61a-65f9-41cc-8e03-1673743ee119 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:04:05.440940 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-3bd4f61a-65f9-41cc-8e03-1673743ee119 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:04:05.448051 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-3bd4f61a-65f9-41cc-8e03-1673743ee119 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.077189 Mar 08 15:04:05.448608 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1077/2083] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:04:05 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:04:06.387044 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b7ec1802-5027-444a-b891-63e0a58e7a7f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:04:06.387686 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-b7ec1802-5027-444a-b891-63e0a58e7a7f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:04:06.393990 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b7ec1802-5027-444a-b891-63e0a58e7a7f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:04:06.394449 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b7ec1802-5027-444a-b891-63e0a58e7a7f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:04:06.395220 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b7ec1802-5027-444a-b891-63e0a58e7a7f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:04:06.395660 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b7ec1802-5027-444a-b891-63e0a58e7a7f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:04:06.533493 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-b7ec1802-5027-444a-b891-63e0a58e7a7f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:04:06.540960 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-b7ec1802-5027-444a-b891-63e0a58e7a7f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.157783 Mar 08 15:04:06.541519 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1078/2084] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:04:06 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:04:06.546646 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-320be577-1b2c-4329-bf26-ca60e09153d2 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:04:06.547237 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-320be577-1b2c-4329-bf26-ca60e09153d2 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:04:06.553000 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-320be577-1b2c-4329-bf26-ca60e09153d2 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:04:06.553447 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-320be577-1b2c-4329-bf26-ca60e09153d2 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:04:06.554229 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-320be577-1b2c-4329-bf26-ca60e09153d2 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:04:06.554665 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-320be577-1b2c-4329-bf26-ca60e09153d2 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:04:06.614122 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-320be577-1b2c-4329-bf26-ca60e09153d2 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:04:06.621299 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-320be577-1b2c-4329-bf26-ca60e09153d2 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078844 Mar 08 15:04:06.621875 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1079/2085] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:04:06 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:04:07.559093 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-bb2913cf-6041-4495-b56c-eb899c08cc43 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:04:07.559781 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-bb2913cf-6041-4495-b56c-eb899c08cc43 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:04:07.567244 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bb2913cf-6041-4495-b56c-eb899c08cc43 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:04:07.567697 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bb2913cf-6041-4495-b56c-eb899c08cc43 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:04:07.568461 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bb2913cf-6041-4495-b56c-eb899c08cc43 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:04:07.568907 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bb2913cf-6041-4495-b56c-eb899c08cc43 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:04:07.703341 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-bb2913cf-6041-4495-b56c-eb899c08cc43 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:04:07.711041 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-bb2913cf-6041-4495-b56c-eb899c08cc43 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.155801 Mar 08 15:04:07.711614 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1080/2086] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:04:07 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:04:07.716004 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-a44b1d28-4919-4cbb-adb9-c3d56cd9db01 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:04:07.716605 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-a44b1d28-4919-4cbb-adb9-c3d56cd9db01 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:04:07.722087 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a44b1d28-4919-4cbb-adb9-c3d56cd9db01 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:04:07.722550 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a44b1d28-4919-4cbb-adb9-c3d56cd9db01 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:04:07.723349 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a44b1d28-4919-4cbb-adb9-c3d56cd9db01 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:04:07.723788 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a44b1d28-4919-4cbb-adb9-c3d56cd9db01 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:04:07.781898 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-a44b1d28-4919-4cbb-adb9-c3d56cd9db01 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:04:07.788973 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-a44b1d28-4919-4cbb-adb9-c3d56cd9db01 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.076405 Mar 08 15:04:07.789557 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1081/2087] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:04:07 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:04:08.728131 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-7b46b383-9ad2-43fb-b8b3-a6837c524ee2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:04:08.728840 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-7b46b383-9ad2-43fb-b8b3-a6837c524ee2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:04:08.735378 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7b46b383-9ad2-43fb-b8b3-a6837c524ee2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:04:08.735850 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7b46b383-9ad2-43fb-b8b3-a6837c524ee2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:04:08.736603 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7b46b383-9ad2-43fb-b8b3-a6837c524ee2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:04:08.737045 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7b46b383-9ad2-43fb-b8b3-a6837c524ee2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:04:08.878474 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-7b46b383-9ad2-43fb-b8b3-a6837c524ee2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:04:08.887057 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-7b46b383-9ad2-43fb-b8b3-a6837c524ee2 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.162827 Mar 08 15:04:08.887615 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1082/2088] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:04:08 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:04:08.892599 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-1db02d40-8816-4c58-81ed-c60d68c25b86 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:04:08.893193 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-1db02d40-8816-4c58-81ed-c60d68c25b86 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:04:08.898556 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1db02d40-8816-4c58-81ed-c60d68c25b86 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:04:08.899004 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1db02d40-8816-4c58-81ed-c60d68c25b86 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:04:08.899765 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1db02d40-8816-4c58-81ed-c60d68c25b86 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:04:08.900198 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1db02d40-8816-4c58-81ed-c60d68c25b86 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:04:08.959736 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-1db02d40-8816-4c58-81ed-c60d68c25b86 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:04:08.966963 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-1db02d40-8816-4c58-81ed-c60d68c25b86 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078434 Mar 08 15:04:08.967724 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1083/2089] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:04:08 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:04:09.905572 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-e89570fe-f20b-4dfe-be7a-911dfe9f6f27 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:04:09.906302 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-e89570fe-f20b-4dfe-be7a-911dfe9f6f27 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:04:09.913486 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e89570fe-f20b-4dfe-be7a-911dfe9f6f27 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:04:09.913964 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e89570fe-f20b-4dfe-be7a-911dfe9f6f27 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:04:09.914739 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e89570fe-f20b-4dfe-be7a-911dfe9f6f27 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:04:09.915170 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e89570fe-f20b-4dfe-be7a-911dfe9f6f27 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:04:10.053422 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-e89570fe-f20b-4dfe-be7a-911dfe9f6f27 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:04:10.060643 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-e89570fe-f20b-4dfe-be7a-911dfe9f6f27 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.159060 Mar 08 15:04:10.061374 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1084/2090] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:04:09 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:04:10.065724 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-e9e57298-445a-487e-bb52-713993eadd05 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:04:10.066351 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-e9e57298-445a-487e-bb52-713993eadd05 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:04:10.071637 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e9e57298-445a-487e-bb52-713993eadd05 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:04:10.072085 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e9e57298-445a-487e-bb52-713993eadd05 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:04:10.072839 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e9e57298-445a-487e-bb52-713993eadd05 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:04:10.073274 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e9e57298-445a-487e-bb52-713993eadd05 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:04:10.137507 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-e9e57298-445a-487e-bb52-713993eadd05 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:04:10.146021 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-e9e57298-445a-487e-bb52-713993eadd05 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.083587 Mar 08 15:04:10.146595 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1085/2091] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:04:10 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:04:11.077967 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-eed88d40-d6f5-45ac-a5cc-223af3c6f02c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:04:11.078584 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-eed88d40-d6f5-45ac-a5cc-223af3c6f02c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:04:11.084854 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-eed88d40-d6f5-45ac-a5cc-223af3c6f02c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:04:11.085309 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-eed88d40-d6f5-45ac-a5cc-223af3c6f02c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:04:11.086100 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-eed88d40-d6f5-45ac-a5cc-223af3c6f02c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:04:11.086710 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-eed88d40-d6f5-45ac-a5cc-223af3c6f02c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:04:11.219545 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-eed88d40-d6f5-45ac-a5cc-223af3c6f02c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:04:11.226692 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-eed88d40-d6f5-45ac-a5cc-223af3c6f02c tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.152656 Mar 08 15:04:11.227249 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1086/2092] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:04:11 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:04:11.231493 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-3f0dccb1-d731-4a09-87b4-146e2b89859f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:04:11.232085 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-3f0dccb1-d731-4a09-87b4-146e2b89859f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:04:11.238190 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3f0dccb1-d731-4a09-87b4-146e2b89859f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:04:11.238640 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3f0dccb1-d731-4a09-87b4-146e2b89859f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:04:11.239392 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3f0dccb1-d731-4a09-87b4-146e2b89859f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:04:11.239823 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3f0dccb1-d731-4a09-87b4-146e2b89859f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:04:11.297980 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-3f0dccb1-d731-4a09-87b4-146e2b89859f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:04:11.305244 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-3f0dccb1-d731-4a09-87b4-146e2b89859f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.077082 Mar 08 15:04:11.305801 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1087/2093] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:04:11 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:04:12.244910 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-c54c2a05-7f9b-49b4-a93c-6680204de1d1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:04:12.245567 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-c54c2a05-7f9b-49b4-a93c-6680204de1d1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:04:12.252697 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c54c2a05-7f9b-49b4-a93c-6680204de1d1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:04:12.253154 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c54c2a05-7f9b-49b4-a93c-6680204de1d1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:04:12.253950 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c54c2a05-7f9b-49b4-a93c-6680204de1d1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:04:12.254439 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c54c2a05-7f9b-49b4-a93c-6680204de1d1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:04:12.392424 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-c54c2a05-7f9b-49b4-a93c-6680204de1d1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:04:12.399669 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-c54c2a05-7f9b-49b4-a93c-6680204de1d1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.158648 Mar 08 15:04:12.400229 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1088/2094] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:04:12 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:04:12.404609 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-7293d01e-b8a6-401a-ae60-f9924f1d3396 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:04:12.405926 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-7293d01e-b8a6-401a-ae60-f9924f1d3396 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:04:12.411482 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7293d01e-b8a6-401a-ae60-f9924f1d3396 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:04:12.411934 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7293d01e-b8a6-401a-ae60-f9924f1d3396 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:04:12.412722 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7293d01e-b8a6-401a-ae60-f9924f1d3396 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:04:12.413155 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7293d01e-b8a6-401a-ae60-f9924f1d3396 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:04:12.472523 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-7293d01e-b8a6-401a-ae60-f9924f1d3396 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:04:12.479947 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-7293d01e-b8a6-401a-ae60-f9924f1d3396 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.078788 Mar 08 15:04:12.480502 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1089/2095] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:04:12 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:04:13.418053 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-bfefaf2a-dbf2-4036-8971-14a5a425aa07 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:04:13.418668 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-bfefaf2a-dbf2-4036-8971-14a5a425aa07 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:04:13.425125 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bfefaf2a-dbf2-4036-8971-14a5a425aa07 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:04:13.425586 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bfefaf2a-dbf2-4036-8971-14a5a425aa07 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:04:13.426659 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bfefaf2a-dbf2-4036-8971-14a5a425aa07 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:04:13.427099 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bfefaf2a-dbf2-4036-8971-14a5a425aa07 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:04:13.596965 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-bfefaf2a-dbf2-4036-8971-14a5a425aa07 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:04:13.604155 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-bfefaf2a-dbf2-4036-8971-14a5a425aa07 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.190048 Mar 08 15:04:13.604717 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1090/2096] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:04:13 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:04:13.609121 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-2be7e732-d1f1-45ba-8729-e7484d4307d4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:04:13.609632 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-2be7e732-d1f1-45ba-8729-e7484d4307d4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:04:13.614994 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2be7e732-d1f1-45ba-8729-e7484d4307d4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:04:13.615441 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2be7e732-d1f1-45ba-8729-e7484d4307d4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:04:13.616192 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2be7e732-d1f1-45ba-8729-e7484d4307d4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:04:13.616624 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2be7e732-d1f1-45ba-8729-e7484d4307d4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:04:25.482955 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 15:04:25.483628 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: Tue Mar 8 15:04:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments/9ff4ba39-d5be-4514-8dac-561bb4b9e67e (ip 10.222.0.30) !!! Mar 08 15:04:44.972666 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 15:04:44.973117 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: Tue Mar 8 15:04:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments/9ff4ba39-d5be-4514-8dac-561bb4b9e67e (ip 10.222.0.30) !!! Mar 08 15:05:38.750068 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 15:05:38.751339 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: Tue Mar 8 15:05:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments/9ff4ba39-d5be-4514-8dac-561bb4b9e67e (ip 10.222.0.30) !!! Mar 08 15:06:04.797847 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-d27da657-244c-45d4-8481-d5c8d7bae5c6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4017e8cb-523d-4a32-94af-b4af157ec506) Mar 08 15:06:04.798476 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d27da657-244c-45d4-8481-d5c8d7bae5c6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4017e8cb-523d-4a32-94af-b4af157ec506) {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:06:04.799314 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d27da657-244c-45d4-8481-d5c8d7bae5c6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "DELETE /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments/9ff4ba39-d5be-4514-8dac-561bb4b9e67e" status: 400 len: 269 microversion: 2.1 time: 171.433769 Mar 08 15:06:04.799860 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1007/2097] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Mar 8 15:03:13 2022] DELETE /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments/9ff4ba39-d5be-4514-8dac-561bb4b9e67e => generated 269 bytes in 171435 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Mar 08 15:06:04.805755 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-90c773d3-76f1-469f-9a15-850fe436ead5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:06:04.806392 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-90c773d3-76f1-469f-9a15-850fe436ead5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:06:04.813466 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-90c773d3-76f1-469f-9a15-850fe436ead5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:06:04.813933 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-90c773d3-76f1-469f-9a15-850fe436ead5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:06:04.814711 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-90c773d3-76f1-469f-9a15-850fe436ead5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:06:04.815146 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-90c773d3-76f1-469f-9a15-850fe436ead5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:06:04.875682 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-90c773d3-76f1-469f-9a15-850fe436ead5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:06:04.883425 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-90c773d3-76f1-469f-9a15-850fe436ead5 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.081927 Mar 08 15:06:04.883984 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1008/2098] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:06:04 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:06:04.888424 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-63870df1-57e5-4dfd-92d6-b138fce094f6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:06:04.889051 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-63870df1-57e5-4dfd-92d6-b138fce094f6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:06:04.894631 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-63870df1-57e5-4dfd-92d6-b138fce094f6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:06:04.894946 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-63870df1-57e5-4dfd-92d6-b138fce094f6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:06:04.895839 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-63870df1-57e5-4dfd-92d6-b138fce094f6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:06:04.896280 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-63870df1-57e5-4dfd-92d6-b138fce094f6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:06:04.904329 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.objects.instance [None req-2be7e732-d1f1-45ba-8729-e7484d4307d4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lazy-loading 'services' on Instance uuid 251780d0-025f-4a29-b292-9a73dce671e6 {{(pid=128351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 15:06:05.040266 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-63870df1-57e5-4dfd-92d6-b138fce094f6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:06:05.048606 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-63870df1-57e5-4dfd-92d6-b138fce094f6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.163598 Mar 08 15:06:05.049433 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1009/2099] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:06:04 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:06:05.054290 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5b66f374-9e7e-445b-929d-252829c3ceef tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:06:05.054776 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5b66f374-9e7e-445b-929d-252829c3ceef tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:06:05.060209 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5b66f374-9e7e-445b-929d-252829c3ceef tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:06:05.060654 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5b66f374-9e7e-445b-929d-252829c3ceef tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:06:05.061414 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5b66f374-9e7e-445b-929d-252829c3ceef tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:06:05.061847 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5b66f374-9e7e-445b-929d-252829c3ceef tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:06:20.235589 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 15:06:20.236268 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: Tue Mar 8 15:06:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments/9ff4ba39-d5be-4514-8dac-561bb4b9e67e (ip 10.222.0.30) !!! Mar 08 15:06:20.939871 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 15:06:20.940087 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: Tue Mar 8 15:06:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments/9ff4ba39-d5be-4514-8dac-561bb4b9e67e (ip 10.222.0.30) !!! Mar 08 15:07:45.490806 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 15:07:45.491626 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: Tue Mar 8 15:07:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments/9ff4ba39-d5be-4514-8dac-561bb4b9e67e (ip 10.222.0.30) !!! Mar 08 15:08:04.980928 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 15:08:04.981426 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: Tue Mar 8 15:08:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments/9ff4ba39-d5be-4514-8dac-561bb4b9e67e (ip 10.222.0.30) !!! Mar 08 15:08:05.116389 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.wsgi [None req-2be7e732-d1f1-45ba-8729-e7484d4307d4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-29c3a0f0-4a72-4166-bd7c-84414e55d0d0) Mar 08 15:08:05.117052 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-2be7e732-d1f1-45ba-8729-e7484d4307d4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-29c3a0f0-4a72-4166-bd7c-84414e55d0d0) {{(pid=128351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:08:05.117995 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-2be7e732-d1f1-45ba-8729-e7484d4307d4 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "DELETE /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments/9ff4ba39-d5be-4514-8dac-561bb4b9e67e" status: 400 len: 269 microversion: 2.1 time: 231.512305 Mar 08 15:08:05.118756 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1091/2100] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Mar 8 15:04:13 2022] DELETE /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments/9ff4ba39-d5be-4514-8dac-561bb4b9e67e => generated 269 bytes in 231513 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 08 15:08:05.124072 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-09a39f1d-b8ee-4a0b-bf35-ef5305ebd815 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:08:05.124683 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-09a39f1d-b8ee-4a0b-bf35-ef5305ebd815 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:08:05.132864 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-09a39f1d-b8ee-4a0b-bf35-ef5305ebd815 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:08:05.133326 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-09a39f1d-b8ee-4a0b-bf35-ef5305ebd815 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:08:05.134148 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-09a39f1d-b8ee-4a0b-bf35-ef5305ebd815 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:08:05.134595 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-09a39f1d-b8ee-4a0b-bf35-ef5305ebd815 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:08:05.163666 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.objects.instance [None req-5b66f374-9e7e-445b-929d-252829c3ceef tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lazy-loading 'services' on Instance uuid 251780d0-025f-4a29-b292-9a73dce671e6 {{(pid=128352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 15:08:05.196650 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-09a39f1d-b8ee-4a0b-bf35-ef5305ebd815 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:08:05.204038 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-09a39f1d-b8ee-4a0b-bf35-ef5305ebd815 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1226 microversion: 2.1 time: 0.084390 Mar 08 15:08:05.204873 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1092/2101] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:08:05 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:08:05.209429 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-8275ba30-0878-48d7-aeb2-d12cfd0ef8ee tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:08:05.210068 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-8275ba30-0878-48d7-aeb2-d12cfd0ef8ee tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:08:05.215690 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8275ba30-0878-48d7-aeb2-d12cfd0ef8ee tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:08:05.216139 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8275ba30-0878-48d7-aeb2-d12cfd0ef8ee tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:08:05.216911 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8275ba30-0878-48d7-aeb2-d12cfd0ef8ee tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:08:05.217373 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-8275ba30-0878-48d7-aeb2-d12cfd0ef8ee tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:08:05.361467 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-8275ba30-0878-48d7-aeb2-d12cfd0ef8ee tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:08:05.369427 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-8275ba30-0878-48d7-aeb2-d12cfd0ef8ee tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.163694 Mar 08 15:08:05.370051 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1093/2102] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:08:05 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:08:05.374624 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-d56146ce-30d3-4e7e-ad64-771372678d2b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:08:05.375117 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-d56146ce-30d3-4e7e-ad64-771372678d2b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:08:05.380879 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d56146ce-30d3-4e7e-ad64-771372678d2b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:08:05.381364 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d56146ce-30d3-4e7e-ad64-771372678d2b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:08:05.382196 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d56146ce-30d3-4e7e-ad64-771372678d2b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:08:05.382636 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d56146ce-30d3-4e7e-ad64-771372678d2b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:08:13.433126 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 15:08:13.433777 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: Tue Mar 8 15:08:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments/9ff4ba39-d5be-4514-8dac-561bb4b9e67e (ip 10.222.0.30) !!! Mar 08 15:08:58.761363 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 15:08:58.762205 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: Tue Mar 8 15:08:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments/9ff4ba39-d5be-4514-8dac-561bb4b9e67e (ip 10.222.0.30) !!! Mar 08 15:09:40.243714 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 15:09:40.244323 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: Tue Mar 8 15:09:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments/9ff4ba39-d5be-4514-8dac-561bb4b9e67e (ip 10.222.0.30) !!! Mar 08 15:09:40.947843 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 15:09:40.948007 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: Tue Mar 8 15:09:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments/9ff4ba39-d5be-4514-8dac-561bb4b9e67e (ip 10.222.0.30) !!! Mar 08 15:10:05.481553 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-5b66f374-9e7e-445b-929d-252829c3ceef tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a46a4d3a-689e-4887-b992-a6acf5c6a104) Mar 08 15:10:05.482235 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5b66f374-9e7e-445b-929d-252829c3ceef tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a46a4d3a-689e-4887-b992-a6acf5c6a104) {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:10:05.483218 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5b66f374-9e7e-445b-929d-252829c3ceef tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "DELETE /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments/9ff4ba39-d5be-4514-8dac-561bb4b9e67e" status: 400 len: 269 microversion: 2.1 time: 240.432810 Mar 08 15:10:05.483885 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1010/2103] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Mar 8 15:06:05 2022] DELETE /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments/9ff4ba39-d5be-4514-8dac-561bb4b9e67e => generated 269 bytes in 240434 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 08 15:10:05.528983 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.objects.instance [None req-d56146ce-30d3-4e7e-ad64-771372678d2b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lazy-loading 'services' on Instance uuid 251780d0-025f-4a29-b292-9a73dce671e6 {{(pid=128351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 15:10:05.607924 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-e76b9171-8bcb-4236-9064-c91cbf575df1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:10:05.608629 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-e76b9171-8bcb-4236-9064-c91cbf575df1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:10:05.614563 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e76b9171-8bcb-4236-9064-c91cbf575df1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:10:05.615166 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e76b9171-8bcb-4236-9064-c91cbf575df1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:10:05.616021 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e76b9171-8bcb-4236-9064-c91cbf575df1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:10:05.616529 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e76b9171-8bcb-4236-9064-c91cbf575df1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:10:05.646528 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e76b9171-8bcb-4236-9064-c91cbf575df1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:10:05.646977 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e76b9171-8bcb-4236-9064-c91cbf575df1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:10:05.647424 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.objects.instance [None req-e76b9171-8bcb-4236-9064-c91cbf575df1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lazy-loading 'fault' on Instance uuid 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a {{(pid=128352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 15:10:05.688693 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-e76b9171-8bcb-4236-9064-c91cbf575df1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eebbc0c8574cd58c022f2cc0e9f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce506c63f16445cac166f16104398cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:10:05.697770 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-e76b9171-8bcb-4236-9064-c91cbf575df1 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 200 len: 1231 microversion: 2.1 time: 0.212899 Mar 08 15:10:05.698381 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1011/2104] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:10:05 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 1231 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:10:05.703516 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-7e3246cc-09b6-4909-b35d-7d452f604406 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:10:05.704196 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-7e3246cc-09b6-4909-b35d-7d452f604406 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:10:05.710431 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7e3246cc-09b6-4909-b35d-7d452f604406 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:10:05.710883 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7e3246cc-09b6-4909-b35d-7d452f604406 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:10:05.712630 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7e3246cc-09b6-4909-b35d-7d452f604406 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:10:05.713082 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7e3246cc-09b6-4909-b35d-7d452f604406 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:10:05.862869 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-7e3246cc-09b6-4909-b35d-7d452f604406 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:10:05.870825 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-7e3246cc-09b6-4909-b35d-7d452f604406 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.171186 Mar 08 15:10:05.871393 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1012/2105] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:10:05 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:10:05.876047 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-2e4c2645-806b-4581-8f50-a44d0c4c43b7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:10:05.876780 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-2e4c2645-806b-4581-8f50-a44d0c4c43b7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:10:05.882677 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2e4c2645-806b-4581-8f50-a44d0c4c43b7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:10:05.883181 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2e4c2645-806b-4581-8f50-a44d0c4c43b7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:10:05.883965 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2e4c2645-806b-4581-8f50-a44d0c4c43b7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:10:05.884405 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2e4c2645-806b-4581-8f50-a44d0c4c43b7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:11:05.498386 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 15:11:05.499167 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: Tue Mar 8 15:11:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments/9ff4ba39-d5be-4514-8dac-561bb4b9e67e (ip 10.222.0.30) !!! Mar 08 15:11:21.616412 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.wsgi [None req-d56146ce-30d3-4e7e-ad64-771372678d2b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4ccdb78d-8617-4ba2-ae06-7c5c63495686) Mar 08 15:11:21.617110 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-d56146ce-30d3-4e7e-ad64-771372678d2b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4ccdb78d-8617-4ba2-ae06-7c5c63495686) {{(pid=128351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:11:21.618097 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-d56146ce-30d3-4e7e-ad64-771372678d2b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "DELETE /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments/9ff4ba39-d5be-4514-8dac-561bb4b9e67e" status: 400 len: 269 microversion: 2.1 time: 196.247097 Mar 08 15:11:21.618675 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: Tue Mar 8 15:11:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments/9ff4ba39-d5be-4514-8dac-561bb4b9e67e (ip 10.222.0.30) !!! Mar 08 15:11:21.618675 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: Tue Mar 8 15:11:21 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments/9ff4ba39-d5be-4514-8dac-561bb4b9e67e (10.222.0.30) Mar 08 15:11:21.619548 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: CRITICAL nova [None req-d56146ce-30d3-4e7e-ad64-771372678d2b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Unhandled error: OSError: write error Mar 08 15:11:21.619548 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: ERROR nova OSError: write error Mar 08 15:11:21.619548 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: ERROR nova Mar 08 15:11:21.619785 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1094/2106] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Mar 8 15:08:05 2022] DELETE /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments/9ff4ba39-d5be-4514-8dac-561bb4b9e67e => generated 0 bytes in 196249 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Mar 08 15:11:21.625536 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-cbfd5e75-5e2b-4938-b92d-45b38253e39e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:11:21.626230 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-cbfd5e75-5e2b-4938-b92d-45b38253e39e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:11:21.632510 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cbfd5e75-5e2b-4938-b92d-45b38253e39e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:11:21.632973 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cbfd5e75-5e2b-4938-b92d-45b38253e39e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:11:21.633744 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cbfd5e75-5e2b-4938-b92d-45b38253e39e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:11:21.634226 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cbfd5e75-5e2b-4938-b92d-45b38253e39e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:11:21.647250 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.wsgi [None req-cbfd5e75-5e2b-4938-b92d-45b38253e39e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] HTTP exception thrown: Instance 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a could not be found. Mar 08 15:11:21.647913 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-cbfd5e75-5e2b-4938-b92d-45b38253e39e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Returning 404 to user: Instance 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a could not be found. {{(pid=128351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:11:21.648751 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-cbfd5e75-5e2b-4938-b92d-45b38253e39e tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 404 len: 111 microversion: 2.1 time: 0.027611 Mar 08 15:11:21.649316 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1095/2107] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:11:21 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 15:11:21.654359 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-493d2130-a840-492a-bd87-0ff8d71f8603 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:11:21.654966 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-493d2130-a840-492a-bd87-0ff8d71f8603 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:11:21.660756 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-493d2130-a840-492a-bd87-0ff8d71f8603 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:11:21.661253 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-493d2130-a840-492a-bd87-0ff8d71f8603 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:11:21.662055 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-493d2130-a840-492a-bd87-0ff8d71f8603 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:11:21.662494 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-493d2130-a840-492a-bd87-0ff8d71f8603 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:11:21.765465 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.objects.instance [None req-2e4c2645-806b-4581-8f50-a44d0c4c43b7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lazy-loading 'services' on Instance uuid 251780d0-025f-4a29-b292-9a73dce671e6 {{(pid=128352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 15:11:21.802015 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-493d2130-a840-492a-bd87-0ff8d71f8603 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:11:21.810301 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-493d2130-a840-492a-bd87-0ff8d71f8603 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.159739 Mar 08 15:11:21.810922 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1096/2108] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:11:21 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:11:21.815523 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-be13a912-33d4-40db-84c8-a43e56c5024b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:11:21.816087 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-be13a912-33d4-40db-84c8-a43e56c5024b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:11:21.821497 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-be13a912-33d4-40db-84c8-a43e56c5024b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:11:21.821983 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-be13a912-33d4-40db-84c8-a43e56c5024b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:11:21.822752 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-be13a912-33d4-40db-84c8-a43e56c5024b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:11:21.823303 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-be13a912-33d4-40db-84c8-a43e56c5024b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:11:24.988794 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 15:11:24.989312 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: Tue Mar 8 15:11:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments/9ff4ba39-d5be-4514-8dac-561bb4b9e67e (ip 10.222.0.30) !!! Mar 08 15:11:33.441591 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 15:11:33.442234 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: Tue Mar 8 15:11:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments/9ff4ba39-d5be-4514-8dac-561bb4b9e67e (ip 10.222.0.30) !!! Mar 08 15:12:05.879446 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-2e4c2645-806b-4581-8f50-a44d0c4c43b7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0332d693-0579-4ae5-b7f7-6fcbd9bb5349) Mar 08 15:12:05.880058 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-2e4c2645-806b-4581-8f50-a44d0c4c43b7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0332d693-0579-4ae5-b7f7-6fcbd9bb5349) {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:12:05.880888 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-2e4c2645-806b-4581-8f50-a44d0c4c43b7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "DELETE /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments/9ff4ba39-d5be-4514-8dac-561bb4b9e67e" status: 400 len: 269 microversion: 2.1 time: 120.008562 Mar 08 15:12:05.881436 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1013/2109] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Mar 8 15:10:05 2022] DELETE /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments/9ff4ba39-d5be-4514-8dac-561bb4b9e67e => generated 269 bytes in 120009 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 08 15:12:05.886972 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-be8bf533-c974-430f-8c57-d493cbdb98a0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:12:05.887610 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-be8bf533-c974-430f-8c57-d493cbdb98a0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:12:05.895373 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-be8bf533-c974-430f-8c57-d493cbdb98a0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:12:05.895824 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-be8bf533-c974-430f-8c57-d493cbdb98a0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:12:05.896591 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-be8bf533-c974-430f-8c57-d493cbdb98a0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:12:05.897023 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-be8bf533-c974-430f-8c57-d493cbdb98a0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:12:05.910793 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-be8bf533-c974-430f-8c57-d493cbdb98a0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] HTTP exception thrown: Instance 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a could not be found. Mar 08 15:12:05.911376 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-be8bf533-c974-430f-8c57-d493cbdb98a0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Returning 404 to user: Instance 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a could not be found. {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:12:05.912193 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-be8bf533-c974-430f-8c57-d493cbdb98a0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 404 len: 111 microversion: 2.1 time: 0.029654 Mar 08 15:12:05.912719 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1014/2110] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:12:05 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 15:12:05.917908 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ebf5e4cb-3762-495d-9450-0e6326685a40 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:12:05.918526 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ebf5e4cb-3762-495d-9450-0e6326685a40 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:12:05.924196 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ebf5e4cb-3762-495d-9450-0e6326685a40 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:12:05.924643 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ebf5e4cb-3762-495d-9450-0e6326685a40 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:12:05.925404 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ebf5e4cb-3762-495d-9450-0e6326685a40 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:12:05.925835 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ebf5e4cb-3762-495d-9450-0e6326685a40 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:12:06.033227 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.objects.instance [None req-be13a912-33d4-40db-84c8-a43e56c5024b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lazy-loading 'services' on Instance uuid 251780d0-025f-4a29-b292-9a73dce671e6 {{(pid=128351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 15:12:06.066530 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ebf5e4cb-3762-495d-9450-0e6326685a40 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:12:06.074307 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ebf5e4cb-3762-495d-9450-0e6326685a40 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1447 microversion: 2.1 time: 0.160622 Mar 08 15:12:06.074877 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1015/2111] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:12:05 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1447 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:12:06.079474 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-adef4082-925a-4eae-9fd5-71eeae7bf31b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:12:06.080013 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-adef4082-925a-4eae-9fd5-71eeae7bf31b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:12:06.085611 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-adef4082-925a-4eae-9fd5-71eeae7bf31b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:12:06.086099 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-adef4082-925a-4eae-9fd5-71eeae7bf31b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:12:06.086867 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-adef4082-925a-4eae-9fd5-71eeae7bf31b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:12:06.087300 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-adef4082-925a-4eae-9fd5-71eeae7bf31b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:12:18.770550 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 15:12:18.771335 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: Tue Mar 8 15:12:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments/9ff4ba39-d5be-4514-8dac-561bb4b9e67e (ip 10.222.0.30) !!! Mar 08 15:13:00.251439 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 15:13:00.252046 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: Tue Mar 8 15:13:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments/9ff4ba39-d5be-4514-8dac-561bb4b9e67e (ip 10.222.0.30) !!! Mar 08 15:13:00.955815 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 15:13:00.955963 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: Tue Mar 8 15:13:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments/9ff4ba39-d5be-4514-8dac-561bb4b9e67e (ip 10.222.0.30) !!! Mar 08 15:13:21.977378 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.wsgi [None req-be13a912-33d4-40db-84c8-a43e56c5024b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5216d9ff-f2bf-477a-b31f-3f81eb40eb3c) Mar 08 15:13:21.978029 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-be13a912-33d4-40db-84c8-a43e56c5024b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5216d9ff-f2bf-477a-b31f-3f81eb40eb3c) {{(pid=128351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:13:21.978882 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-be13a912-33d4-40db-84c8-a43e56c5024b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "DELETE /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments/9ff4ba39-d5be-4514-8dac-561bb4b9e67e" status: 400 len: 269 microversion: 2.1 time: 120.167003 Mar 08 15:13:21.979373 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: Tue Mar 8 15:13:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments/9ff4ba39-d5be-4514-8dac-561bb4b9e67e (ip 10.222.0.30) !!! Mar 08 15:13:21.979373 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: Tue Mar 8 15:13:21 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments/9ff4ba39-d5be-4514-8dac-561bb4b9e67e (10.222.0.30) Mar 08 15:13:21.979944 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: CRITICAL nova [None req-be13a912-33d4-40db-84c8-a43e56c5024b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Unhandled error: OSError: write error Mar 08 15:13:21.979944 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: ERROR nova OSError: write error Mar 08 15:13:21.979944 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: ERROR nova Mar 08 15:13:21.980233 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1097/2112] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Mar 8 15:11:21 2022] DELETE /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments/9ff4ba39-d5be-4514-8dac-561bb4b9e67e => generated 0 bytes in 120169 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Mar 08 15:13:21.987194 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-69043271-232b-48ab-be4d-394b316622d0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:13:21.987811 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-69043271-232b-48ab-be4d-394b316622d0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:13:21.993623 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-69043271-232b-48ab-be4d-394b316622d0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:13:21.994119 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-69043271-232b-48ab-be4d-394b316622d0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:13:21.994887 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-69043271-232b-48ab-be4d-394b316622d0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:13:21.995351 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-69043271-232b-48ab-be4d-394b316622d0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:13:22.011549 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.wsgi [None req-69043271-232b-48ab-be4d-394b316622d0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] HTTP exception thrown: Instance 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a could not be found. Mar 08 15:13:22.012228 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-69043271-232b-48ab-be4d-394b316622d0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Returning 404 to user: Instance 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a could not be found. {{(pid=128351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:13:22.013691 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-69043271-232b-48ab-be4d-394b316622d0 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 404 len: 111 microversion: 2.1 time: 0.032197 Mar 08 15:13:22.014544 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1098/2113] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:13:21 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 15:13:22.019052 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-47655953-fb8b-4362-8fb6-9170fb1d550f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:13:22.019656 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-47655953-fb8b-4362-8fb6-9170fb1d550f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:13:22.025158 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-47655953-fb8b-4362-8fb6-9170fb1d550f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:13:22.025608 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-47655953-fb8b-4362-8fb6-9170fb1d550f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:13:22.026476 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-47655953-fb8b-4362-8fb6-9170fb1d550f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:13:22.026918 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-47655953-fb8b-4362-8fb6-9170fb1d550f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:13:22.040837 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.objects.instance [None req-adef4082-925a-4eae-9fd5-71eeae7bf31b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lazy-loading 'services' on Instance uuid 251780d0-025f-4a29-b292-9a73dce671e6 {{(pid=128352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 15:13:22.230818 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-47655953-fb8b-4362-8fb6-9170fb1d550f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:13:22.238152 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-47655953-fb8b-4362-8fb6-9170fb1d550f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1441 microversion: 2.1 time: 0.222482 Mar 08 15:13:22.238734 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1099/2114] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:13:22 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1441 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:13:22.243599 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-e6839d8b-8dc5-4c52-8669-6333639aa353 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:13:22.244194 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-e6839d8b-8dc5-4c52-8669-6333639aa353 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: ecac51d1-33c3-49df-9926-d953f7315f52] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:13:22.250652 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e6839d8b-8dc5-4c52-8669-6333639aa353 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:13:22.251106 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e6839d8b-8dc5-4c52-8669-6333639aa353 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:13:22.252074 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e6839d8b-8dc5-4c52-8669-6333639aa353 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:13:22.252689 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e6839d8b-8dc5-4c52-8669-6333639aa353 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:13:22.403268 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-adef4082-925a-4eae-9fd5-71eeae7bf31b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-14905763-4eb9-4355-add8-1655f192580c) Mar 08 15:13:22.403974 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-adef4082-925a-4eae-9fd5-71eeae7bf31b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-14905763-4eb9-4355-add8-1655f192580c) {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:13:22.404921 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-adef4082-925a-4eae-9fd5-71eeae7bf31b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "DELETE /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments/9ff4ba39-d5be-4514-8dac-561bb4b9e67e" status: 400 len: 269 microversion: 2.1 time: 76.329136 Mar 08 15:13:22.405475 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1016/2115] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Mar 8 15:12:06 2022] DELETE /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments/9ff4ba39-d5be-4514-8dac-561bb4b9e67e => generated 269 bytes in 76330 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 08 15:13:22.461570 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.objects.instance [None req-e6839d8b-8dc5-4c52-8669-6333639aa353 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lazy-loading 'services' on Instance uuid ecac51d1-33c3-49df-9926-d953f7315f52 {{(pid=128351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 15:13:22.485795 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-98d2fc29-51c0-4c76-8019-396ca4fa9af4 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:13:22.486369 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-98d2fc29-51c0-4c76-8019-396ca4fa9af4 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:13:22.495745 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-98d2fc29-51c0-4c76-8019-396ca4fa9af4 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:13:22.495745 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-98d2fc29-51c0-4c76-8019-396ca4fa9af4 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:13:22.495745 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-98d2fc29-51c0-4c76-8019-396ca4fa9af4 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:13:22.495745 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-98d2fc29-51c0-4c76-8019-396ca4fa9af4 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:13:22.518823 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-98d2fc29-51c0-4c76-8019-396ca4fa9af4 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42] Going to try to terminate instance {{(pid=128352) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 15:13:22.552830 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-e6839d8b-8dc5-4c52-8669-6333639aa353 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52/os-volume_attachments/67fc183b-4d10-4f71-9e5d-14819fc5becd" status: 202 len: 0 microversion: 2.1 time: 0.312497 Mar 08 15:13:22.553669 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1100/2116] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Mar 8 15:13:22 2022] DELETE /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52/os-volume_attachments/67fc183b-4d10-4f71-9e5d-14819fc5becd => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 15:13:22.560495 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-864922a4-0cb8-4ab9-a974-56066e707a61 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:13:22.562447 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-864922a4-0cb8-4ab9-a974-56066e707a61 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:13:22.570276 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-864922a4-0cb8-4ab9-a974-56066e707a61 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:13:22.571042 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-864922a4-0cb8-4ab9-a974-56066e707a61 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:13:22.572321 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-864922a4-0cb8-4ab9-a974-56066e707a61 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:13:22.573071 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-864922a4-0cb8-4ab9-a974-56066e707a61 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:13:22.633352 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-98d2fc29-51c0-4c76-8019-396ca4fa9af4 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42" status: 204 len: 0 microversion: 2.1 time: 0.226113 Mar 08 15:13:22.635014 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1017/2117] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 15:13:22 2022] DELETE /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 15:13:22.642891 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ef659888-3f02-4423-8f9b-d894c0eb1122 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:13:22.644239 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ef659888-3f02-4423-8f9b-d894c0eb1122 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:13:22.653005 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ef659888-3f02-4423-8f9b-d894c0eb1122 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:13:22.654455 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ef659888-3f02-4423-8f9b-d894c0eb1122 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:13:22.655587 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ef659888-3f02-4423-8f9b-d894c0eb1122 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:13:22.656027 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ef659888-3f02-4423-8f9b-d894c0eb1122 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:13:22.673040 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-ef659888-3f02-4423-8f9b-d894c0eb1122 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] HTTP exception thrown: Instance 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a could not be found. Mar 08 15:13:22.673640 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ef659888-3f02-4423-8f9b-d894c0eb1122 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Returning 404 to user: Instance 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a could not be found. {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:13:22.674558 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ef659888-3f02-4423-8f9b-d894c0eb1122 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 404 len: 111 microversion: 2.1 time: 0.038004 Mar 08 15:13:22.675821 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1018/2118] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:13:22 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 15:13:22.684330 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-4c0d7739-4692-41a8-9165-3c6fd8de7bba tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:13:22.685110 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-4c0d7739-4692-41a8-9165-3c6fd8de7bba tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:13:22.696915 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4c0d7739-4692-41a8-9165-3c6fd8de7bba tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:13:22.697450 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4c0d7739-4692-41a8-9165-3c6fd8de7bba tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:13:22.698743 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4c0d7739-4692-41a8-9165-3c6fd8de7bba tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:13:22.701617 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4c0d7739-4692-41a8-9165-3c6fd8de7bba tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:13:22.760879 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.objects.instance [None req-864922a4-0cb8-4ab9-a974-56066e707a61 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lazy-loading 'services' on Instance uuid 251780d0-025f-4a29-b292-9a73dce671e6 {{(pid=128351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 15:13:22.811648 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-4c0d7739-4692-41a8-9165-3c6fd8de7bba tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:13:22.822502 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-4c0d7739-4692-41a8-9165-3c6fd8de7bba tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1374 microversion: 2.1 time: 0.145091 Mar 08 15:13:22.823394 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1019/2119] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:13:22 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1374 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:13:22.829188 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-be1caf29-c1d5-4a04-a81f-c0b52b260755 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:13:22.829978 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-be1caf29-c1d5-4a04-a81f-c0b52b260755 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: ecac51d1-33c3-49df-9926-d953f7315f52] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:13:22.837140 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-be1caf29-c1d5-4a04-a81f-c0b52b260755 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:13:22.837598 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-be1caf29-c1d5-4a04-a81f-c0b52b260755 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:13:22.838429 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-be1caf29-c1d5-4a04-a81f-c0b52b260755 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:13:22.838865 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-be1caf29-c1d5-4a04-a81f-c0b52b260755 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:13:22.891128 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.wsgi [None req-864922a4-0cb8-4ab9-a974-56066e707a61 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8c757b8e-5a38-42d4-8a92-8203f6863db8) Mar 08 15:13:22.891931 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-864922a4-0cb8-4ab9-a974-56066e707a61 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8c757b8e-5a38-42d4-8a92-8203f6863db8) {{(pid=128351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:13:22.892943 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-864922a4-0cb8-4ab9-a974-56066e707a61 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "DELETE /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments/9ff4ba39-d5be-4514-8dac-561bb4b9e67e" status: 400 len: 269 microversion: 2.1 time: 0.337456 Mar 08 15:13:22.893974 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1101/2120] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Mar 8 15:13:22 2022] DELETE /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments/9ff4ba39-d5be-4514-8dac-561bb4b9e67e => generated 269 bytes in 339 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 08 15:13:22.899783 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-a1c5b4d6-895d-4a52-8164-45e43fc19a9c tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:13:22.900501 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-a1c5b4d6-895d-4a52-8164-45e43fc19a9c tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:13:22.909171 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a1c5b4d6-895d-4a52-8164-45e43fc19a9c tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:13:22.909642 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a1c5b4d6-895d-4a52-8164-45e43fc19a9c tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:13:22.910460 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a1c5b4d6-895d-4a52-8164-45e43fc19a9c tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:13:22.910900 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a1c5b4d6-895d-4a52-8164-45e43fc19a9c tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:13:22.935985 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-a1c5b4d6-895d-4a52-8164-45e43fc19a9c tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42] Going to try to terminate instance {{(pid=128351) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 15:13:22.979774 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.compute.api [None req-a1c5b4d6-895d-4a52-8164-45e43fc19a9c tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42] Instance is already in deleting state, ignoring this request Mar 08 15:13:22.980579 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-a1c5b4d6-895d-4a52-8164-45e43fc19a9c tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42" status: 204 len: 0 microversion: 2.1 time: 0.085523 Mar 08 15:13:22.981122 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1102/2121] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 15:13:22 2022] DELETE /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 15:13:22.985750 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-68c55139-88e9-4633-80ae-eee3dcfd904e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:13:22.986262 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-68c55139-88e9-4633-80ae-eee3dcfd904e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:13:22.991473 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-68c55139-88e9-4633-80ae-eee3dcfd904e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:13:22.991922 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-68c55139-88e9-4633-80ae-eee3dcfd904e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:13:22.992676 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-68c55139-88e9-4633-80ae-eee3dcfd904e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:13:22.993110 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-68c55139-88e9-4633-80ae-eee3dcfd904e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:14:06.139101 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.objects.instance [None req-be1caf29-c1d5-4a04-a81f-c0b52b260755 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lazy-loading 'services' on Instance uuid ecac51d1-33c3-49df-9926-d953f7315f52 {{(pid=128352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 15:14:06.180902 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.objects.instance [None req-68c55139-88e9-4633-80ae-eee3dcfd904e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lazy-loading 'services' on Instance uuid 251780d0-025f-4a29-b292-9a73dce671e6 {{(pid=128351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 15:14:25.506161 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 15:14:25.506736 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: Tue Mar 8 15:14:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52/os-volume_attachments/67fc183b-4d10-4f71-9e5d-14819fc5becd (ip 10.222.0.30) !!! Mar 08 15:14:44.996634 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 15:14:44.997183 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: Tue Mar 8 15:14:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments/9ff4ba39-d5be-4514-8dac-561bb4b9e67e (ip 10.222.0.30) !!! Mar 08 15:15:23.029118 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-be1caf29-c1d5-4a04-a81f-c0b52b260755 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-80f229b8-8213-48eb-8931-8ed06c92de7e) Mar 08 15:15:23.029725 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-be1caf29-c1d5-4a04-a81f-c0b52b260755 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-80f229b8-8213-48eb-8931-8ed06c92de7e) {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:15:23.030612 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-be1caf29-c1d5-4a04-a81f-c0b52b260755 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52/os-volume_attachments/67fc183b-4d10-4f71-9e5d-14819fc5becd" status: 400 len: 269 microversion: 2.1 time: 120.206127 Mar 08 15:15:23.031162 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1020/2122] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Mar 8 15:13:22 2022] DELETE /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52/os-volume_attachments/67fc183b-4d10-4f71-9e5d-14819fc5becd => generated 269 bytes in 120207 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 08 15:15:23.117610 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f5895536-ae09-4e76-83ff-23145cbbf11b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:15:23.118398 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f5895536-ae09-4e76-83ff-23145cbbf11b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:15:23.124931 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f5895536-ae09-4e76-83ff-23145cbbf11b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:15:23.125475 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f5895536-ae09-4e76-83ff-23145cbbf11b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:15:23.126366 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f5895536-ae09-4e76-83ff-23145cbbf11b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:15:23.127035 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f5895536-ae09-4e76-83ff-23145cbbf11b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:15:23.141650 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-f5895536-ae09-4e76-83ff-23145cbbf11b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] HTTP exception thrown: Instance 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a could not be found. Mar 08 15:15:23.141811 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.wsgi [None req-68c55139-88e9-4633-80ae-eee3dcfd904e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6f799bd4-3fb1-4e43-bc15-cbf307fa5b96) Mar 08 15:15:23.142492 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-68c55139-88e9-4633-80ae-eee3dcfd904e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6f799bd4-3fb1-4e43-bc15-cbf307fa5b96) {{(pid=128351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:15:23.143766 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-68c55139-88e9-4633-80ae-eee3dcfd904e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "DELETE /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments/9ff4ba39-d5be-4514-8dac-561bb4b9e67e" status: 400 len: 269 microversion: 2.1 time: 120.161240 Mar 08 15:15:23.144278 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f5895536-ae09-4e76-83ff-23145cbbf11b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Returning 404 to user: Instance 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a could not be found. {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:15:23.144589 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1103/2123] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Mar 8 15:13:22 2022] DELETE /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments/9ff4ba39-d5be-4514-8dac-561bb4b9e67e => generated 269 bytes in 120163 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 08 15:15:23.145319 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f5895536-ae09-4e76-83ff-23145cbbf11b tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 404 len: 111 microversion: 2.1 time: 0.113246 Mar 08 15:15:23.146447 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1021/2124] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:15:23 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 15:15:23.151448 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-8fd1926b-aa15-4315-a386-780985850be8 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:15:23.151679 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-9fc39ba1-977b-4114-b4cf-86ec7467562d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:15:23.151938 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-8fd1926b-aa15-4315-a386-780985850be8 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: ecac51d1-33c3-49df-9926-d953f7315f52] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:15:23.152296 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-9fc39ba1-977b-4114-b4cf-86ec7467562d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:15:23.158726 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9fc39ba1-977b-4114-b4cf-86ec7467562d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:15:23.159604 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8fd1926b-aa15-4315-a386-780985850be8 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:15:23.159766 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9fc39ba1-977b-4114-b4cf-86ec7467562d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:15:23.160213 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8fd1926b-aa15-4315-a386-780985850be8 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:15:23.160556 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9fc39ba1-977b-4114-b4cf-86ec7467562d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:15:23.161000 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9fc39ba1-977b-4114-b4cf-86ec7467562d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:15:23.162015 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8fd1926b-aa15-4315-a386-780985850be8 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:15:23.162727 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8fd1926b-aa15-4315-a386-780985850be8 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:15:23.230824 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-9fc39ba1-977b-4114-b4cf-86ec7467562d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:15:23.238511 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-9fc39ba1-977b-4114-b4cf-86ec7467562d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1212 microversion: 2.1 time: 0.092796 Mar 08 15:15:23.239172 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1104/2125] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:15:23 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 1212 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:15:23.244978 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-6e027e76-9333-4bc3-882e-9ed37d84b783 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:15:23.245488 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-6e027e76-9333-4bc3-882e-9ed37d84b783 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:15:23.251419 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6e027e76-9333-4bc3-882e-9ed37d84b783 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:15:23.251988 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6e027e76-9333-4bc3-882e-9ed37d84b783 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:15:23.253785 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6e027e76-9333-4bc3-882e-9ed37d84b783 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:15:23.253936 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6e027e76-9333-4bc3-882e-9ed37d84b783 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:15:23.269446 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.wsgi [None req-6e027e76-9333-4bc3-882e-9ed37d84b783 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] HTTP exception thrown: Instance 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 could not be found. Mar 08 15:15:23.270090 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-6e027e76-9333-4bc3-882e-9ed37d84b783 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Returning 404 to user: Instance 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 could not be found. {{(pid=128351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:15:23.270916 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-6e027e76-9333-4bc3-882e-9ed37d84b783 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42" status: 404 len: 111 microversion: 2.1 time: 0.030651 Mar 08 15:15:23.271816 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1105/2126] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 15:15:23 2022] DELETE /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 15:15:23.276515 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-ac4d0b42-18d0-4cf6-bff7-b6f1faeca5fc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:15:23.277009 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-ac4d0b42-18d0-4cf6-bff7-b6f1faeca5fc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:15:23.283030 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ac4d0b42-18d0-4cf6-bff7-b6f1faeca5fc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:15:23.283488 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ac4d0b42-18d0-4cf6-bff7-b6f1faeca5fc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:15:23.284757 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ac4d0b42-18d0-4cf6-bff7-b6f1faeca5fc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:15:23.285316 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ac4d0b42-18d0-4cf6-bff7-b6f1faeca5fc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:15:38.778959 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 15:15:38.780066 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: Tue Mar 8 15:15:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments/9ff4ba39-d5be-4514-8dac-561bb4b9e67e (ip 10.222.0.30) !!! Mar 08 15:16:06.312339 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.objects.instance [None req-8fd1926b-aa15-4315-a386-780985850be8 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lazy-loading 'services' on Instance uuid ecac51d1-33c3-49df-9926-d953f7315f52 {{(pid=128352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 15:16:06.351296 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.objects.instance [None req-ac4d0b42-18d0-4cf6-bff7-b6f1faeca5fc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lazy-loading 'services' on Instance uuid 251780d0-025f-4a29-b292-9a73dce671e6 {{(pid=128351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 15:16:20.259097 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 15:16:20.259695 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: Tue Mar 8 15:16:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52/os-volume_attachments/67fc183b-4d10-4f71-9e5d-14819fc5becd (ip 10.222.0.30) !!! Mar 08 15:16:20.964263 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 15:16:20.964413 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: Tue Mar 8 15:16:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52/os-volume_attachments/67fc183b-4d10-4f71-9e5d-14819fc5becd (ip 10.222.0.30) !!! Mar 08 15:16:33.452487 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 15:16:33.453102 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: Tue Mar 8 15:16:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments/9ff4ba39-d5be-4514-8dac-561bb4b9e67e (ip 10.222.0.30) !!! Mar 08 15:17:23.965364 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-8fd1926b-aa15-4315-a386-780985850be8 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4ca15db8-c666-441a-a1a9-1faf90ce2904) Mar 08 15:17:23.965998 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-8fd1926b-aa15-4315-a386-780985850be8 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4ca15db8-c666-441a-a1a9-1faf90ce2904) {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:17:23.966885 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-8fd1926b-aa15-4315-a386-780985850be8 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52/os-volume_attachments/67fc183b-4d10-4f71-9e5d-14819fc5becd" status: 400 len: 269 microversion: 2.1 time: 120.819332 Mar 08 15:17:23.967383 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: Tue Mar 8 15:17:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52/os-volume_attachments/67fc183b-4d10-4f71-9e5d-14819fc5becd (ip 10.222.0.30) !!! Mar 08 15:17:23.967383 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: Tue Mar 8 15:17:23 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52/os-volume_attachments/67fc183b-4d10-4f71-9e5d-14819fc5becd (10.222.0.30) Mar 08 15:17:23.968180 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: CRITICAL nova [None req-8fd1926b-aa15-4315-a386-780985850be8 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Unhandled error: OSError: write error Mar 08 15:17:23.968180 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: ERROR nova OSError: write error Mar 08 15:17:23.968180 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: ERROR nova Mar 08 15:17:23.968460 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1022/2127] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Mar 8 15:15:23 2022] DELETE /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52/os-volume_attachments/67fc183b-4d10-4f71-9e5d-14819fc5becd => generated 0 bytes in 120821 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Mar 08 15:17:23.973670 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-357cdefd-c934-44fc-8198-379f28319878 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:17:23.974394 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-357cdefd-c934-44fc-8198-379f28319878 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:17:23.981085 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-357cdefd-c934-44fc-8198-379f28319878 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:17:23.981538 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-357cdefd-c934-44fc-8198-379f28319878 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:17:23.982514 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-357cdefd-c934-44fc-8198-379f28319878 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:17:23.982952 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-357cdefd-c934-44fc-8198-379f28319878 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:17:24.055885 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.wsgi [None req-ac4d0b42-18d0-4cf6-bff7-b6f1faeca5fc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1180170a-f05a-4dcb-9674-905855b75ed9) Mar 08 15:17:24.056625 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-ac4d0b42-18d0-4cf6-bff7-b6f1faeca5fc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1180170a-f05a-4dcb-9674-905855b75ed9) {{(pid=128351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:17:24.057482 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-ac4d0b42-18d0-4cf6-bff7-b6f1faeca5fc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "DELETE /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments/9ff4ba39-d5be-4514-8dac-561bb4b9e67e" status: 400 len: 269 microversion: 2.1 time: 120.784745 Mar 08 15:17:24.058058 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: Tue Mar 8 15:17:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments/9ff4ba39-d5be-4514-8dac-561bb4b9e67e (ip 10.222.0.30) !!! Mar 08 15:17:24.058058 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: Tue Mar 8 15:17:24 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments/9ff4ba39-d5be-4514-8dac-561bb4b9e67e (10.222.0.30) Mar 08 15:17:24.059530 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: CRITICAL nova [None req-ac4d0b42-18d0-4cf6-bff7-b6f1faeca5fc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Unhandled error: OSError: write error Mar 08 15:17:24.059530 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: ERROR nova OSError: write error Mar 08 15:17:24.059530 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: ERROR nova Mar 08 15:17:24.059781 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1106/2128] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Mar 8 15:15:23 2022] DELETE /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments/9ff4ba39-d5be-4514-8dac-561bb4b9e67e => generated 0 bytes in 120787 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Mar 08 15:17:24.065654 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-ab1d193e-12da-4cfc-9ec3-9e24eade332b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:17:24.066316 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-ab1d193e-12da-4cfc-9ec3-9e24eade332b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:17:24.073433 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ab1d193e-12da-4cfc-9ec3-9e24eade332b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:17:24.073922 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ab1d193e-12da-4cfc-9ec3-9e24eade332b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:17:24.074722 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ab1d193e-12da-4cfc-9ec3-9e24eade332b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:17:24.075168 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ab1d193e-12da-4cfc-9ec3-9e24eade332b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:17:24.141273 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-ab1d193e-12da-4cfc-9ec3-9e24eade332b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:17:24.149438 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-ab1d193e-12da-4cfc-9ec3-9e24eade332b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1212 microversion: 2.1 time: 0.088296 Mar 08 15:17:24.149999 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: Tue Mar 8 15:17:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 (ip 10.222.0.30) !!! Mar 08 15:17:24.149999 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: Tue Mar 8 15:17:24 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 (10.222.0.30) Mar 08 15:17:24.150592 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: CRITICAL nova [None req-ab1d193e-12da-4cfc-9ec3-9e24eade332b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Unhandled error: OSError: write error Mar 08 15:17:24.150592 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: ERROR nova OSError: write error Mar 08 15:17:24.150592 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: ERROR nova Mar 08 15:17:24.150827 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1107/2129] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:17:24 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 0 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Mar 08 15:17:24.155480 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-170abe97-d6f0-4311-b8f2-ab5c48e03255 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:17:24.155980 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-170abe97-d6f0-4311-b8f2-ab5c48e03255 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: ecac51d1-33c3-49df-9926-d953f7315f52] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:17:24.158144 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-357cdefd-c934-44fc-8198-379f28319878 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] HTTP exception thrown: Instance 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a could not be found. Mar 08 15:17:24.158734 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-357cdefd-c934-44fc-8198-379f28319878 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Returning 404 to user: Instance 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a could not be found. {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:17:24.159763 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-357cdefd-c934-44fc-8198-379f28319878 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 404 len: 111 microversion: 2.1 time: 0.190468 Mar 08 15:17:24.160226 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: Tue Mar 8 15:17:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a (ip 10.222.0.30) !!! Mar 08 15:17:24.160422 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: Tue Mar 8 15:17:24 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a (10.222.0.30) Mar 08 15:17:24.160976 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: CRITICAL nova [None req-357cdefd-c934-44fc-8198-379f28319878 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Unhandled error: OSError: write error Mar 08 15:17:24.160976 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: ERROR nova OSError: write error Mar 08 15:17:24.160976 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: ERROR nova Mar 08 15:17:24.161215 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1023/2130] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:17:23 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 0 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Mar 08 15:17:24.161779 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-170abe97-d6f0-4311-b8f2-ab5c48e03255 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:17:24.162293 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-170abe97-d6f0-4311-b8f2-ab5c48e03255 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:17:24.163075 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-170abe97-d6f0-4311-b8f2-ab5c48e03255 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:17:24.163522 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-170abe97-d6f0-4311-b8f2-ab5c48e03255 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:17:24.166507 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-2dfa6c06-cca8-41d3-98bf-10d945960a15 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:17:24.167004 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-2dfa6c06-cca8-41d3-98bf-10d945960a15 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:17:24.172961 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2dfa6c06-cca8-41d3-98bf-10d945960a15 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:17:24.173512 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2dfa6c06-cca8-41d3-98bf-10d945960a15 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:17:24.174401 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2dfa6c06-cca8-41d3-98bf-10d945960a15 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:17:24.175252 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2dfa6c06-cca8-41d3-98bf-10d945960a15 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:17:24.189088 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-2dfa6c06-cca8-41d3-98bf-10d945960a15 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] HTTP exception thrown: Instance 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 could not be found. Mar 08 15:17:24.189686 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-2dfa6c06-cca8-41d3-98bf-10d945960a15 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Returning 404 to user: Instance 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 could not be found. {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:17:24.190650 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-2dfa6c06-cca8-41d3-98bf-10d945960a15 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42" status: 404 len: 111 microversion: 2.1 time: 0.028622 Mar 08 15:17:24.191200 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1024/2131] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 15:17:24 2022] DELETE /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 15:17:24.196019 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-bc39afad-d159-43c2-af17-3c2825650ebc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:17:24.196628 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-bc39afad-d159-43c2-af17-3c2825650ebc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:17:24.202261 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bc39afad-d159-43c2-af17-3c2825650ebc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:17:24.202717 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bc39afad-d159-43c2-af17-3c2825650ebc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:17:24.203528 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bc39afad-d159-43c2-af17-3c2825650ebc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:17:24.203975 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bc39afad-d159-43c2-af17-3c2825650ebc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:17:45.513672 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 15:17:45.514499 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: Tue Mar 8 15:17:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments/9ff4ba39-d5be-4514-8dac-561bb4b9e67e (ip 10.222.0.30) !!! Mar 08 15:18:05.005014 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 15:18:05.005493 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: Tue Mar 8 15:18:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52/os-volume_attachments/67fc183b-4d10-4f71-9e5d-14819fc5becd (ip 10.222.0.30) !!! Mar 08 15:18:06.605827 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.objects.instance [None req-170abe97-d6f0-4311-b8f2-ab5c48e03255 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lazy-loading 'services' on Instance uuid ecac51d1-33c3-49df-9926-d953f7315f52 {{(pid=128351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 15:18:06.644513 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.objects.instance [None req-bc39afad-d159-43c2-af17-3c2825650ebc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lazy-loading 'services' on Instance uuid 251780d0-025f-4a29-b292-9a73dce671e6 {{(pid=128352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 15:18:58.787305 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 15:18:58.787925 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: Tue Mar 8 15:18:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52/os-volume_attachments/67fc183b-4d10-4f71-9e5d-14819fc5becd (ip 10.222.0.30) !!! Mar 08 15:19:24.510315 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.wsgi [None req-170abe97-d6f0-4311-b8f2-ab5c48e03255 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-18a57ba5-fe2c-472f-bca0-b154515b9d99) Mar 08 15:19:24.511247 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-170abe97-d6f0-4311-b8f2-ab5c48e03255 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-18a57ba5-fe2c-472f-bca0-b154515b9d99) {{(pid=128351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:19:24.511981 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-170abe97-d6f0-4311-b8f2-ab5c48e03255 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52/os-volume_attachments/67fc183b-4d10-4f71-9e5d-14819fc5becd" status: 400 len: 269 microversion: 2.1 time: 120.360344 Mar 08 15:19:24.513236 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: Tue Mar 8 15:19:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52/os-volume_attachments/67fc183b-4d10-4f71-9e5d-14819fc5becd (ip 10.222.0.30) !!! Mar 08 15:19:24.513236 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: Tue Mar 8 15:19:24 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52/os-volume_attachments/67fc183b-4d10-4f71-9e5d-14819fc5becd (10.222.0.30) Mar 08 15:19:24.514261 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: CRITICAL nova [None req-170abe97-d6f0-4311-b8f2-ab5c48e03255 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Unhandled error: OSError: write error Mar 08 15:19:24.514261 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: ERROR nova OSError: write error Mar 08 15:19:24.514261 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: ERROR nova Mar 08 15:19:24.514486 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1108/2132] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Mar 8 15:17:24 2022] DELETE /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52/os-volume_attachments/67fc183b-4d10-4f71-9e5d-14819fc5becd => generated 0 bytes in 120363 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Mar 08 15:19:24.522732 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-0f64428e-4798-4dc9-87b9-4f8e2816f06f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:19:24.523355 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-0f64428e-4798-4dc9-87b9-4f8e2816f06f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:19:24.530981 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0f64428e-4798-4dc9-87b9-4f8e2816f06f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:19:24.531480 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0f64428e-4798-4dc9-87b9-4f8e2816f06f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:19:24.532701 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0f64428e-4798-4dc9-87b9-4f8e2816f06f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:19:24.533448 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0f64428e-4798-4dc9-87b9-4f8e2816f06f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:19:24.545180 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-bc39afad-d159-43c2-af17-3c2825650ebc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9c650154-4118-4727-a9b0-624de7aeb470) Mar 08 15:19:24.545819 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-bc39afad-d159-43c2-af17-3c2825650ebc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9c650154-4118-4727-a9b0-624de7aeb470) {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:19:24.546681 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-bc39afad-d159-43c2-af17-3c2825650ebc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "DELETE /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments/9ff4ba39-d5be-4514-8dac-561bb4b9e67e" status: 400 len: 269 microversion: 2.1 time: 120.354405 Mar 08 15:19:24.547176 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: Tue Mar 8 15:19:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments/9ff4ba39-d5be-4514-8dac-561bb4b9e67e (ip 10.222.0.30) !!! Mar 08 15:19:24.547607 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: Tue Mar 8 15:19:24 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments/9ff4ba39-d5be-4514-8dac-561bb4b9e67e (10.222.0.30) Mar 08 15:19:24.548246 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: CRITICAL nova [None req-bc39afad-d159-43c2-af17-3c2825650ebc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Unhandled error: OSError: write error Mar 08 15:19:24.548246 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: ERROR nova OSError: write error Mar 08 15:19:24.548246 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: ERROR nova Mar 08 15:19:24.548489 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1025/2133] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Mar 8 15:17:24 2022] DELETE /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6/os-volume_attachments/9ff4ba39-d5be-4514-8dac-561bb4b9e67e => generated 0 bytes in 120356 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Mar 08 15:19:24.548582 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.wsgi [None req-0f64428e-4798-4dc9-87b9-4f8e2816f06f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] HTTP exception thrown: Instance 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a could not be found. Mar 08 15:19:24.549167 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-0f64428e-4798-4dc9-87b9-4f8e2816f06f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Returning 404 to user: Instance 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a could not be found. {{(pid=128351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:19:24.550027 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-0f64428e-4798-4dc9-87b9-4f8e2816f06f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 404 len: 111 microversion: 2.1 time: 0.034788 Mar 08 15:19:24.550709 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: Tue Mar 8 15:19:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a (ip 10.222.0.30) !!! Mar 08 15:19:24.550709 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: Tue Mar 8 15:19:24 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a (10.222.0.30) Mar 08 15:19:24.551078 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: CRITICAL nova [None req-0f64428e-4798-4dc9-87b9-4f8e2816f06f tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Unhandled error: OSError: write error Mar 08 15:19:24.551078 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: ERROR nova OSError: write error Mar 08 15:19:24.551078 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: ERROR nova Mar 08 15:19:24.551315 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1109/2134] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:19:24 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 0 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Mar 08 15:19:24.561813 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-aebb4f05-2b41-4c83-8d1c-2c8737662381 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:19:24.562762 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-aebb4f05-2b41-4c83-8d1c-2c8737662381 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:19:24.573022 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-aebb4f05-2b41-4c83-8d1c-2c8737662381 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:19:24.573778 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-aebb4f05-2b41-4c83-8d1c-2c8737662381 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:19:24.575101 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-aebb4f05-2b41-4c83-8d1c-2c8737662381 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:19:24.576053 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-aebb4f05-2b41-4c83-8d1c-2c8737662381 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:19:24.627131 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [req-9da513a2-052f-443a-ba9e-ff4f314d815f req-65139dca-3039-483a-839b-65a93831cc1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c488812-68f5-41d9-9d25-7f0fb61125f5", "name": "network-vif-deleted", "tag": "ab17bc28-ab3f-46b1-be9d-d202c3e9d04f"}]} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:19:24.638206 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-9da513a2-052f-443a-ba9e-ff4f314d815f req-65139dca-3039-483a-839b-65a93831cc1d service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:19:24.638817 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-9da513a2-052f-443a-ba9e-ff4f314d815f req-65139dca-3039-483a-839b-65a93831cc1d service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:19:24.645347 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-aebb4f05-2b41-4c83-8d1c-2c8737662381 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:19:24.653413 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.compute.server_external_events [req-9da513a2-052f-443a-ba9e-ff4f314d815f req-65139dca-3039-483a-839b-65a93831cc1d service nova] Creating event network-vif-deleted:ab17bc28-ab3f-46b1-be9d-d202c3e9d04f for instance 1c488812-68f5-41d9-9d25-7f0fb61125f5 on hv-cinder-83009 Mar 08 15:19:24.653767 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-aebb4f05-2b41-4c83-8d1c-2c8737662381 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1212 microversion: 2.1 time: 0.103929 Mar 08 15:19:24.654693 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: Tue Mar 8 15:19:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 (ip 10.222.0.30) !!! Mar 08 15:19:24.654693 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: Tue Mar 8 15:19:24 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 (10.222.0.30) Mar 08 15:19:24.655597 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: CRITICAL nova [None req-aebb4f05-2b41-4c83-8d1c-2c8737662381 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Unhandled error: OSError: write error Mar 08 15:19:24.655597 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: ERROR nova OSError: write error Mar 08 15:19:24.655597 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: ERROR nova Mar 08 15:19:24.655882 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1026/2135] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:19:24 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 0 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Mar 08 15:19:24.660401 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [req-9da513a2-052f-443a-ba9e-ff4f314d815f req-65139dca-3039-483a-839b-65a93831cc1d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108021 Mar 08 15:19:24.660537 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-1727523c-c17d-4753-b0d1-b0f061b3f73c tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:19:24.660936 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: Tue Mar 8 15:19:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.30) !!! Mar 08 15:19:24.660936 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: Tue Mar 8 15:19:24 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during POST /compute/v2.1/os-server-external-events (10.222.0.30) Mar 08 15:19:24.661131 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-1727523c-c17d-4753-b0d1-b0f061b3f73c tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: ecac51d1-33c3-49df-9926-d953f7315f52] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:19:24.661588 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: CRITICAL nova [req-9da513a2-052f-443a-ba9e-ff4f314d815f req-65139dca-3039-483a-839b-65a93831cc1d service nova] Unhandled error: OSError: write error Mar 08 15:19:24.661588 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: ERROR nova OSError: write error Mar 08 15:19:24.661588 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: ERROR nova Mar 08 15:19:24.661832 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1110/2136] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 15:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 0 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Mar 08 15:19:24.668020 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1727523c-c17d-4753-b0d1-b0f061b3f73c tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:19:24.668786 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1727523c-c17d-4753-b0d1-b0f061b3f73c tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:19:24.669596 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1727523c-c17d-4753-b0d1-b0f061b3f73c tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:19:24.670376 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1727523c-c17d-4753-b0d1-b0f061b3f73c tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:19:24.799859 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b4a1a17c-0c50-4738-9b0a-a41dd4d42bb8 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:19:24.800757 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-b4a1a17c-0c50-4738-9b0a-a41dd4d42bb8 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:19:24.807422 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b4a1a17c-0c50-4738-9b0a-a41dd4d42bb8 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:19:24.807874 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b4a1a17c-0c50-4738-9b0a-a41dd4d42bb8 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:19:24.808987 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b4a1a17c-0c50-4738-9b0a-a41dd4d42bb8 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:19:24.809434 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b4a1a17c-0c50-4738-9b0a-a41dd4d42bb8 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:19:24.823803 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.wsgi [None req-b4a1a17c-0c50-4738-9b0a-a41dd4d42bb8 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] HTTP exception thrown: Instance 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 could not be found. Mar 08 15:19:24.824397 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b4a1a17c-0c50-4738-9b0a-a41dd4d42bb8 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Returning 404 to user: Instance 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 could not be found. {{(pid=128351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:19:24.825252 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-b4a1a17c-0c50-4738-9b0a-a41dd4d42bb8 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42" status: 404 len: 111 microversion: 2.1 time: 0.162429 Mar 08 15:19:24.825755 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: Tue Mar 8 15:19:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 (ip 10.222.0.30) !!! Mar 08 15:19:24.825755 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: Tue Mar 8 15:19:24 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 (10.222.0.30) Mar 08 15:19:24.826371 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: CRITICAL nova [None req-b4a1a17c-0c50-4738-9b0a-a41dd4d42bb8 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Unhandled error: OSError: write error Mar 08 15:19:24.826371 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: ERROR nova OSError: write error Mar 08 15:19:24.826371 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: ERROR nova Mar 08 15:19:24.826639 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1111/2137] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 15:19:24 2022] DELETE /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 => generated 0 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Mar 08 15:19:24.831619 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-0ceac5cf-51a2-417a-a21e-23bee4640219 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:19:24.832227 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-0ceac5cf-51a2-417a-a21e-23bee4640219 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] [instance: 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:19:24.839027 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0ceac5cf-51a2-417a-a21e-23bee4640219 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:19:24.839486 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0ceac5cf-51a2-417a-a21e-23bee4640219 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:19:24.840265 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0ceac5cf-51a2-417a-a21e-23bee4640219 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:19:24.840708 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0ceac5cf-51a2-417a-a21e-23bee4640219 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:19:24.856258 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.wsgi [None req-0ceac5cf-51a2-417a-a21e-23bee4640219 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] HTTP exception thrown: Instance 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a could not be found. Mar 08 15:19:24.857010 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-0ceac5cf-51a2-417a-a21e-23bee4640219 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Returning 404 to user: Instance 3b13cbf6-22b6-4acc-bbc2-1baead4cb29a could not be found. {{(pid=128351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:19:24.858169 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-0ceac5cf-51a2-417a-a21e-23bee4640219 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a" status: 404 len: 111 microversion: 2.1 time: 0.030588 Mar 08 15:19:24.858543 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: Tue Mar 8 15:19:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a (ip 10.222.0.30) !!! Mar 08 15:19:24.858543 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: Tue Mar 8 15:19:24 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a (10.222.0.30) Mar 08 15:19:24.859154 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: CRITICAL nova [None req-0ceac5cf-51a2-417a-a21e-23bee4640219 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Unhandled error: OSError: write error Mar 08 15:19:24.859154 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: ERROR nova OSError: write error Mar 08 15:19:24.859154 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: ERROR nova Mar 08 15:19:24.859501 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1112/2138] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:19:24 2022] GET /compute/v2.1/servers/3b13cbf6-22b6-4acc-bbc2-1baead4cb29a => generated 0 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Mar 08 15:19:24.863780 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-6aa917e5-df8f-4050-ba27-c684b15b137b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:19:24.864394 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-6aa917e5-df8f-4050-ba27-c684b15b137b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] [instance: 1c488812-68f5-41d9-9d25-7f0fb61125f5] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:19:24.870575 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6aa917e5-df8f-4050-ba27-c684b15b137b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:19:24.871030 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6aa917e5-df8f-4050-ba27-c684b15b137b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:19:24.871808 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6aa917e5-df8f-4050-ba27-c684b15b137b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:19:24.872248 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6aa917e5-df8f-4050-ba27-c684b15b137b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:19:24.941689 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-6aa917e5-df8f-4050-ba27-c684b15b137b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a6549a475a4cbe803ab5bed1c91e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8469a7d8671451eb029d18b67e7f76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:19:24.949347 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-6aa917e5-df8f-4050-ba27-c684b15b137b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5" status: 200 len: 1212 microversion: 2.1 time: 0.089100 Mar 08 15:19:24.949900 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: Tue Mar 8 15:19:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 (ip 10.222.0.30) !!! Mar 08 15:19:24.949900 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: Tue Mar 8 15:19:24 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 (10.222.0.30) Mar 08 15:19:24.950618 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: CRITICAL nova [None req-6aa917e5-df8f-4050-ba27-c684b15b137b tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Unhandled error: OSError: write error Mar 08 15:19:24.950618 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: ERROR nova OSError: write error Mar 08 15:19:24.950618 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: ERROR nova Mar 08 15:19:24.950875 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1113/2139] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:19:24 2022] GET /compute/v2.1/servers/1c488812-68f5-41d9-9d25-7f0fb61125f5 => generated 0 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Mar 08 15:19:24.956300 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-212d3071-b1fc-4471-9bd7-7a0af165dff3 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:19:24.956797 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-212d3071-b1fc-4471-9bd7-7a0af165dff3 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: ecac51d1-33c3-49df-9926-d953f7315f52] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:19:24.963266 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-212d3071-b1fc-4471-9bd7-7a0af165dff3 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:19:24.963725 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-212d3071-b1fc-4471-9bd7-7a0af165dff3 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:19:24.964502 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-212d3071-b1fc-4471-9bd7-7a0af165dff3 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:19:24.964944 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-212d3071-b1fc-4471-9bd7-7a0af165dff3 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:19:40.266476 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 15:19:40.267000 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: Tue Mar 8 15:19:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52/os-volume_attachments/67fc183b-4d10-4f71-9e5d-14819fc5becd (ip 10.222.0.30) !!! Mar 08 15:19:40.972103 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 15:19:40.972266 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: Tue Mar 8 15:19:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52/os-volume_attachments/67fc183b-4d10-4f71-9e5d-14819fc5becd (ip 10.222.0.30) !!! Mar 08 15:20:06.851705 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.objects.instance [None req-1727523c-c17d-4753-b0d1-b0f061b3f73c tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lazy-loading 'services' on Instance uuid ecac51d1-33c3-49df-9926-d953f7315f52 {{(pid=128352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 15:20:06.895719 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.objects.instance [None req-212d3071-b1fc-4471-9bd7-7a0af165dff3 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lazy-loading 'services' on Instance uuid ecac51d1-33c3-49df-9926-d953f7315f52 {{(pid=128351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 15:20:07.058369 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-1727523c-c17d-4753-b0d1-b0f061b3f73c tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8f7e5970-f296-47e9-9e6c-caa01ff13667) Mar 08 15:20:07.058979 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-1727523c-c17d-4753-b0d1-b0f061b3f73c tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8f7e5970-f296-47e9-9e6c-caa01ff13667) {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:20:07.059844 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-1727523c-c17d-4753-b0d1-b0f061b3f73c tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52/os-volume_attachments/67fc183b-4d10-4f71-9e5d-14819fc5becd" status: 400 len: 269 microversion: 2.1 time: 42.403222 Mar 08 15:20:07.060343 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: Tue Mar 8 15:20:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52/os-volume_attachments/67fc183b-4d10-4f71-9e5d-14819fc5becd (ip 10.222.0.30) !!! Mar 08 15:20:07.060343 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: Tue Mar 8 15:20:07 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52/os-volume_attachments/67fc183b-4d10-4f71-9e5d-14819fc5becd (10.222.0.30) Mar 08 15:20:07.060918 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: CRITICAL nova [None req-1727523c-c17d-4753-b0d1-b0f061b3f73c tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Unhandled error: OSError: write error Mar 08 15:20:07.060918 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: ERROR nova OSError: write error Mar 08 15:20:07.060918 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: ERROR nova Mar 08 15:20:07.061243 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1027/2140] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Mar 8 15:19:24 2022] DELETE /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52/os-volume_attachments/67fc183b-4d10-4f71-9e5d-14819fc5becd => generated 0 bytes in 42405 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Mar 08 15:20:07.065507 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3467f2e4-15f6-4e4d-890a-fb8f5a0a0f22 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:20:07.066034 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-3467f2e4-15f6-4e4d-890a-fb8f5a0a0f22 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:20:07.071698 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3467f2e4-15f6-4e4d-890a-fb8f5a0a0f22 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:20:07.072151 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3467f2e4-15f6-4e4d-890a-fb8f5a0a0f22 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:20:07.072923 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3467f2e4-15f6-4e4d-890a-fb8f5a0a0f22 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:20:07.074332 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3467f2e4-15f6-4e4d-890a-fb8f5a0a0f22 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:20:07.086967 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-3467f2e4-15f6-4e4d-890a-fb8f5a0a0f22 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] HTTP exception thrown: Instance 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 could not be found. Mar 08 15:20:07.087550 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3467f2e4-15f6-4e4d-890a-fb8f5a0a0f22 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Returning 404 to user: Instance 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 could not be found. {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:20:07.088469 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-3467f2e4-15f6-4e4d-890a-fb8f5a0a0f22 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42" status: 404 len: 111 microversion: 2.1 time: 0.026459 Mar 08 15:20:07.088874 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: Tue Mar 8 15:20:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 (ip 10.222.0.30) !!! Mar 08 15:20:07.088874 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: Tue Mar 8 15:20:07 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 (10.222.0.30) Mar 08 15:20:07.089594 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: CRITICAL nova [None req-3467f2e4-15f6-4e4d-890a-fb8f5a0a0f22 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Unhandled error: OSError: write error Mar 08 15:20:07.089594 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: ERROR nova OSError: write error Mar 08 15:20:07.089594 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: ERROR nova Mar 08 15:20:07.089876 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1028/2141] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 15:20:07 2022] DELETE /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 => generated 0 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Mar 08 15:20:07.092627 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.wsgi [None req-212d3071-b1fc-4471-9bd7-7a0af165dff3 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-89a1b15b-0397-4815-bb9b-19ee60f94df7) Mar 08 15:20:07.093316 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-212d3071-b1fc-4471-9bd7-7a0af165dff3 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-89a1b15b-0397-4815-bb9b-19ee60f94df7) {{(pid=128351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:20:07.094062 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c700b4de-5f99-479b-8a9d-3db2e18be67d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '.version_select at 0x7ff361c20550>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:20:07.094317 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-212d3071-b1fc-4471-9bd7-7a0af165dff3 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52/os-volume_attachments/67fc183b-4d10-4f71-9e5d-14819fc5becd" status: 400 len: 269 microversion: 2.1 time: 42.142161 Mar 08 15:20:07.094923 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: Tue Mar 8 15:20:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52/os-volume_attachments/67fc183b-4d10-4f71-9e5d-14819fc5becd (ip 10.222.0.30) !!! Mar 08 15:20:07.094923 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: Tue Mar 8 15:20:07 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52/os-volume_attachments/67fc183b-4d10-4f71-9e5d-14819fc5becd (10.222.0.30) Mar 08 15:20:07.095592 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: CRITICAL nova [None req-212d3071-b1fc-4471-9bd7-7a0af165dff3 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Unhandled error: OSError: write error Mar 08 15:20:07.095592 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: ERROR nova OSError: write error Mar 08 15:20:07.095592 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: ERROR nova Mar 08 15:20:07.095838 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1114/2142] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Mar 8 15:19:24 2022] DELETE /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52/os-volume_attachments/67fc183b-4d10-4f71-9e5d-14819fc5becd => generated 0 bytes in 42144 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Mar 08 15:20:07.101478 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-1d669e1f-68bc-4ffc-be16-ef5631254c3a tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:20:07.101991 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-1d669e1f-68bc-4ffc-be16-ef5631254c3a tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: ecac51d1-33c3-49df-9926-d953f7315f52] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:20:07.108003 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1d669e1f-68bc-4ffc-be16-ef5631254c3a tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:20:07.108454 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1d669e1f-68bc-4ffc-be16-ef5631254c3a tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:20:07.109211 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1d669e1f-68bc-4ffc-be16-ef5631254c3a tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:20:07.109649 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1d669e1f-68bc-4ffc-be16-ef5631254c3a tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:20:07.117049 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-c700b4de-5f99-479b-8a9d-3db2e18be67d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-665506048" status: 202 len: 0 microversion: 2.1 time: 0.026304 Mar 08 15:20:07.117642 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1029/2143] 10.222.0.30 () {58 vars in 1250 bytes} [Tue Mar 8 15:20:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-665506048 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 15:20:07.122649 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-848def5b-3d92-4d77-b332-bdd501c8864f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:20:07.123147 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-848def5b-3d92-4d77-b332-bdd501c8864f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:20:07.130719 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-848def5b-3d92-4d77-b332-bdd501c8864f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:20:07.131170 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-848def5b-3d92-4d77-b332-bdd501c8864f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:20:07.131941 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-848def5b-3d92-4d77-b332-bdd501c8864f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:20:07.132381 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-848def5b-3d92-4d77-b332-bdd501c8864f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:20:07.146174 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-848def5b-3d92-4d77-b332-bdd501c8864f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] HTTP exception thrown: Instance 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 could not be found. Mar 08 15:20:07.146668 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-848def5b-3d92-4d77-b332-bdd501c8864f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Returning 404 to user: Instance 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 could not be found. {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:20:07.147750 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-848def5b-3d92-4d77-b332-bdd501c8864f tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42" status: 404 len: 111 microversion: 2.1 time: 0.028939 Mar 08 15:20:07.148288 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1030/2144] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 15:20:07 2022] DELETE /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 15:20:07.152748 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f3a38f19-764b-4e07-a9dc-19aacf99b8ff tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '.version_select at 0x7ff361c27af0>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:20:07.168318 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-f3a38f19-764b-4e07-a9dc-19aacf99b8ff tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] HTTP exception thrown: Keypair tempest-TestShelveInstance-665506048 not found for user 86a6549a475a4cbe803ab5bed1c91e51 Mar 08 15:20:07.168913 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f3a38f19-764b-4e07-a9dc-19aacf99b8ff tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Returning 404 to user: Keypair tempest-TestShelveInstance-665506048 not found for user 86a6549a475a4cbe803ab5bed1c91e51 {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:20:07.169728 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f3a38f19-764b-4e07-a9dc-19aacf99b8ff tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-665506048" status: 404 len: 142 microversion: 2.1 time: 0.020555 Mar 08 15:20:07.170296 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1031/2145] 10.222.0.30 () {58 vars in 1250 bytes} [Tue Mar 8 15:20:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-665506048 => generated 142 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 15:20:07.175001 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-65ae4659-1a19-4346-a36e-7f6b720744fe tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:20:07.175489 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-65ae4659-1a19-4346-a36e-7f6b720744fe tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: ecac51d1-33c3-49df-9926-d953f7315f52] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:20:07.182062 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-65ae4659-1a19-4346-a36e-7f6b720744fe tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:20:07.183195 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-65ae4659-1a19-4346-a36e-7f6b720744fe tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:20:07.184118 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-65ae4659-1a19-4346-a36e-7f6b720744fe tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:20:07.184655 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-65ae4659-1a19-4346-a36e-7f6b720744fe tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:20:07.190769 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.objects.instance [None req-1d669e1f-68bc-4ffc-be16-ef5631254c3a tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lazy-loading 'services' on Instance uuid ecac51d1-33c3-49df-9926-d953f7315f52 {{(pid=128351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 15:20:07.246646 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.wsgi [None req-1d669e1f-68bc-4ffc-be16-ef5631254c3a tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5f8a583c-4352-4429-969a-4b8255a0fcc4) Mar 08 15:20:07.247425 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-1d669e1f-68bc-4ffc-be16-ef5631254c3a tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5f8a583c-4352-4429-969a-4b8255a0fcc4) {{(pid=128351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:20:07.248291 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-1d669e1f-68bc-4ffc-be16-ef5631254c3a tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52/os-volume_attachments/67fc183b-4d10-4f71-9e5d-14819fc5becd" status: 400 len: 269 microversion: 2.1 time: 0.151598 Mar 08 15:20:07.248840 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1115/2146] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Mar 8 15:20:07 2022] DELETE /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52/os-volume_attachments/67fc183b-4d10-4f71-9e5d-14819fc5becd => generated 269 bytes in 153 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 08 15:20:07.254695 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-43893514-b377-49c3-a9ab-0181d7b1c3a6 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:20:07.255345 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-43893514-b377-49c3-a9ab-0181d7b1c3a6 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:20:07.262475 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-43893514-b377-49c3-a9ab-0181d7b1c3a6 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:20:07.262935 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-43893514-b377-49c3-a9ab-0181d7b1c3a6 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:20:07.264403 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-43893514-b377-49c3-a9ab-0181d7b1c3a6 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:20:07.264843 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-43893514-b377-49c3-a9ab-0181d7b1c3a6 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:20:07.279345 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.wsgi [None req-43893514-b377-49c3-a9ab-0181d7b1c3a6 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] HTTP exception thrown: Instance 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 could not be found. Mar 08 15:20:07.279942 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-43893514-b377-49c3-a9ab-0181d7b1c3a6 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Returning 404 to user: Instance 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 could not be found. {{(pid=128351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:20:07.280757 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-43893514-b377-49c3-a9ab-0181d7b1c3a6 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42" status: 404 len: 111 microversion: 2.1 time: 0.030739 Mar 08 15:20:07.281303 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1116/2147] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 15:20:07 2022] DELETE /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 15:20:07.285926 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b55ce7e7-d2a5-4bb2-bbe9-8aa68e9c3fca tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '.version_select at 0x7ff361ca41f0>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:20:07.296272 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.objects.instance [None req-65ae4659-1a19-4346-a36e-7f6b720744fe tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lazy-loading 'services' on Instance uuid ecac51d1-33c3-49df-9926-d953f7315f52 {{(pid=128352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 15:20:07.302569 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.wsgi [None req-b55ce7e7-d2a5-4bb2-bbe9-8aa68e9c3fca tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] HTTP exception thrown: Keypair tempest-TestShelveInstance-665506048 not found for user 86a6549a475a4cbe803ab5bed1c91e51 Mar 08 15:20:07.303126 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b55ce7e7-d2a5-4bb2-bbe9-8aa68e9c3fca tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Returning 404 to user: Keypair tempest-TestShelveInstance-665506048 not found for user 86a6549a475a4cbe803ab5bed1c91e51 {{(pid=128351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:20:07.303955 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-b55ce7e7-d2a5-4bb2-bbe9-8aa68e9c3fca tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-665506048" status: 404 len: 142 microversion: 2.1 time: 0.021494 Mar 08 15:20:07.304487 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1117/2148] 10.222.0.30 () {58 vars in 1250 bytes} [Tue Mar 8 15:20:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-665506048 => generated 142 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 15:20:07.355305 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-65ae4659-1a19-4346-a36e-7f6b720744fe tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-349ee586-be62-434f-ad59-02bb717d3ae8) Mar 08 15:20:07.355907 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-65ae4659-1a19-4346-a36e-7f6b720744fe tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-349ee586-be62-434f-ad59-02bb717d3ae8) {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:20:07.356756 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-65ae4659-1a19-4346-a36e-7f6b720744fe tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52/os-volume_attachments/67fc183b-4d10-4f71-9e5d-14819fc5becd" status: 400 len: 269 microversion: 2.1 time: 0.185563 Mar 08 15:20:07.357503 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1032/2149] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Mar 8 15:20:07 2022] DELETE /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52/os-volume_attachments/67fc183b-4d10-4f71-9e5d-14819fc5becd => generated 269 bytes in 187 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 08 15:20:07.364368 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5cad9aac-fa50-45c6-8084-6031f69badf0 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:20:07.364872 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5cad9aac-fa50-45c6-8084-6031f69badf0 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: ecac51d1-33c3-49df-9926-d953f7315f52] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:20:07.371305 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5cad9aac-fa50-45c6-8084-6031f69badf0 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:20:07.371892 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5cad9aac-fa50-45c6-8084-6031f69badf0 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:20:07.372672 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5cad9aac-fa50-45c6-8084-6031f69badf0 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:20:07.373115 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5cad9aac-fa50-45c6-8084-6031f69badf0 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:20:07.428436 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-6d925faf-0375-4529-8ba2-c1370548737e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:20:07.428952 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-6d925faf-0375-4529-8ba2-c1370548737e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:20:07.436202 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6d925faf-0375-4529-8ba2-c1370548737e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:20:07.436667 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6d925faf-0375-4529-8ba2-c1370548737e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:20:07.437438 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6d925faf-0375-4529-8ba2-c1370548737e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:20:07.437908 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6d925faf-0375-4529-8ba2-c1370548737e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:20:07.460538 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-6d925faf-0375-4529-8ba2-c1370548737e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Going to try to terminate instance {{(pid=128351) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 15:20:07.533153 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-6d925faf-0375-4529-8ba2-c1370548737e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 204 len: 0 microversion: 2.20 time: 0.227416 Mar 08 15:20:07.533734 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1118/2150] 10.222.0.30 () {60 vars in 1279 bytes} [Tue Mar 8 15:20:07 2022] DELETE /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 08 15:20:07.539472 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-86d09b88-956b-4baa-a056-6bde6593845d tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:20:07.540087 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-86d09b88-956b-4baa-a056-6bde6593845d tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:20:07.546649 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-86d09b88-956b-4baa-a056-6bde6593845d tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:20:07.547099 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-86d09b88-956b-4baa-a056-6bde6593845d tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:20:07.547858 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-86d09b88-956b-4baa-a056-6bde6593845d tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:20:07.548292 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-86d09b88-956b-4baa-a056-6bde6593845d tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:20:07.561692 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.wsgi [None req-86d09b88-956b-4baa-a056-6bde6593845d tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] HTTP exception thrown: Instance 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 could not be found. Mar 08 15:20:07.562233 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-86d09b88-956b-4baa-a056-6bde6593845d tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Returning 404 to user: Instance 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 could not be found. {{(pid=128351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:20:07.563042 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-86d09b88-956b-4baa-a056-6bde6593845d tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42" status: 404 len: 111 microversion: 2.1 time: 0.028127 Mar 08 15:20:07.563554 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1119/2151] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 15:20:07 2022] DELETE /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 15:20:07.567945 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-c465038d-553c-48ba-9c26-bcc839e0a27e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '.version_select at 0x7ff35dbab9d0>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:20:07.577828 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.wsgi [None req-c465038d-553c-48ba-9c26-bcc839e0a27e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] HTTP exception thrown: Keypair tempest-TestShelveInstance-665506048 not found for user 86a6549a475a4cbe803ab5bed1c91e51 Mar 08 15:20:07.578433 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-c465038d-553c-48ba-9c26-bcc839e0a27e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Returning 404 to user: Keypair tempest-TestShelveInstance-665506048 not found for user 86a6549a475a4cbe803ab5bed1c91e51 {{(pid=128351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:20:07.579203 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-c465038d-553c-48ba-9c26-bcc839e0a27e tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-665506048" status: 404 len: 142 microversion: 2.1 time: 0.014633 Mar 08 15:20:07.579687 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1120/2152] 10.222.0.30 () {58 vars in 1250 bytes} [Tue Mar 8 15:20:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-665506048 => generated 142 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 15:20:07.583843 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-4e16f621-88d7-41a6-8307-50242ae7a13e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:20:07.584321 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-4e16f621-88d7-41a6-8307-50242ae7a13e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:20:07.590421 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4e16f621-88d7-41a6-8307-50242ae7a13e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:20:07.590880 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4e16f621-88d7-41a6-8307-50242ae7a13e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:20:07.591649 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4e16f621-88d7-41a6-8307-50242ae7a13e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:20:07.592090 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4e16f621-88d7-41a6-8307-50242ae7a13e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:20:07.615457 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-4e16f621-88d7-41a6-8307-50242ae7a13e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Going to try to terminate instance {{(pid=128351) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 15:20:07.661155 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.compute.api [None req-4e16f621-88d7-41a6-8307-50242ae7a13e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Instance is already in deleting state, ignoring this request Mar 08 15:20:07.662068 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-4e16f621-88d7-41a6-8307-50242ae7a13e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 204 len: 0 microversion: 2.20 time: 0.081359 Mar 08 15:20:07.662879 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1121/2153] 10.222.0.30 () {60 vars in 1279 bytes} [Tue Mar 8 15:20:07 2022] DELETE /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 08 15:20:07.668030 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [req-cb2cbb41-0579-4d2b-a94b-e4abcf5b088b req-cddd0051-36ff-4a02-988a-c94cc1d8b331 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42", "name": "network-vif-deleted", "tag": "47990633-f90b-4bac-989c-4141bf8ff314"}]} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:20:07.675301 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-cb2cbb41-0579-4d2b-a94b-e4abcf5b088b req-cddd0051-36ff-4a02-988a-c94cc1d8b331 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:20:07.675758 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-cb2cbb41-0579-4d2b-a94b-e4abcf5b088b req-cddd0051-36ff-4a02-988a-c94cc1d8b331 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:20:07.686664 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.compute.server_external_events [req-cb2cbb41-0579-4d2b-a94b-e4abcf5b088b req-cddd0051-36ff-4a02-988a-c94cc1d8b331 service nova] Creating event network-vif-deleted:47990633-f90b-4bac-989c-4141bf8ff314 for instance 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 on hv-cinder-83009 Mar 08 15:20:07.691561 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [req-cb2cbb41-0579-4d2b-a94b-e4abcf5b088b req-cddd0051-36ff-4a02-988a-c94cc1d8b331 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027520 Mar 08 15:20:07.692128 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1122/2154] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 15:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:20:07.697225 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-7e96c8a9-3aba-4052-88bc-dc7769280a54 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:20:07.697795 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-7e96c8a9-3aba-4052-88bc-dc7769280a54 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: ecac51d1-33c3-49df-9926-d953f7315f52] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:20:07.703482 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7e96c8a9-3aba-4052-88bc-dc7769280a54 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:20:07.703929 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7e96c8a9-3aba-4052-88bc-dc7769280a54 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:20:07.704681 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7e96c8a9-3aba-4052-88bc-dc7769280a54 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:20:07.705119 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7e96c8a9-3aba-4052-88bc-dc7769280a54 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:21:05.521146 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 15:21:05.521763 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: Tue Mar 8 15:21:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52/os-volume_attachments/67fc183b-4d10-4f71-9e5d-14819fc5becd (ip 10.222.0.30) !!! Mar 08 15:21:25.013571 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 15:21:25.014403 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: Tue Mar 8 15:21:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52/os-volume_attachments/67fc183b-4d10-4f71-9e5d-14819fc5becd (ip 10.222.0.30) !!! Mar 08 15:21:25.211204 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.objects.instance [None req-5cad9aac-fa50-45c6-8084-6031f69badf0 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lazy-loading 'services' on Instance uuid ecac51d1-33c3-49df-9926-d953f7315f52 {{(pid=128352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 15:21:25.250344 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.objects.instance [None req-7e96c8a9-3aba-4052-88bc-dc7769280a54 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lazy-loading 'services' on Instance uuid ecac51d1-33c3-49df-9926-d953f7315f52 {{(pid=128351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 15:23:00.274322 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 15:23:00.274814 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: Tue Mar 8 15:23:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52/os-volume_attachments/67fc183b-4d10-4f71-9e5d-14819fc5becd (ip 10.222.0.30) !!! Mar 08 15:23:00.979563 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 15:23:00.979739 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: Tue Mar 8 15:23:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52/os-volume_attachments/67fc183b-4d10-4f71-9e5d-14819fc5becd (ip 10.222.0.30) !!! Mar 08 15:23:13.462961 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 15:23:13.463574 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: Tue Mar 8 15:23:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52/os-volume_attachments/67fc183b-4d10-4f71-9e5d-14819fc5becd (ip 10.222.0.30) !!! Mar 08 15:23:25.683203 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-5cad9aac-fa50-45c6-8084-6031f69badf0 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9dfce1a6-168e-42cd-953d-75d6bffb9ce0) Mar 08 15:23:25.683819 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5cad9aac-fa50-45c6-8084-6031f69badf0 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9dfce1a6-168e-42cd-953d-75d6bffb9ce0) {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:23:25.684692 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5cad9aac-fa50-45c6-8084-6031f69badf0 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52/os-volume_attachments/67fc183b-4d10-4f71-9e5d-14819fc5becd" status: 400 len: 269 microversion: 2.1 time: 198.326231 Mar 08 15:23:25.685196 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: Tue Mar 8 15:23:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52/os-volume_attachments/67fc183b-4d10-4f71-9e5d-14819fc5becd (ip 10.222.0.30) !!! Mar 08 15:23:25.685196 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: Tue Mar 8 15:23:25 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52/os-volume_attachments/67fc183b-4d10-4f71-9e5d-14819fc5becd (10.222.0.30) Mar 08 15:23:25.685766 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: CRITICAL nova [None req-5cad9aac-fa50-45c6-8084-6031f69badf0 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Unhandled error: OSError: write error Mar 08 15:23:25.685766 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: ERROR nova OSError: write error Mar 08 15:23:25.685766 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: ERROR nova Mar 08 15:23:25.686140 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1033/2155] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Mar 8 15:20:07 2022] DELETE /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52/os-volume_attachments/67fc183b-4d10-4f71-9e5d-14819fc5becd => generated 0 bytes in 198328 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Mar 08 15:23:25.692635 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-92ae7d47-57c1-4b9c-a580-06daacfa6574 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:25.693136 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-92ae7d47-57c1-4b9c-a580-06daacfa6574 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:25.698984 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-92ae7d47-57c1-4b9c-a580-06daacfa6574 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:25.699436 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-92ae7d47-57c1-4b9c-a580-06daacfa6574 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:25.700398 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-92ae7d47-57c1-4b9c-a580-06daacfa6574 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:25.700698 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-92ae7d47-57c1-4b9c-a580-06daacfa6574 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:25.713945 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-92ae7d47-57c1-4b9c-a580-06daacfa6574 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] HTTP exception thrown: Instance 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 could not be found. Mar 08 15:23:25.714535 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-92ae7d47-57c1-4b9c-a580-06daacfa6574 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Returning 404 to user: Instance 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 could not be found. {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:23:25.715414 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-92ae7d47-57c1-4b9c-a580-06daacfa6574 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42" status: 404 len: 111 microversion: 2.1 time: 0.028483 Mar 08 15:23:25.715945 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1034/2156] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 15:23:25 2022] DELETE /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 15:23:25.720257 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-86f67044-8007-48e6-8cb8-02a25a666fc6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '.version_select at 0x7ff35d12f550>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:25.736681 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-86f67044-8007-48e6-8cb8-02a25a666fc6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] HTTP exception thrown: Keypair tempest-TestShelveInstance-665506048 not found for user 86a6549a475a4cbe803ab5bed1c91e51 Mar 08 15:23:25.737271 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-86f67044-8007-48e6-8cb8-02a25a666fc6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Returning 404 to user: Keypair tempest-TestShelveInstance-665506048 not found for user 86a6549a475a4cbe803ab5bed1c91e51 {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:23:25.738230 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-86f67044-8007-48e6-8cb8-02a25a666fc6 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-665506048" status: 404 len: 142 microversion: 2.1 time: 0.021249 Mar 08 15:23:25.738741 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1035/2157] 10.222.0.30 () {58 vars in 1250 bytes} [Tue Mar 8 15:23:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-665506048 => generated 142 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 15:23:25.743451 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-cca5b8db-cc20-410e-b554-06ab871a30e8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:25.743943 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-cca5b8db-cc20-410e-b554-06ab871a30e8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:25.750208 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cca5b8db-cc20-410e-b554-06ab871a30e8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:25.750661 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cca5b8db-cc20-410e-b554-06ab871a30e8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:25.751433 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cca5b8db-cc20-410e-b554-06ab871a30e8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:25.751873 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cca5b8db-cc20-410e-b554-06ab871a30e8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:25.764522 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.wsgi [None req-7e96c8a9-3aba-4052-88bc-dc7769280a54 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e8e51839-c2a4-44db-8488-b059ac009e04) Mar 08 15:23:25.765133 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-7e96c8a9-3aba-4052-88bc-dc7769280a54 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e8e51839-c2a4-44db-8488-b059ac009e04) {{(pid=128351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:23:25.766800 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-7e96c8a9-3aba-4052-88bc-dc7769280a54 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52/os-volume_attachments/67fc183b-4d10-4f71-9e5d-14819fc5becd" status: 400 len: 269 microversion: 2.1 time: 198.073568 Mar 08 15:23:25.767884 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1123/2158] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Mar 8 15:20:07 2022] DELETE /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52/os-volume_attachments/67fc183b-4d10-4f71-9e5d-14819fc5becd => generated 269 bytes in 198075 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 08 15:23:25.775261 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-5ae2be2e-89b1-492a-a253-7ecaade05e65 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:25.775762 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-5ae2be2e-89b1-492a-a253-7ecaade05e65 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: ecac51d1-33c3-49df-9926-d953f7315f52] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:25.775903 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-cca5b8db-cc20-410e-b554-06ab871a30e8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Going to try to terminate instance {{(pid=128352) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 15:23:25.784676 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5ae2be2e-89b1-492a-a253-7ecaade05e65 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:25.786347 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5ae2be2e-89b1-492a-a253-7ecaade05e65 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:25.787130 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5ae2be2e-89b1-492a-a253-7ecaade05e65 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:25.787586 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5ae2be2e-89b1-492a-a253-7ecaade05e65 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:25.828018 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.compute.api [None req-cca5b8db-cc20-410e-b554-06ab871a30e8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Instance is already in deleting state, ignoring this request Mar 08 15:23:25.828882 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-cca5b8db-cc20-410e-b554-06ab871a30e8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 204 len: 0 microversion: 2.20 time: 0.088963 Mar 08 15:23:25.829443 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1036/2159] 10.222.0.30 () {60 vars in 1279 bytes} [Tue Mar 8 15:23:25 2022] DELETE /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 08 15:23:25.835485 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-92748e11-6a15-4071-a75e-9a93ff55e081 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:25.835981 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-92748e11-6a15-4071-a75e-9a93ff55e081 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:25.841599 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-92748e11-6a15-4071-a75e-9a93ff55e081 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:25.842126 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-92748e11-6a15-4071-a75e-9a93ff55e081 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:25.842898 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-92748e11-6a15-4071-a75e-9a93ff55e081 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:25.843338 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-92748e11-6a15-4071-a75e-9a93ff55e081 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:25.856365 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-92748e11-6a15-4071-a75e-9a93ff55e081 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] HTTP exception thrown: Instance 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 could not be found. Mar 08 15:23:25.856890 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-92748e11-6a15-4071-a75e-9a93ff55e081 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Returning 404 to user: Instance 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 could not be found. {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:23:25.857699 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-92748e11-6a15-4071-a75e-9a93ff55e081 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42" status: 404 len: 111 microversion: 2.1 time: 0.027324 Mar 08 15:23:25.858253 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1037/2160] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 15:23:25 2022] DELETE /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 15:23:25.862470 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [req-7f8508b4-a982-4dc8-b2da-6c19546478e7 req-0e68550b-712e-4bf0-8f0c-eb53f51ca95b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b7917ad-8941-400f-ae66-d22e26633416", "name": "network-vif-deleted", "tag": "14e51cd2-ee26-4f88-bdde-048115f528a7"}]} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:23:25.871113 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-7f8508b4-a982-4dc8-b2da-6c19546478e7 req-0e68550b-712e-4bf0-8f0c-eb53f51ca95b service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:25.871566 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-7f8508b4-a982-4dc8-b2da-6c19546478e7 req-0e68550b-712e-4bf0-8f0c-eb53f51ca95b service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:25.882452 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.compute.server_external_events [req-7f8508b4-a982-4dc8-b2da-6c19546478e7 req-0e68550b-712e-4bf0-8f0c-eb53f51ca95b service nova] Creating event network-vif-deleted:14e51cd2-ee26-4f88-bdde-048115f528a7 for instance 1b7917ad-8941-400f-ae66-d22e26633416 on hv-cinder-83009 Mar 08 15:23:25.888196 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [req-7f8508b4-a982-4dc8-b2da-6c19546478e7 req-0e68550b-712e-4bf0-8f0c-eb53f51ca95b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028872 Mar 08 15:23:25.888743 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1038/2161] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 15:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:23:25.893669 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-202131a3-a2a9-470a-b9d0-dcd063e6e18f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '.version_select at 0x7ff35cfdb8b0>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:25.903471 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-202131a3-a2a9-470a-b9d0-dcd063e6e18f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] HTTP exception thrown: Keypair tempest-TestShelveInstance-665506048 not found for user 86a6549a475a4cbe803ab5bed1c91e51 Mar 08 15:23:25.904048 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-202131a3-a2a9-470a-b9d0-dcd063e6e18f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Returning 404 to user: Keypair tempest-TestShelveInstance-665506048 not found for user 86a6549a475a4cbe803ab5bed1c91e51 {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:23:25.904840 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-202131a3-a2a9-470a-b9d0-dcd063e6e18f tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-665506048" status: 404 len: 142 microversion: 2.1 time: 0.015057 Mar 08 15:23:25.905338 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1039/2162] 10.222.0.30 () {58 vars in 1250 bytes} [Tue Mar 8 15:23:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-665506048 => generated 142 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 15:23:25.910424 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-265f9d24-feb7-4b21-b3da-fd80fe789bb8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:25.911154 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-265f9d24-feb7-4b21-b3da-fd80fe789bb8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:25.917114 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-265f9d24-feb7-4b21-b3da-fd80fe789bb8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:25.917573 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-265f9d24-feb7-4b21-b3da-fd80fe789bb8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:25.918370 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-265f9d24-feb7-4b21-b3da-fd80fe789bb8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:25.918810 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-265f9d24-feb7-4b21-b3da-fd80fe789bb8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:25.942823 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-265f9d24-feb7-4b21-b3da-fd80fe789bb8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Going to try to terminate instance {{(pid=128352) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 15:23:25.985304 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.compute.api [None req-265f9d24-feb7-4b21-b3da-fd80fe789bb8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Instance is already in deleting state, ignoring this request Mar 08 15:23:25.986144 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-265f9d24-feb7-4b21-b3da-fd80fe789bb8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 204 len: 0 microversion: 2.20 time: 0.079902 Mar 08 15:23:25.986687 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1040/2163] 10.222.0.30 () {60 vars in 1279 bytes} [Tue Mar 8 15:23:25 2022] DELETE /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 08 15:23:25.991794 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-1be0e7c8-2f79-407d-9fc2-6af9f849fdd5 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '.version_select at 0x7ff35d22c280>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:26.008114 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-1be0e7c8-2f79-407d-9fc2-6af9f849fdd5 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-513935596" status: 202 len: 0 microversion: 2.1 time: 0.020464 Mar 08 15:23:26.008656 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1041/2164] 10.222.0.30 () {58 vars in 1217 bytes} [Tue Mar 8 15:23:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-513935596 => generated 0 bytes in 21 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 15:23:26.013197 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ad0b5b15-a81a-48f9-b02f-153e350990df tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '.version_select at 0x7ff35cfdb1f0>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:26.023096 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-ad0b5b15-a81a-48f9-b02f-153e350990df tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] HTTP exception thrown: Keypair tempest-TestShelveInstance-665506048 not found for user 86a6549a475a4cbe803ab5bed1c91e51 Mar 08 15:23:26.023672 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ad0b5b15-a81a-48f9-b02f-153e350990df tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Returning 404 to user: Keypair tempest-TestShelveInstance-665506048 not found for user 86a6549a475a4cbe803ab5bed1c91e51 {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:23:26.024466 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ad0b5b15-a81a-48f9-b02f-153e350990df tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-665506048" status: 404 len: 142 microversion: 2.1 time: 0.014828 Mar 08 15:23:26.024963 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1042/2165] 10.222.0.30 () {58 vars in 1250 bytes} [Tue Mar 8 15:23:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-665506048 => generated 142 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 15:23:26.030065 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-42dc3a59-7d1a-4473-991a-788af60466f4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:26.030556 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-42dc3a59-7d1a-4473-991a-788af60466f4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:26.037084 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-42dc3a59-7d1a-4473-991a-788af60466f4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:26.037539 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-42dc3a59-7d1a-4473-991a-788af60466f4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:26.038336 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-42dc3a59-7d1a-4473-991a-788af60466f4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:26.038779 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-42dc3a59-7d1a-4473-991a-788af60466f4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:26.061999 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-42dc3a59-7d1a-4473-991a-788af60466f4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Going to try to terminate instance {{(pid=128352) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 15:23:26.106309 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.compute.api [None req-42dc3a59-7d1a-4473-991a-788af60466f4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Instance is already in deleting state, ignoring this request Mar 08 15:23:26.107167 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-42dc3a59-7d1a-4473-991a-788af60466f4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 204 len: 0 microversion: 2.20 time: 0.081170 Mar 08 15:23:26.107645 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1043/2166] 10.222.0.30 () {60 vars in 1279 bytes} [Tue Mar 8 15:23:26 2022] DELETE /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 08 15:23:26.111982 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-43d0ab73-2d30-4cb2-8ecf-4b3f53705752 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '.version_select at 0x7ff35d208550>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:26.122029 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-43d0ab73-2d30-4cb2-8ecf-4b3f53705752 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] HTTP exception thrown: Keypair tempest-keypair-513935596 not found for user 51ed61d0a16d465889c0474a4d2b7dee Mar 08 15:23:26.122596 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-43d0ab73-2d30-4cb2-8ecf-4b3f53705752 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Returning 404 to user: Keypair tempest-keypair-513935596 not found for user 51ed61d0a16d465889c0474a4d2b7dee {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:23:26.123376 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-43d0ab73-2d30-4cb2-8ecf-4b3f53705752 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-513935596" status: 404 len: 131 microversion: 2.1 time: 0.014854 Mar 08 15:23:26.123864 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1044/2167] 10.222.0.30 () {58 vars in 1217 bytes} [Tue Mar 8 15:23:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-513935596 => generated 131 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 15:23:26.127939 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-8a7c1686-2ec1-4bc1-98ac-446fefc4c0a6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:26.128420 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-8a7c1686-2ec1-4bc1-98ac-446fefc4c0a6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:26.134293 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8a7c1686-2ec1-4bc1-98ac-446fefc4c0a6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:26.134744 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8a7c1686-2ec1-4bc1-98ac-446fefc4c0a6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:26.135501 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8a7c1686-2ec1-4bc1-98ac-446fefc4c0a6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:26.135937 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8a7c1686-2ec1-4bc1-98ac-446fefc4c0a6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:26.157544 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-8a7c1686-2ec1-4bc1-98ac-446fefc4c0a6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Going to try to terminate instance {{(pid=128352) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 15:23:26.228427 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-8a7c1686-2ec1-4bc1-98ac-446fefc4c0a6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "DELETE /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 204 len: 0 microversion: 2.1 time: 0.103401 Mar 08 15:23:26.228995 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1045/2168] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 15:23:26 2022] DELETE /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 15:23:26.234103 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d82d3cb9-f375-440e-8631-e1346cb2385a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '.version_select at 0x7ff35d236940>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:26.252517 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d82d3cb9-f375-440e-8631-e1346cb2385a tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1546550273" status: 202 len: 0 microversion: 2.1 time: 0.022299 Mar 08 15:23:26.253088 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1046/2169] 10.222.0.30 () {58 vars in 1262 bytes} [Tue Mar 8 15:23:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1546550273 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 15:23:26.258093 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c4c975cd-09d0-4330-a271-30b08cebf98d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '.version_select at 0x7ff35cfdb160>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:26.268378 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-c4c975cd-09d0-4330-a271-30b08cebf98d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] HTTP exception thrown: Keypair tempest-TestShelveInstance-665506048 not found for user 86a6549a475a4cbe803ab5bed1c91e51 Mar 08 15:23:26.268947 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c4c975cd-09d0-4330-a271-30b08cebf98d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Returning 404 to user: Keypair tempest-TestShelveInstance-665506048 not found for user 86a6549a475a4cbe803ab5bed1c91e51 {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:23:26.270323 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-c4c975cd-09d0-4330-a271-30b08cebf98d tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-665506048" status: 404 len: 142 microversion: 2.1 time: 0.016287 Mar 08 15:23:26.270816 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1047/2170] 10.222.0.30 () {58 vars in 1250 bytes} [Tue Mar 8 15:23:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-665506048 => generated 142 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 15:23:26.275478 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-42bd3eb7-97d4-4683-8d7b-22d3609e6fc7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:26.276063 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-42bd3eb7-97d4-4683-8d7b-22d3609e6fc7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:26.281376 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-42bd3eb7-97d4-4683-8d7b-22d3609e6fc7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:26.281873 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-42bd3eb7-97d4-4683-8d7b-22d3609e6fc7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:26.282704 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-42bd3eb7-97d4-4683-8d7b-22d3609e6fc7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:26.283137 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-42bd3eb7-97d4-4683-8d7b-22d3609e6fc7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:26.307487 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-42bd3eb7-97d4-4683-8d7b-22d3609e6fc7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Going to try to terminate instance {{(pid=128352) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 15:23:26.350035 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.compute.api [None req-42bd3eb7-97d4-4683-8d7b-22d3609e6fc7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Instance is already in deleting state, ignoring this request Mar 08 15:23:26.350847 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-42bd3eb7-97d4-4683-8d7b-22d3609e6fc7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 204 len: 0 microversion: 2.20 time: 0.079156 Mar 08 15:23:26.351396 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1048/2171] 10.222.0.30 () {60 vars in 1279 bytes} [Tue Mar 8 15:23:26 2022] DELETE /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 08 15:23:26.355735 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-8a0667e4-b86c-4fad-ade7-82956fc20cde tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '.version_select at 0x7ff35d12fd30>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:26.366102 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-8a0667e4-b86c-4fad-ade7-82956fc20cde tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] HTTP exception thrown: Keypair tempest-keypair-513935596 not found for user 51ed61d0a16d465889c0474a4d2b7dee Mar 08 15:23:26.366619 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-8a0667e4-b86c-4fad-ade7-82956fc20cde tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Returning 404 to user: Keypair tempest-keypair-513935596 not found for user 51ed61d0a16d465889c0474a4d2b7dee {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:23:26.367412 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-8a0667e4-b86c-4fad-ade7-82956fc20cde tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-513935596" status: 404 len: 131 microversion: 2.1 time: 0.015127 Mar 08 15:23:26.367914 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1049/2172] 10.222.0.30 () {58 vars in 1217 bytes} [Tue Mar 8 15:23:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-513935596 => generated 131 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 15:23:26.372481 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-04d34c88-9e09-47c0-94d5-bf9b7a543cb9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:26.372973 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-04d34c88-9e09-47c0-94d5-bf9b7a543cb9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:26.379795 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-04d34c88-9e09-47c0-94d5-bf9b7a543cb9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:26.380251 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-04d34c88-9e09-47c0-94d5-bf9b7a543cb9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:26.381025 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-04d34c88-9e09-47c0-94d5-bf9b7a543cb9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:26.381462 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-04d34c88-9e09-47c0-94d5-bf9b7a543cb9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:26.407135 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-04d34c88-9e09-47c0-94d5-bf9b7a543cb9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Going to try to terminate instance {{(pid=128352) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 15:23:26.451245 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.compute.api [None req-04d34c88-9e09-47c0-94d5-bf9b7a543cb9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Instance is already in deleting state, ignoring this request Mar 08 15:23:26.452063 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-04d34c88-9e09-47c0-94d5-bf9b7a543cb9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "DELETE /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 204 len: 0 microversion: 2.1 time: 0.083282 Mar 08 15:23:26.452964 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1050/2173] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 15:23:26 2022] DELETE /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 15:23:26.458167 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-e46b6803-d0de-4bf9-a11b-29da1d2fe021 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Calling method '.version_select at 0x7ff35d12f670>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:26.471798 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-e46b6803-d0de-4bf9-a11b-29da1d2fe021 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] HTTP exception thrown: Keypair tempest-TestVolumeBootPattern-1546550273 not found for user d5eebbc0c8574cd58c022f2cc0e9f1eb Mar 08 15:23:26.472479 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-e46b6803-d0de-4bf9-a11b-29da1d2fe021 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] Returning 404 to user: Keypair tempest-TestVolumeBootPattern-1546550273 not found for user d5eebbc0c8574cd58c022f2cc0e9f1eb {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:23:26.475002 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-e46b6803-d0de-4bf9-a11b-29da1d2fe021 tempest-TestVolumeBootPattern-790196501 tempest-TestVolumeBootPattern-790196501-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1546550273" status: 404 len: 146 microversion: 2.1 time: 0.020199 Mar 08 15:23:26.475002 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1051/2174] 10.222.0.30 () {58 vars in 1262 bytes} [Tue Mar 8 15:23:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1546550273 => generated 146 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 15:23:26.479142 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d217d8b3-01dc-4f16-b287-2994c9eb30e1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Calling method '.version_select at 0x7ff361c27e50>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:26.499763 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-d217d8b3-01dc-4f16-b287-2994c9eb30e1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] HTTP exception thrown: Keypair tempest-TestShelveInstance-665506048 not found for user 86a6549a475a4cbe803ab5bed1c91e51 Mar 08 15:23:26.500479 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d217d8b3-01dc-4f16-b287-2994c9eb30e1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] Returning 404 to user: Keypair tempest-TestShelveInstance-665506048 not found for user 86a6549a475a4cbe803ab5bed1c91e51 {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:23:26.501202 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d217d8b3-01dc-4f16-b287-2994c9eb30e1 tempest-TestShelveInstance-517632837 tempest-TestShelveInstance-517632837-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-665506048" status: 404 len: 142 microversion: 2.1 time: 0.025626 Mar 08 15:23:26.501737 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1052/2175] 10.222.0.30 () {58 vars in 1250 bytes} [Tue Mar 8 15:23:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-665506048 => generated 142 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 15:23:26.514209 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-649445ec-f0dd-4c5c-aefa-5d1b9b262873 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:26.514774 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-649445ec-f0dd-4c5c-aefa-5d1b9b262873 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:26.521167 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-649445ec-f0dd-4c5c-aefa-5d1b9b262873 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:26.521562 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-649445ec-f0dd-4c5c-aefa-5d1b9b262873 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:26.522483 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-649445ec-f0dd-4c5c-aefa-5d1b9b262873 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:26.522971 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-649445ec-f0dd-4c5c-aefa-5d1b9b262873 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:26.562121 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-649445ec-f0dd-4c5c-aefa-5d1b9b262873 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Going to try to terminate instance {{(pid=128352) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 15:23:26.635957 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.compute.api [None req-649445ec-f0dd-4c5c-aefa-5d1b9b262873 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Instance is already in deleting state, ignoring this request Mar 08 15:23:26.636901 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-649445ec-f0dd-4c5c-aefa-5d1b9b262873 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 204 len: 0 microversion: 2.20 time: 0.129618 Mar 08 15:23:26.637709 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1053/2176] 10.222.0.30 () {60 vars in 1279 bytes} [Tue Mar 8 15:23:26 2022] DELETE /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 08 15:23:26.642115 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5077e482-1b65-4b8e-8f9d-8ed2e96bbc19 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:26.642720 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5077e482-1b65-4b8e-8f9d-8ed2e96bbc19 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:26.649383 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5077e482-1b65-4b8e-8f9d-8ed2e96bbc19 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:26.649832 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5077e482-1b65-4b8e-8f9d-8ed2e96bbc19 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:26.650632 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5077e482-1b65-4b8e-8f9d-8ed2e96bbc19 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:26.651062 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5077e482-1b65-4b8e-8f9d-8ed2e96bbc19 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:26.919278 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-5077e482-1b65-4b8e-8f9d-8ed2e96bbc19 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:26.927690 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5077e482-1b65-4b8e-8f9d-8ed2e96bbc19 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1601 microversion: 2.1 time: 0.289269 Mar 08 15:23:26.928838 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1054/2177] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:23:26 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1601 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:23:26.933427 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-4fc97079-2ced-4a4b-bae6-a8d5c7698906 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:26.934206 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-4fc97079-2ced-4a4b-bae6-a8d5c7698906 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:26.942716 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4fc97079-2ced-4a4b-bae6-a8d5c7698906 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:26.943340 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4fc97079-2ced-4a4b-bae6-a8d5c7698906 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:26.944389 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4fc97079-2ced-4a4b-bae6-a8d5c7698906 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:26.948603 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4fc97079-2ced-4a4b-bae6-a8d5c7698906 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:27.072973 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-4fc97079-2ced-4a4b-bae6-a8d5c7698906 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:27.082612 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-4fc97079-2ced-4a4b-bae6-a8d5c7698906 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:27.084411 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-4fc97079-2ced-4a4b-bae6-a8d5c7698906 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:27.086315 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-4fc97079-2ced-4a4b-bae6-a8d5c7698906 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.155832 Mar 08 15:23:27.086315 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1055/2178] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:23:26 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:23:27.905022 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [req-184ed663-8bae-48d5-8e7b-5c016de91b7a req-5c91507c-020d-4e82-b9fd-9ac0225a0d31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "251780d0-025f-4a29-b292-9a73dce671e6", "name": "network-vif-deleted", "tag": "b4376b4c-6cf3-4dbf-b874-e5bde382acad"}]} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:23:27.914836 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-184ed663-8bae-48d5-8e7b-5c016de91b7a req-5c91507c-020d-4e82-b9fd-9ac0225a0d31 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:27.915280 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-184ed663-8bae-48d5-8e7b-5c016de91b7a req-5c91507c-020d-4e82-b9fd-9ac0225a0d31 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:27.927620 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.compute.server_external_events [req-184ed663-8bae-48d5-8e7b-5c016de91b7a req-5c91507c-020d-4e82-b9fd-9ac0225a0d31 service nova] Creating event network-vif-deleted:b4376b4c-6cf3-4dbf-b874-e5bde382acad for instance 251780d0-025f-4a29-b292-9a73dce671e6 on hv-cinder-83009 Mar 08 15:23:27.934479 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [req-184ed663-8bae-48d5-8e7b-5c016de91b7a req-5c91507c-020d-4e82-b9fd-9ac0225a0d31 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033396 Mar 08 15:23:27.936272 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1056/2179] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 15:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 15:23:27.950589 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-baf71052-88a7-413b-b3a9-469f16f6e8df tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:27.951480 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-baf71052-88a7-413b-b3a9-469f16f6e8df tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:27.958575 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-baf71052-88a7-413b-b3a9-469f16f6e8df tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:27.959033 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-baf71052-88a7-413b-b3a9-469f16f6e8df tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:27.959827 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-baf71052-88a7-413b-b3a9-469f16f6e8df tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:27.960418 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-baf71052-88a7-413b-b3a9-469f16f6e8df tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:28.044046 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-baf71052-88a7-413b-b3a9-469f16f6e8df tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:28.053199 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-baf71052-88a7-413b-b3a9-469f16f6e8df tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.108282 Mar 08 15:23:28.053995 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1057/2180] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:23:27 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:23:28.104807 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-e25d3b9f-b323-4784-b7a7-80e4effbfa91 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:28.105432 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-e25d3b9f-b323-4784-b7a7-80e4effbfa91 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:28.111599 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e25d3b9f-b323-4784-b7a7-80e4effbfa91 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:28.112116 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e25d3b9f-b323-4784-b7a7-80e4effbfa91 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:28.112864 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e25d3b9f-b323-4784-b7a7-80e4effbfa91 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:28.113964 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e25d3b9f-b323-4784-b7a7-80e4effbfa91 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:28.409226 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-e25d3b9f-b323-4784-b7a7-80e4effbfa91 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:28.418437 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-e25d3b9f-b323-4784-b7a7-80e4effbfa91 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:28.419954 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-e25d3b9f-b323-4784-b7a7-80e4effbfa91 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:28.421102 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-e25d3b9f-b323-4784-b7a7-80e4effbfa91 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.320523 Mar 08 15:23:28.421877 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1058/2181] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:23:28 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:23:29.075444 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b70fa3fc-5b55-410c-bb3d-e9714aa37d7a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:29.076817 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b70fa3fc-5b55-410c-bb3d-e9714aa37d7a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:29.084809 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b70fa3fc-5b55-410c-bb3d-e9714aa37d7a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:29.085600 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b70fa3fc-5b55-410c-bb3d-e9714aa37d7a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:29.086622 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b70fa3fc-5b55-410c-bb3d-e9714aa37d7a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:29.087234 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b70fa3fc-5b55-410c-bb3d-e9714aa37d7a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:29.149965 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b70fa3fc-5b55-410c-bb3d-e9714aa37d7a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:29.159102 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b70fa3fc-5b55-410c-bb3d-e9714aa37d7a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.088840 Mar 08 15:23:29.160196 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1059/2182] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:23:29 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:23:29.439098 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-75e74c1e-f2dc-4615-bb45-f1a9904a8d70 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:29.439638 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-75e74c1e-f2dc-4615-bb45-f1a9904a8d70 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:29.445741 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-75e74c1e-f2dc-4615-bb45-f1a9904a8d70 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:29.446231 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-75e74c1e-f2dc-4615-bb45-f1a9904a8d70 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:29.447038 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-75e74c1e-f2dc-4615-bb45-f1a9904a8d70 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:29.447480 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-75e74c1e-f2dc-4615-bb45-f1a9904a8d70 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:29.508468 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-75e74c1e-f2dc-4615-bb45-f1a9904a8d70 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:29.516678 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-75e74c1e-f2dc-4615-bb45-f1a9904a8d70 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:29.518209 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-75e74c1e-f2dc-4615-bb45-f1a9904a8d70 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:29.520018 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-75e74c1e-f2dc-4615-bb45-f1a9904a8d70 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.084330 Mar 08 15:23:29.520783 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1060/2183] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:23:29 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:23:30.176935 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-8f2fa180-7266-4b95-8c9c-9e1ce484f3e9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:30.177589 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-8f2fa180-7266-4b95-8c9c-9e1ce484f3e9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:30.190252 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8f2fa180-7266-4b95-8c9c-9e1ce484f3e9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:30.190252 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8f2fa180-7266-4b95-8c9c-9e1ce484f3e9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:30.190964 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8f2fa180-7266-4b95-8c9c-9e1ce484f3e9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:30.192463 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8f2fa180-7266-4b95-8c9c-9e1ce484f3e9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:30.339976 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-8f2fa180-7266-4b95-8c9c-9e1ce484f3e9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:30.348214 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-8f2fa180-7266-4b95-8c9c-9e1ce484f3e9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.176257 Mar 08 15:23:30.348799 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1061/2184] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:23:30 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:23:30.538721 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-57ad8c17-8192-4732-94de-bf33628e4b25 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:30.539645 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-57ad8c17-8192-4732-94de-bf33628e4b25 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:30.546131 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-57ad8c17-8192-4732-94de-bf33628e4b25 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:30.552012 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-57ad8c17-8192-4732-94de-bf33628e4b25 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:30.554669 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-57ad8c17-8192-4732-94de-bf33628e4b25 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:30.555391 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-57ad8c17-8192-4732-94de-bf33628e4b25 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:30.678087 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-57ad8c17-8192-4732-94de-bf33628e4b25 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:30.693634 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-57ad8c17-8192-4732-94de-bf33628e4b25 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:30.697366 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-57ad8c17-8192-4732-94de-bf33628e4b25 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:30.701484 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-57ad8c17-8192-4732-94de-bf33628e4b25 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.167303 Mar 08 15:23:30.702253 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1062/2185] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:23:30 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:23:31.368291 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f8ad7ce2-583f-4c73-af48-391345182c46 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:31.370003 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f8ad7ce2-583f-4c73-af48-391345182c46 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:31.393384 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f8ad7ce2-583f-4c73-af48-391345182c46 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:31.393820 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f8ad7ce2-583f-4c73-af48-391345182c46 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:31.396023 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f8ad7ce2-583f-4c73-af48-391345182c46 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:31.396294 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f8ad7ce2-583f-4c73-af48-391345182c46 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:31.475620 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f8ad7ce2-583f-4c73-af48-391345182c46 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:31.493440 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f8ad7ce2-583f-4c73-af48-391345182c46 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.129384 Mar 08 15:23:31.497517 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1063/2186] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:23:31 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:23:31.719060 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-9f9a835a-7f15-42cb-a291-c3671be10580 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:31.719931 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-9f9a835a-7f15-42cb-a291-c3671be10580 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:31.727188 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9f9a835a-7f15-42cb-a291-c3671be10580 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:31.727641 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9f9a835a-7f15-42cb-a291-c3671be10580 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:31.728597 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9f9a835a-7f15-42cb-a291-c3671be10580 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:31.729219 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9f9a835a-7f15-42cb-a291-c3671be10580 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:31.804288 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-9f9a835a-7f15-42cb-a291-c3671be10580 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:31.813365 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-9f9a835a-7f15-42cb-a291-c3671be10580 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:31.815062 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-9f9a835a-7f15-42cb-a291-c3671be10580 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:31.816358 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-9f9a835a-7f15-42cb-a291-c3671be10580 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.101077 Mar 08 15:23:31.817136 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1064/2187] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:23:31 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:23:32.513497 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-84fbf29b-9103-4b84-b985-ab280f9ebca2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:32.514263 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-84fbf29b-9103-4b84-b985-ab280f9ebca2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:32.530615 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-84fbf29b-9103-4b84-b985-ab280f9ebca2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:32.531083 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-84fbf29b-9103-4b84-b985-ab280f9ebca2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:32.532001 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-84fbf29b-9103-4b84-b985-ab280f9ebca2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:32.532448 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-84fbf29b-9103-4b84-b985-ab280f9ebca2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:32.636596 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-84fbf29b-9103-4b84-b985-ab280f9ebca2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:32.657393 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-84fbf29b-9103-4b84-b985-ab280f9ebca2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.147227 Mar 08 15:23:32.660584 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1065/2188] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:23:32 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:23:32.833566 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-15dfc84f-f333-4068-a02a-6ed8fe69628a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:32.834329 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-15dfc84f-f333-4068-a02a-6ed8fe69628a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:32.841022 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-15dfc84f-f333-4068-a02a-6ed8fe69628a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:32.841668 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-15dfc84f-f333-4068-a02a-6ed8fe69628a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:32.842668 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-15dfc84f-f333-4068-a02a-6ed8fe69628a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:32.843303 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-15dfc84f-f333-4068-a02a-6ed8fe69628a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:32.964902 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-15dfc84f-f333-4068-a02a-6ed8fe69628a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:32.973742 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-15dfc84f-f333-4068-a02a-6ed8fe69628a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:32.975278 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-15dfc84f-f333-4068-a02a-6ed8fe69628a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:32.976448 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-15dfc84f-f333-4068-a02a-6ed8fe69628a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.146949 Mar 08 15:23:32.976999 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1066/2189] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:23:32 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:23:33.680313 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-cc82c5d6-017c-4884-87ea-bdc8552dedc7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:33.681754 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-cc82c5d6-017c-4884-87ea-bdc8552dedc7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:33.693445 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cc82c5d6-017c-4884-87ea-bdc8552dedc7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:33.694923 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cc82c5d6-017c-4884-87ea-bdc8552dedc7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:33.696462 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cc82c5d6-017c-4884-87ea-bdc8552dedc7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:33.697178 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cc82c5d6-017c-4884-87ea-bdc8552dedc7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:33.803278 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-cc82c5d6-017c-4884-87ea-bdc8552dedc7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:33.815996 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-cc82c5d6-017c-4884-87ea-bdc8552dedc7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.141598 Mar 08 15:23:33.817771 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1067/2190] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:23:33 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:23:33.997735 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-559d300f-4e66-47da-93dc-99f5f4e4e454 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:33.999513 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-559d300f-4e66-47da-93dc-99f5f4e4e454 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:34.017524 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-559d300f-4e66-47da-93dc-99f5f4e4e454 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:34.018457 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-559d300f-4e66-47da-93dc-99f5f4e4e454 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:34.020227 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-559d300f-4e66-47da-93dc-99f5f4e4e454 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:34.020903 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-559d300f-4e66-47da-93dc-99f5f4e4e454 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:34.165146 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-559d300f-4e66-47da-93dc-99f5f4e4e454 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:34.175941 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-559d300f-4e66-47da-93dc-99f5f4e4e454 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:34.177611 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-559d300f-4e66-47da-93dc-99f5f4e4e454 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:34.179814 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-559d300f-4e66-47da-93dc-99f5f4e4e454 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.188388 Mar 08 15:23:34.192130 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1068/2191] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:23:33 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:23:34.835930 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-360f6bbc-4c2c-4061-bb0f-9e377b5f0b71 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:34.838558 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-360f6bbc-4c2c-4061-bb0f-9e377b5f0b71 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:34.848223 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-360f6bbc-4c2c-4061-bb0f-9e377b5f0b71 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:34.850173 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-360f6bbc-4c2c-4061-bb0f-9e377b5f0b71 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:34.851825 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-360f6bbc-4c2c-4061-bb0f-9e377b5f0b71 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:34.852457 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-360f6bbc-4c2c-4061-bb0f-9e377b5f0b71 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:34.934258 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-360f6bbc-4c2c-4061-bb0f-9e377b5f0b71 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:34.945710 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-360f6bbc-4c2c-4061-bb0f-9e377b5f0b71 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.114607 Mar 08 15:23:34.947205 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1069/2192] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:23:34 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:23:35.201321 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-e78a93ea-734f-4074-8360-3f9dede58e36 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:35.202002 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-e78a93ea-734f-4074-8360-3f9dede58e36 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:35.214178 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e78a93ea-734f-4074-8360-3f9dede58e36 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:35.214918 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e78a93ea-734f-4074-8360-3f9dede58e36 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:35.216039 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e78a93ea-734f-4074-8360-3f9dede58e36 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:35.216649 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e78a93ea-734f-4074-8360-3f9dede58e36 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:35.320534 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-e78a93ea-734f-4074-8360-3f9dede58e36 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:35.345289 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-e78a93ea-734f-4074-8360-3f9dede58e36 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:35.349451 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-e78a93ea-734f-4074-8360-3f9dede58e36 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:35.350678 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-e78a93ea-734f-4074-8360-3f9dede58e36 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.155387 Mar 08 15:23:35.358826 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1070/2193] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:23:35 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:23:35.963000 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-448b735a-fe2d-4a96-95c4-422352c076f3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:35.963725 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-448b735a-fe2d-4a96-95c4-422352c076f3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:35.970202 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-448b735a-fe2d-4a96-95c4-422352c076f3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:35.971019 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-448b735a-fe2d-4a96-95c4-422352c076f3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:35.972651 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-448b735a-fe2d-4a96-95c4-422352c076f3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:35.973104 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-448b735a-fe2d-4a96-95c4-422352c076f3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:36.075633 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-448b735a-fe2d-4a96-95c4-422352c076f3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:36.098683 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-448b735a-fe2d-4a96-95c4-422352c076f3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.134120 Mar 08 15:23:36.100519 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1071/2194] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:23:35 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:23:36.369267 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-9f96c1fb-863e-4c10-a632-bcbdef750432 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:36.370006 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-9f96c1fb-863e-4c10-a632-bcbdef750432 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:36.376292 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9f96c1fb-863e-4c10-a632-bcbdef750432 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:36.377090 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9f96c1fb-863e-4c10-a632-bcbdef750432 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:36.378092 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9f96c1fb-863e-4c10-a632-bcbdef750432 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:36.378918 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9f96c1fb-863e-4c10-a632-bcbdef750432 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:36.454011 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-9f96c1fb-863e-4c10-a632-bcbdef750432 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:36.467495 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-9f96c1fb-863e-4c10-a632-bcbdef750432 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:36.469223 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-9f96c1fb-863e-4c10-a632-bcbdef750432 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:36.470695 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-9f96c1fb-863e-4c10-a632-bcbdef750432 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.105501 Mar 08 15:23:36.471471 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1072/2195] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:23:36 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:23:37.117116 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-fdef8f94-c9b1-4f5f-963f-ac7df5e7220d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:37.117807 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-fdef8f94-c9b1-4f5f-963f-ac7df5e7220d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:37.124070 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fdef8f94-c9b1-4f5f-963f-ac7df5e7220d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:37.124702 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fdef8f94-c9b1-4f5f-963f-ac7df5e7220d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:37.125660 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fdef8f94-c9b1-4f5f-963f-ac7df5e7220d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:37.127420 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fdef8f94-c9b1-4f5f-963f-ac7df5e7220d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:37.197303 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-fdef8f94-c9b1-4f5f-963f-ac7df5e7220d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:37.206877 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-fdef8f94-c9b1-4f5f-963f-ac7df5e7220d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.093478 Mar 08 15:23:37.207781 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1073/2196] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:23:37 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:23:37.489424 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3a6f9d6c-b7b9-4370-b8b5-6a7de1f3877a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:37.490082 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-3a6f9d6c-b7b9-4370-b8b5-6a7de1f3877a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:37.496294 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3a6f9d6c-b7b9-4370-b8b5-6a7de1f3877a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:37.496817 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3a6f9d6c-b7b9-4370-b8b5-6a7de1f3877a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:37.497687 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3a6f9d6c-b7b9-4370-b8b5-6a7de1f3877a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:37.498171 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3a6f9d6c-b7b9-4370-b8b5-6a7de1f3877a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:37.558367 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-3a6f9d6c-b7b9-4370-b8b5-6a7de1f3877a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:37.567260 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-3a6f9d6c-b7b9-4370-b8b5-6a7de1f3877a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:37.568809 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-3a6f9d6c-b7b9-4370-b8b5-6a7de1f3877a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:37.569978 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-3a6f9d6c-b7b9-4370-b8b5-6a7de1f3877a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.085281 Mar 08 15:23:37.570539 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1074/2197] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:23:37 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:23:38.225013 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-cf8e9c4f-c370-4e53-b0c5-f76d91924b33 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:38.225661 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-cf8e9c4f-c370-4e53-b0c5-f76d91924b33 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:38.231445 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cf8e9c4f-c370-4e53-b0c5-f76d91924b33 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:38.231900 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cf8e9c4f-c370-4e53-b0c5-f76d91924b33 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:38.232670 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cf8e9c4f-c370-4e53-b0c5-f76d91924b33 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:38.233112 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cf8e9c4f-c370-4e53-b0c5-f76d91924b33 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:38.292123 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-cf8e9c4f-c370-4e53-b0c5-f76d91924b33 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:38.299852 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-cf8e9c4f-c370-4e53-b0c5-f76d91924b33 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.078927 Mar 08 15:23:38.301229 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1075/2198] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:23:38 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:23:38.588349 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-fcac6f6f-1ac8-4c8e-b9f7-bc41f0abeb6a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:38.588966 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-fcac6f6f-1ac8-4c8e-b9f7-bc41f0abeb6a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:38.595285 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fcac6f6f-1ac8-4c8e-b9f7-bc41f0abeb6a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:38.595740 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fcac6f6f-1ac8-4c8e-b9f7-bc41f0abeb6a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:38.596511 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fcac6f6f-1ac8-4c8e-b9f7-bc41f0abeb6a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:38.597554 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fcac6f6f-1ac8-4c8e-b9f7-bc41f0abeb6a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:38.912205 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-fcac6f6f-1ac8-4c8e-b9f7-bc41f0abeb6a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:38.920617 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-fcac6f6f-1ac8-4c8e-b9f7-bc41f0abeb6a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:38.922151 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-fcac6f6f-1ac8-4c8e-b9f7-bc41f0abeb6a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:38.923276 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-fcac6f6f-1ac8-4c8e-b9f7-bc41f0abeb6a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.338869 Mar 08 15:23:38.923831 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1076/2199] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:23:38 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:23:39.318933 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-591d8bae-b646-4347-a759-4b57c1bcd5cb tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:39.319604 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-591d8bae-b646-4347-a759-4b57c1bcd5cb tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:39.325371 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-591d8bae-b646-4347-a759-4b57c1bcd5cb tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:39.325818 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-591d8bae-b646-4347-a759-4b57c1bcd5cb tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:39.326608 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-591d8bae-b646-4347-a759-4b57c1bcd5cb tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:39.327042 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-591d8bae-b646-4347-a759-4b57c1bcd5cb tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:39.384208 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-591d8bae-b646-4347-a759-4b57c1bcd5cb tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:39.393362 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-591d8bae-b646-4347-a759-4b57c1bcd5cb tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.079479 Mar 08 15:23:39.395250 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1077/2200] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:23:39 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:23:39.940606 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-57ee9cc0-1b00-4163-9212-1e1da3677b61 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:39.941229 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-57ee9cc0-1b00-4163-9212-1e1da3677b61 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:39.947631 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-57ee9cc0-1b00-4163-9212-1e1da3677b61 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:39.948090 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-57ee9cc0-1b00-4163-9212-1e1da3677b61 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:39.948875 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-57ee9cc0-1b00-4163-9212-1e1da3677b61 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:39.949317 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-57ee9cc0-1b00-4163-9212-1e1da3677b61 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:40.009196 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-57ee9cc0-1b00-4163-9212-1e1da3677b61 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:40.017372 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-57ee9cc0-1b00-4163-9212-1e1da3677b61 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:40.018904 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-57ee9cc0-1b00-4163-9212-1e1da3677b61 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:40.020707 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-57ee9cc0-1b00-4163-9212-1e1da3677b61 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.083956 Mar 08 15:23:40.021264 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1078/2201] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:23:39 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:23:40.411236 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-a2478934-4722-41dd-8a71-1c7e2c11da37 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:40.411882 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-a2478934-4722-41dd-8a71-1c7e2c11da37 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:40.417755 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a2478934-4722-41dd-8a71-1c7e2c11da37 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:40.418243 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a2478934-4722-41dd-8a71-1c7e2c11da37 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:40.419011 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a2478934-4722-41dd-8a71-1c7e2c11da37 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:40.419451 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a2478934-4722-41dd-8a71-1c7e2c11da37 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:40.476814 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-a2478934-4722-41dd-8a71-1c7e2c11da37 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:40.484513 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-a2478934-4722-41dd-8a71-1c7e2c11da37 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.077544 Mar 08 15:23:40.485087 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1079/2202] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:23:40 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:23:41.038688 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-7a939299-3222-4d2b-b694-8608f3f523bd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:41.039308 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-7a939299-3222-4d2b-b694-8608f3f523bd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:41.045595 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7a939299-3222-4d2b-b694-8608f3f523bd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:41.046089 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7a939299-3222-4d2b-b694-8608f3f523bd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:41.046864 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7a939299-3222-4d2b-b694-8608f3f523bd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:41.047310 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7a939299-3222-4d2b-b694-8608f3f523bd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:41.107934 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-7a939299-3222-4d2b-b694-8608f3f523bd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:41.116757 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-7a939299-3222-4d2b-b694-8608f3f523bd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:41.118302 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-7a939299-3222-4d2b-b694-8608f3f523bd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:41.119437 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-7a939299-3222-4d2b-b694-8608f3f523bd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.085188 Mar 08 15:23:41.120002 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1080/2203] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:23:41 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:23:41.501925 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d2cf2897-8089-40bc-b42b-49cebfc69602 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:41.502596 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d2cf2897-8089-40bc-b42b-49cebfc69602 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:41.508558 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d2cf2897-8089-40bc-b42b-49cebfc69602 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:41.509013 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d2cf2897-8089-40bc-b42b-49cebfc69602 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:41.509783 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d2cf2897-8089-40bc-b42b-49cebfc69602 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:41.510250 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d2cf2897-8089-40bc-b42b-49cebfc69602 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:41.567872 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d2cf2897-8089-40bc-b42b-49cebfc69602 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:41.575440 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d2cf2897-8089-40bc-b42b-49cebfc69602 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.077383 Mar 08 15:23:41.576004 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1081/2204] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:23:41 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:23:42.137380 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-6aae9e7d-4e4c-44bc-8c91-0e433bcd7c5f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:42.138039 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-6aae9e7d-4e4c-44bc-8c91-0e433bcd7c5f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:42.144339 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6aae9e7d-4e4c-44bc-8c91-0e433bcd7c5f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:42.144839 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6aae9e7d-4e4c-44bc-8c91-0e433bcd7c5f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:42.145690 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6aae9e7d-4e4c-44bc-8c91-0e433bcd7c5f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:42.146175 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6aae9e7d-4e4c-44bc-8c91-0e433bcd7c5f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:42.205817 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-6aae9e7d-4e4c-44bc-8c91-0e433bcd7c5f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:42.214159 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-6aae9e7d-4e4c-44bc-8c91-0e433bcd7c5f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:42.215665 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-6aae9e7d-4e4c-44bc-8c91-0e433bcd7c5f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:42.216799 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-6aae9e7d-4e4c-44bc-8c91-0e433bcd7c5f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.083325 Mar 08 15:23:42.217354 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1082/2205] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:23:42 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:23:42.592425 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-06705d76-ae5c-4599-ad08-c3a3ebd0bda0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:42.593105 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-06705d76-ae5c-4599-ad08-c3a3ebd0bda0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:42.599517 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-06705d76-ae5c-4599-ad08-c3a3ebd0bda0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:42.599971 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-06705d76-ae5c-4599-ad08-c3a3ebd0bda0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:42.600744 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-06705d76-ae5c-4599-ad08-c3a3ebd0bda0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:42.601184 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-06705d76-ae5c-4599-ad08-c3a3ebd0bda0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:42.658934 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-06705d76-ae5c-4599-ad08-c3a3ebd0bda0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:42.667186 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-06705d76-ae5c-4599-ad08-c3a3ebd0bda0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.078583 Mar 08 15:23:42.667748 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1083/2206] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:23:42 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:23:43.234608 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-22539095-086a-4bd0-a7c2-b6abfe04b3ed tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:43.235217 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-22539095-086a-4bd0-a7c2-b6abfe04b3ed tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:43.242019 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-22539095-086a-4bd0-a7c2-b6abfe04b3ed tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:43.242469 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-22539095-086a-4bd0-a7c2-b6abfe04b3ed tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:43.243229 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-22539095-086a-4bd0-a7c2-b6abfe04b3ed tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:43.243663 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-22539095-086a-4bd0-a7c2-b6abfe04b3ed tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:43.304410 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-22539095-086a-4bd0-a7c2-b6abfe04b3ed tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:43.312564 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-22539095-086a-4bd0-a7c2-b6abfe04b3ed tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:43.314105 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-22539095-086a-4bd0-a7c2-b6abfe04b3ed tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:43.315240 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-22539095-086a-4bd0-a7c2-b6abfe04b3ed tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.084522 Mar 08 15:23:43.315791 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1084/2207] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:23:43 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:23:43.684516 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-a87fbd17-6386-4ef0-a412-00f24e758420 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:43.685230 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-a87fbd17-6386-4ef0-a412-00f24e758420 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:43.690945 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a87fbd17-6386-4ef0-a412-00f24e758420 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:43.691404 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a87fbd17-6386-4ef0-a412-00f24e758420 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:43.692783 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a87fbd17-6386-4ef0-a412-00f24e758420 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:43.693223 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a87fbd17-6386-4ef0-a412-00f24e758420 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:43.753995 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-a87fbd17-6386-4ef0-a412-00f24e758420 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:43.762681 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-a87fbd17-6386-4ef0-a412-00f24e758420 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.082084 Mar 08 15:23:43.763254 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1085/2208] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:23:43 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:23:44.332723 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-0aac9fbe-bd70-40b5-9906-6153f52c9511 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:44.333240 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-0aac9fbe-bd70-40b5-9906-6153f52c9511 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:44.339478 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0aac9fbe-bd70-40b5-9906-6153f52c9511 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:44.339959 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0aac9fbe-bd70-40b5-9906-6153f52c9511 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:44.340720 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0aac9fbe-bd70-40b5-9906-6153f52c9511 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:44.341155 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0aac9fbe-bd70-40b5-9906-6153f52c9511 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:44.400677 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-0aac9fbe-bd70-40b5-9906-6153f52c9511 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:44.409122 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-0aac9fbe-bd70-40b5-9906-6153f52c9511 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:44.411164 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-0aac9fbe-bd70-40b5-9906-6153f52c9511 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:44.411992 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-0aac9fbe-bd70-40b5-9906-6153f52c9511 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.083419 Mar 08 15:23:44.412545 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1086/2209] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:23:44 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:23:44.778784 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5c14dda7-3b19-484c-8581-33b162a9f9d1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:44.779450 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5c14dda7-3b19-484c-8581-33b162a9f9d1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:44.786313 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5c14dda7-3b19-484c-8581-33b162a9f9d1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:44.786801 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5c14dda7-3b19-484c-8581-33b162a9f9d1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:44.787569 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5c14dda7-3b19-484c-8581-33b162a9f9d1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:44.788008 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5c14dda7-3b19-484c-8581-33b162a9f9d1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:44.845820 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-5c14dda7-3b19-484c-8581-33b162a9f9d1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:44.854483 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5c14dda7-3b19-484c-8581-33b162a9f9d1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.079561 Mar 08 15:23:44.855040 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1087/2210] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:23:44 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:23:45.429942 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-69b0a547-4ed9-40d5-b234-564407ba08d5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:45.430556 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-69b0a547-4ed9-40d5-b234-564407ba08d5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:45.436845 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-69b0a547-4ed9-40d5-b234-564407ba08d5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:45.437299 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-69b0a547-4ed9-40d5-b234-564407ba08d5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:45.438100 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-69b0a547-4ed9-40d5-b234-564407ba08d5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:45.438547 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-69b0a547-4ed9-40d5-b234-564407ba08d5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:45.497247 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-69b0a547-4ed9-40d5-b234-564407ba08d5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:45.505928 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-69b0a547-4ed9-40d5-b234-564407ba08d5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:45.507436 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-69b0a547-4ed9-40d5-b234-564407ba08d5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:45.508571 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-69b0a547-4ed9-40d5-b234-564407ba08d5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.082708 Mar 08 15:23:45.509155 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1088/2211] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:23:45 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:23:45.870709 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-953118de-672b-40a3-ae99-3d9821a666e2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:45.871332 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-953118de-672b-40a3-ae99-3d9821a666e2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:45.877043 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-953118de-672b-40a3-ae99-3d9821a666e2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:45.877488 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-953118de-672b-40a3-ae99-3d9821a666e2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:45.878278 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-953118de-672b-40a3-ae99-3d9821a666e2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:45.878711 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-953118de-672b-40a3-ae99-3d9821a666e2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:45.938498 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-953118de-672b-40a3-ae99-3d9821a666e2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:45.947320 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-953118de-672b-40a3-ae99-3d9821a666e2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.080493 Mar 08 15:23:45.947902 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1089/2212] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:23:45 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:23:46.526944 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d04f2ab0-2789-4227-9b19-49b7748f66bd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:46.527555 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d04f2ab0-2789-4227-9b19-49b7748f66bd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:46.534108 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d04f2ab0-2789-4227-9b19-49b7748f66bd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:46.534565 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d04f2ab0-2789-4227-9b19-49b7748f66bd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:46.535360 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d04f2ab0-2789-4227-9b19-49b7748f66bd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:46.536328 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d04f2ab0-2789-4227-9b19-49b7748f66bd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:46.597014 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d04f2ab0-2789-4227-9b19-49b7748f66bd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:46.605960 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d04f2ab0-2789-4227-9b19-49b7748f66bd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:46.607456 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d04f2ab0-2789-4227-9b19-49b7748f66bd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:46.608579 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d04f2ab0-2789-4227-9b19-49b7748f66bd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.085557 Mar 08 15:23:46.609131 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1090/2213] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:23:46 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:23:46.963769 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f01a1741-1c1e-4bd7-b83c-436fa0b37fc2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:46.964370 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f01a1741-1c1e-4bd7-b83c-436fa0b37fc2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:46.970276 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f01a1741-1c1e-4bd7-b83c-436fa0b37fc2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:46.970731 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f01a1741-1c1e-4bd7-b83c-436fa0b37fc2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:46.971496 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f01a1741-1c1e-4bd7-b83c-436fa0b37fc2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:46.971937 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f01a1741-1c1e-4bd7-b83c-436fa0b37fc2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:47.032394 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f01a1741-1c1e-4bd7-b83c-436fa0b37fc2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:47.041245 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f01a1741-1c1e-4bd7-b83c-436fa0b37fc2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.081295 Mar 08 15:23:47.041808 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1091/2214] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:23:46 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:23:47.627385 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ba776f8e-4cda-432c-8cf4-0826cc89a086 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:47.627994 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ba776f8e-4cda-432c-8cf4-0826cc89a086 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:47.634351 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ba776f8e-4cda-432c-8cf4-0826cc89a086 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:47.634829 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ba776f8e-4cda-432c-8cf4-0826cc89a086 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:47.635593 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ba776f8e-4cda-432c-8cf4-0826cc89a086 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:47.636030 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ba776f8e-4cda-432c-8cf4-0826cc89a086 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:47.695528 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ba776f8e-4cda-432c-8cf4-0826cc89a086 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:47.703576 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ba776f8e-4cda-432c-8cf4-0826cc89a086 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:47.705104 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ba776f8e-4cda-432c-8cf4-0826cc89a086 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:47.706275 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ba776f8e-4cda-432c-8cf4-0826cc89a086 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.082746 Mar 08 15:23:47.706850 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1092/2215] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:23:47 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:23:48.057386 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-4bdd5b86-9196-4bb6-afe3-a84e3505029f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:48.058040 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-4bdd5b86-9196-4bb6-afe3-a84e3505029f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:48.063852 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4bdd5b86-9196-4bb6-afe3-a84e3505029f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:48.064307 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4bdd5b86-9196-4bb6-afe3-a84e3505029f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:48.065061 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4bdd5b86-9196-4bb6-afe3-a84e3505029f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:48.065495 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4bdd5b86-9196-4bb6-afe3-a84e3505029f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:48.123397 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-4bdd5b86-9196-4bb6-afe3-a84e3505029f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:48.131465 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-4bdd5b86-9196-4bb6-afe3-a84e3505029f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.077889 Mar 08 15:23:48.132037 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1093/2216] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:23:48 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:23:48.724665 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f7185be8-7e2f-4eea-a194-7ff853e84527 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:48.725218 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f7185be8-7e2f-4eea-a194-7ff853e84527 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:48.731499 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f7185be8-7e2f-4eea-a194-7ff853e84527 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:48.731946 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f7185be8-7e2f-4eea-a194-7ff853e84527 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:48.732702 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f7185be8-7e2f-4eea-a194-7ff853e84527 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:48.733136 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f7185be8-7e2f-4eea-a194-7ff853e84527 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:48.793661 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f7185be8-7e2f-4eea-a194-7ff853e84527 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:48.802540 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f7185be8-7e2f-4eea-a194-7ff853e84527 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:48.804029 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f7185be8-7e2f-4eea-a194-7ff853e84527 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:48.805151 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f7185be8-7e2f-4eea-a194-7ff853e84527 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.084533 Mar 08 15:23:48.805703 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1094/2217] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:23:48 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:23:49.147422 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-0a942166-fa1d-46be-abbe-9c2a5413b38b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:49.148072 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-0a942166-fa1d-46be-abbe-9c2a5413b38b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:49.154013 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0a942166-fa1d-46be-abbe-9c2a5413b38b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:49.154472 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0a942166-fa1d-46be-abbe-9c2a5413b38b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:49.155242 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0a942166-fa1d-46be-abbe-9c2a5413b38b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:49.155682 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0a942166-fa1d-46be-abbe-9c2a5413b38b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:49.213816 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-0a942166-fa1d-46be-abbe-9c2a5413b38b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:49.221403 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-0a942166-fa1d-46be-abbe-9c2a5413b38b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.077991 Mar 08 15:23:49.221983 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1095/2218] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:23:49 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:23:49.823962 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b9621c06-58a3-4f32-b5c4-38c2d22f0650 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:49.824690 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b9621c06-58a3-4f32-b5c4-38c2d22f0650 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:49.831192 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b9621c06-58a3-4f32-b5c4-38c2d22f0650 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:49.831729 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b9621c06-58a3-4f32-b5c4-38c2d22f0650 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:49.833637 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b9621c06-58a3-4f32-b5c4-38c2d22f0650 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:49.834194 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b9621c06-58a3-4f32-b5c4-38c2d22f0650 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:49.896779 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b9621c06-58a3-4f32-b5c4-38c2d22f0650 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:49.905385 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b9621c06-58a3-4f32-b5c4-38c2d22f0650 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:49.906928 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b9621c06-58a3-4f32-b5c4-38c2d22f0650 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:49.908356 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b9621c06-58a3-4f32-b5c4-38c2d22f0650 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.088186 Mar 08 15:23:49.909149 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1096/2219] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:23:49 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:23:50.239293 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-9e5f8566-28cb-4032-9ea0-ef696cc85138 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:50.239965 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-9e5f8566-28cb-4032-9ea0-ef696cc85138 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:50.245632 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9e5f8566-28cb-4032-9ea0-ef696cc85138 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:50.246118 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9e5f8566-28cb-4032-9ea0-ef696cc85138 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:50.246878 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9e5f8566-28cb-4032-9ea0-ef696cc85138 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:50.247314 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9e5f8566-28cb-4032-9ea0-ef696cc85138 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:50.309999 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-9e5f8566-28cb-4032-9ea0-ef696cc85138 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:50.317729 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-9e5f8566-28cb-4032-9ea0-ef696cc85138 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.082941 Mar 08 15:23:50.318321 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1097/2220] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:23:50 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:23:50.928175 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b1cad943-9d7d-4512-a901-0ebadd2b0452 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:50.928724 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b1cad943-9d7d-4512-a901-0ebadd2b0452 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:50.934685 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b1cad943-9d7d-4512-a901-0ebadd2b0452 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:50.935140 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b1cad943-9d7d-4512-a901-0ebadd2b0452 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:50.935914 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b1cad943-9d7d-4512-a901-0ebadd2b0452 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:50.936353 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b1cad943-9d7d-4512-a901-0ebadd2b0452 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:50.998081 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b1cad943-9d7d-4512-a901-0ebadd2b0452 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:51.007431 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b1cad943-9d7d-4512-a901-0ebadd2b0452 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:51.008940 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b1cad943-9d7d-4512-a901-0ebadd2b0452 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:51.010109 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b1cad943-9d7d-4512-a901-0ebadd2b0452 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.086951 Mar 08 15:23:51.010663 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1098/2221] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:23:50 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:23:51.334765 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d7843628-bdb9-44d2-9b5b-af44d39e3c7e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:51.335482 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d7843628-bdb9-44d2-9b5b-af44d39e3c7e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:51.341361 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d7843628-bdb9-44d2-9b5b-af44d39e3c7e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:51.341812 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d7843628-bdb9-44d2-9b5b-af44d39e3c7e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:51.342603 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d7843628-bdb9-44d2-9b5b-af44d39e3c7e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:51.343040 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d7843628-bdb9-44d2-9b5b-af44d39e3c7e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:51.401464 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d7843628-bdb9-44d2-9b5b-af44d39e3c7e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:51.409444 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d7843628-bdb9-44d2-9b5b-af44d39e3c7e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.078927 Mar 08 15:23:51.410033 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1099/2222] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:23:51 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:23:52.027959 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-aa442d9e-1315-4725-8398-87d6283c51fd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:52.028566 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-aa442d9e-1315-4725-8398-87d6283c51fd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:52.034997 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-aa442d9e-1315-4725-8398-87d6283c51fd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:52.035527 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-aa442d9e-1315-4725-8398-87d6283c51fd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:52.036314 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-aa442d9e-1315-4725-8398-87d6283c51fd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:52.036750 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-aa442d9e-1315-4725-8398-87d6283c51fd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:52.095247 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-aa442d9e-1315-4725-8398-87d6283c51fd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:52.103895 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-aa442d9e-1315-4725-8398-87d6283c51fd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:52.105403 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-aa442d9e-1315-4725-8398-87d6283c51fd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:52.106574 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-aa442d9e-1315-4725-8398-87d6283c51fd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.082530 Mar 08 15:23:52.107133 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1100/2223] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:23:52 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:23:52.427702 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3e25a37b-1577-4b0a-a1ae-ba1e3265f66e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:52.428349 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-3e25a37b-1577-4b0a-a1ae-ba1e3265f66e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:52.434213 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3e25a37b-1577-4b0a-a1ae-ba1e3265f66e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:52.434666 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3e25a37b-1577-4b0a-a1ae-ba1e3265f66e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:52.435433 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3e25a37b-1577-4b0a-a1ae-ba1e3265f66e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:52.435872 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3e25a37b-1577-4b0a-a1ae-ba1e3265f66e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:52.494338 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-3e25a37b-1577-4b0a-a1ae-ba1e3265f66e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:52.501994 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-3e25a37b-1577-4b0a-a1ae-ba1e3265f66e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.079153 Mar 08 15:23:52.502553 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1101/2224] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:23:52 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:23:53.125225 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-381a7468-f810-42b4-83ff-9c1c38f92592 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:53.125840 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-381a7468-f810-42b4-83ff-9c1c38f92592 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:53.132244 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-381a7468-f810-42b4-83ff-9c1c38f92592 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:53.132702 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-381a7468-f810-42b4-83ff-9c1c38f92592 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:53.133469 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-381a7468-f810-42b4-83ff-9c1c38f92592 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:53.133935 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-381a7468-f810-42b4-83ff-9c1c38f92592 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:53.192880 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-381a7468-f810-42b4-83ff-9c1c38f92592 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:53.201026 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-381a7468-f810-42b4-83ff-9c1c38f92592 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:53.202599 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-381a7468-f810-42b4-83ff-9c1c38f92592 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:53.203729 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-381a7468-f810-42b4-83ff-9c1c38f92592 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.082456 Mar 08 15:23:53.204322 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1102/2225] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:23:53 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:23:53.519962 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-1a2dd68a-800b-4c46-b58d-a586248f1207 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:53.520619 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-1a2dd68a-800b-4c46-b58d-a586248f1207 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:53.527069 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1a2dd68a-800b-4c46-b58d-a586248f1207 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:53.527523 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1a2dd68a-800b-4c46-b58d-a586248f1207 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:53.528294 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1a2dd68a-800b-4c46-b58d-a586248f1207 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:53.528733 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1a2dd68a-800b-4c46-b58d-a586248f1207 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:53.590464 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-1a2dd68a-800b-4c46-b58d-a586248f1207 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:53.598127 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-1a2dd68a-800b-4c46-b58d-a586248f1207 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.082035 Mar 08 15:23:53.598681 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1103/2226] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:23:53 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:23:54.222236 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-fdd1ff8f-4b1a-4afe-86fb-34e16dd4e464 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:54.222974 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-fdd1ff8f-4b1a-4afe-86fb-34e16dd4e464 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:54.229063 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fdd1ff8f-4b1a-4afe-86fb-34e16dd4e464 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:54.229512 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fdd1ff8f-4b1a-4afe-86fb-34e16dd4e464 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:54.230302 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fdd1ff8f-4b1a-4afe-86fb-34e16dd4e464 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:54.230742 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fdd1ff8f-4b1a-4afe-86fb-34e16dd4e464 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:54.289602 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-fdd1ff8f-4b1a-4afe-86fb-34e16dd4e464 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:54.297697 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-fdd1ff8f-4b1a-4afe-86fb-34e16dd4e464 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:54.299243 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-fdd1ff8f-4b1a-4afe-86fb-34e16dd4e464 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:54.300373 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-fdd1ff8f-4b1a-4afe-86fb-34e16dd4e464 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.082188 Mar 08 15:23:54.301064 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1104/2227] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:23:54 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:23:54.615497 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-48027dea-f665-4855-967d-951290599a9f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:54.616168 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-48027dea-f665-4855-967d-951290599a9f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:54.621974 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-48027dea-f665-4855-967d-951290599a9f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:54.622430 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-48027dea-f665-4855-967d-951290599a9f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:54.623225 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-48027dea-f665-4855-967d-951290599a9f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:54.623664 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-48027dea-f665-4855-967d-951290599a9f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:54.682310 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-48027dea-f665-4855-967d-951290599a9f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:54.689947 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-48027dea-f665-4855-967d-951290599a9f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.079021 Mar 08 15:23:54.690509 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1105/2228] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:23:54 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:23:55.319219 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-37e3b70d-5a78-430c-b82f-3a5ed2d01f4e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:55.319841 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-37e3b70d-5a78-430c-b82f-3a5ed2d01f4e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:55.326022 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-37e3b70d-5a78-430c-b82f-3a5ed2d01f4e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:55.326474 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-37e3b70d-5a78-430c-b82f-3a5ed2d01f4e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:55.327232 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-37e3b70d-5a78-430c-b82f-3a5ed2d01f4e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:55.327663 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-37e3b70d-5a78-430c-b82f-3a5ed2d01f4e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:55.387018 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-37e3b70d-5a78-430c-b82f-3a5ed2d01f4e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:55.396048 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-37e3b70d-5a78-430c-b82f-3a5ed2d01f4e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:55.397559 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-37e3b70d-5a78-430c-b82f-3a5ed2d01f4e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:55.398731 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-37e3b70d-5a78-430c-b82f-3a5ed2d01f4e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.084057 Mar 08 15:23:55.399290 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1106/2229] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:23:55 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:23:55.707650 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-1e309f49-f909-4afc-97c9-acca0dded5f5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:55.708309 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-1e309f49-f909-4afc-97c9-acca0dded5f5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:55.714016 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1e309f49-f909-4afc-97c9-acca0dded5f5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:55.714468 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1e309f49-f909-4afc-97c9-acca0dded5f5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:55.715235 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1e309f49-f909-4afc-97c9-acca0dded5f5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:55.715671 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1e309f49-f909-4afc-97c9-acca0dded5f5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:55.776023 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-1e309f49-f909-4afc-97c9-acca0dded5f5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:55.783875 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-1e309f49-f909-4afc-97c9-acca0dded5f5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.080562 Mar 08 15:23:55.784430 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1107/2230] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:23:55 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:23:56.416998 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c20e7038-daf3-42b1-a4fd-6485159d0e12 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:56.417631 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-c20e7038-daf3-42b1-a4fd-6485159d0e12 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:56.423870 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c20e7038-daf3-42b1-a4fd-6485159d0e12 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:56.424325 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c20e7038-daf3-42b1-a4fd-6485159d0e12 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:56.425093 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c20e7038-daf3-42b1-a4fd-6485159d0e12 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:56.425613 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c20e7038-daf3-42b1-a4fd-6485159d0e12 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:56.485317 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-c20e7038-daf3-42b1-a4fd-6485159d0e12 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:56.494294 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-c20e7038-daf3-42b1-a4fd-6485159d0e12 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:56.495803 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-c20e7038-daf3-42b1-a4fd-6485159d0e12 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:56.496934 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-c20e7038-daf3-42b1-a4fd-6485159d0e12 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.083826 Mar 08 15:23:56.497493 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1108/2231] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:23:56 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:23:56.800412 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ed45f07a-f0b0-4be3-97c0-41923011ea74 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:56.801081 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ed45f07a-f0b0-4be3-97c0-41923011ea74 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:56.806920 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ed45f07a-f0b0-4be3-97c0-41923011ea74 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:56.807375 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ed45f07a-f0b0-4be3-97c0-41923011ea74 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:56.808143 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ed45f07a-f0b0-4be3-97c0-41923011ea74 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:56.808584 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ed45f07a-f0b0-4be3-97c0-41923011ea74 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:56.869912 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ed45f07a-f0b0-4be3-97c0-41923011ea74 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:56.877735 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ed45f07a-f0b0-4be3-97c0-41923011ea74 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.081119 Mar 08 15:23:56.878332 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1109/2232] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:23:56 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:23:57.514787 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-9a393f59-7f1f-48d1-8291-626191f32edd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:57.515406 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-9a393f59-7f1f-48d1-8291-626191f32edd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:57.522166 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9a393f59-7f1f-48d1-8291-626191f32edd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:57.522626 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9a393f59-7f1f-48d1-8291-626191f32edd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:57.523399 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9a393f59-7f1f-48d1-8291-626191f32edd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:57.523839 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9a393f59-7f1f-48d1-8291-626191f32edd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:57.582457 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-9a393f59-7f1f-48d1-8291-626191f32edd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:57.590718 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-9a393f59-7f1f-48d1-8291-626191f32edd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:57.592239 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-9a393f59-7f1f-48d1-8291-626191f32edd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:57.593372 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-9a393f59-7f1f-48d1-8291-626191f32edd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.082476 Mar 08 15:23:57.593948 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1110/2233] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:23:57 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:23:57.894819 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c73ab97b-b48c-4023-9de3-52e523fc192c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:57.895532 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-c73ab97b-b48c-4023-9de3-52e523fc192c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:57.901371 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c73ab97b-b48c-4023-9de3-52e523fc192c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:57.901831 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c73ab97b-b48c-4023-9de3-52e523fc192c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:57.902627 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c73ab97b-b48c-4023-9de3-52e523fc192c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:57.903074 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c73ab97b-b48c-4023-9de3-52e523fc192c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:57.961296 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-c73ab97b-b48c-4023-9de3-52e523fc192c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:57.969060 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-c73ab97b-b48c-4023-9de3-52e523fc192c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.078559 Mar 08 15:23:57.969620 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1111/2234] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:23:57 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:23:58.612273 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f8705773-175d-4e73-abb6-bfe3b1eef445 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:58.612809 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f8705773-175d-4e73-abb6-bfe3b1eef445 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:58.619349 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f8705773-175d-4e73-abb6-bfe3b1eef445 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:58.619805 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f8705773-175d-4e73-abb6-bfe3b1eef445 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:58.620597 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f8705773-175d-4e73-abb6-bfe3b1eef445 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:58.621014 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f8705773-175d-4e73-abb6-bfe3b1eef445 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:58.680870 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f8705773-175d-4e73-abb6-bfe3b1eef445 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:58.689047 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f8705773-175d-4e73-abb6-bfe3b1eef445 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:58.690604 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f8705773-175d-4e73-abb6-bfe3b1eef445 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:58.692239 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f8705773-175d-4e73-abb6-bfe3b1eef445 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.084193 Mar 08 15:23:58.692797 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1112/2235] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:23:58 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:23:58.984876 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-a0a683f6-672c-4572-98b3-325603b033fe tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:58.985490 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-a0a683f6-672c-4572-98b3-325603b033fe tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:58.993337 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a0a683f6-672c-4572-98b3-325603b033fe tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:58.993792 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a0a683f6-672c-4572-98b3-325603b033fe tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:58.994586 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a0a683f6-672c-4572-98b3-325603b033fe tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:58.995025 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a0a683f6-672c-4572-98b3-325603b033fe tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:59.053206 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-a0a683f6-672c-4572-98b3-325603b033fe tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:59.060800 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-a0a683f6-672c-4572-98b3-325603b033fe tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.079752 Mar 08 15:23:59.061363 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1113/2236] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:23:58 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:23:59.710860 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-cea6e1f0-afb8-445e-8b76-c913592bf1d3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:23:59.711469 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-cea6e1f0-afb8-445e-8b76-c913592bf1d3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:23:59.717621 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cea6e1f0-afb8-445e-8b76-c913592bf1d3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:59.718107 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cea6e1f0-afb8-445e-8b76-c913592bf1d3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:59.718863 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cea6e1f0-afb8-445e-8b76-c913592bf1d3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:23:59.719298 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cea6e1f0-afb8-445e-8b76-c913592bf1d3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:23:59.778636 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-cea6e1f0-afb8-445e-8b76-c913592bf1d3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:59.788021 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-cea6e1f0-afb8-445e-8b76-c913592bf1d3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:59.789552 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-cea6e1f0-afb8-445e-8b76-c913592bf1d3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:23:59.790795 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-cea6e1f0-afb8-445e-8b76-c913592bf1d3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.084615 Mar 08 15:23:59.791369 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1114/2237] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:23:59 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:00.078037 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-99a17690-c033-4b14-86e6-0d5e56fab407 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:00.078697 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-99a17690-c033-4b14-86e6-0d5e56fab407 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:00.085583 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-99a17690-c033-4b14-86e6-0d5e56fab407 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:00.086069 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-99a17690-c033-4b14-86e6-0d5e56fab407 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:00.086840 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-99a17690-c033-4b14-86e6-0d5e56fab407 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:00.087283 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-99a17690-c033-4b14-86e6-0d5e56fab407 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:00.149931 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-99a17690-c033-4b14-86e6-0d5e56fab407 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:00.158679 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-99a17690-c033-4b14-86e6-0d5e56fab407 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.084532 Mar 08 15:24:00.159236 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1115/2238] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:00 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:24:00.809447 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-71fc6700-06e5-4eff-9a17-da2623aa42e2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:00.810088 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-71fc6700-06e5-4eff-9a17-da2623aa42e2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:00.816990 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-71fc6700-06e5-4eff-9a17-da2623aa42e2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:00.817449 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-71fc6700-06e5-4eff-9a17-da2623aa42e2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:00.818248 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-71fc6700-06e5-4eff-9a17-da2623aa42e2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:00.818692 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-71fc6700-06e5-4eff-9a17-da2623aa42e2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:00.877706 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-71fc6700-06e5-4eff-9a17-da2623aa42e2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:00.886130 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-71fc6700-06e5-4eff-9a17-da2623aa42e2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:00.887624 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-71fc6700-06e5-4eff-9a17-da2623aa42e2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:00.888775 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-71fc6700-06e5-4eff-9a17-da2623aa42e2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.083256 Mar 08 15:24:00.889316 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1116/2239] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:00 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:01.177205 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b87f3c5a-5138-4695-8037-1d214296b72f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:01.177867 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b87f3c5a-5138-4695-8037-1d214296b72f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:01.183547 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b87f3c5a-5138-4695-8037-1d214296b72f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:01.183992 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b87f3c5a-5138-4695-8037-1d214296b72f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:01.184777 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b87f3c5a-5138-4695-8037-1d214296b72f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:01.185208 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b87f3c5a-5138-4695-8037-1d214296b72f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:01.243277 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b87f3c5a-5138-4695-8037-1d214296b72f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:01.250863 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b87f3c5a-5138-4695-8037-1d214296b72f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.077628 Mar 08 15:24:01.251551 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1117/2240] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:01 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:24:01.906760 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-29a35406-da06-404f-808a-3130b7ae0593 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:01.907364 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-29a35406-da06-404f-808a-3130b7ae0593 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:01.914515 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-29a35406-da06-404f-808a-3130b7ae0593 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:01.914962 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-29a35406-da06-404f-808a-3130b7ae0593 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:01.915717 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-29a35406-da06-404f-808a-3130b7ae0593 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:01.916150 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-29a35406-da06-404f-808a-3130b7ae0593 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:01.975550 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-29a35406-da06-404f-808a-3130b7ae0593 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:01.983788 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-29a35406-da06-404f-808a-3130b7ae0593 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:01.985301 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-29a35406-da06-404f-808a-3130b7ae0593 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:01.986479 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-29a35406-da06-404f-808a-3130b7ae0593 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.083664 Mar 08 15:24:01.987038 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1118/2241] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:01 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:02.267988 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-42cf830a-31f4-471a-8323-68caafb995e6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:02.268599 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-42cf830a-31f4-471a-8323-68caafb995e6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:02.274399 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-42cf830a-31f4-471a-8323-68caafb995e6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:02.274851 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-42cf830a-31f4-471a-8323-68caafb995e6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:02.275609 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-42cf830a-31f4-471a-8323-68caafb995e6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:02.276045 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-42cf830a-31f4-471a-8323-68caafb995e6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:02.334962 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-42cf830a-31f4-471a-8323-68caafb995e6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:02.342598 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-42cf830a-31f4-471a-8323-68caafb995e6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.078490 Mar 08 15:24:02.343153 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1119/2242] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:02 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:24:03.004715 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f4ebfb6c-fd46-46f5-82cd-4b5b3c5759a5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:03.005328 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f4ebfb6c-fd46-46f5-82cd-4b5b3c5759a5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:03.011635 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f4ebfb6c-fd46-46f5-82cd-4b5b3c5759a5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:03.012096 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f4ebfb6c-fd46-46f5-82cd-4b5b3c5759a5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:03.012869 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f4ebfb6c-fd46-46f5-82cd-4b5b3c5759a5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:03.013313 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f4ebfb6c-fd46-46f5-82cd-4b5b3c5759a5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:03.071920 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f4ebfb6c-fd46-46f5-82cd-4b5b3c5759a5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:03.079971 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f4ebfb6c-fd46-46f5-82cd-4b5b3c5759a5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:03.081492 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f4ebfb6c-fd46-46f5-82cd-4b5b3c5759a5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:03.083367 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f4ebfb6c-fd46-46f5-82cd-4b5b3c5759a5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.083105 Mar 08 15:24:03.083925 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1120/2243] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:02 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:03.360136 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-dd2a8741-7286-4b6f-824e-4be954f1afc5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:03.360806 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-dd2a8741-7286-4b6f-824e-4be954f1afc5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:03.366974 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dd2a8741-7286-4b6f-824e-4be954f1afc5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:03.367428 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dd2a8741-7286-4b6f-824e-4be954f1afc5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:03.368196 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dd2a8741-7286-4b6f-824e-4be954f1afc5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:03.368637 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dd2a8741-7286-4b6f-824e-4be954f1afc5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:03.431149 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-dd2a8741-7286-4b6f-824e-4be954f1afc5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:03.438990 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-dd2a8741-7286-4b6f-824e-4be954f1afc5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.082861 Mar 08 15:24:03.439561 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1121/2244] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:03 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:24:04.101566 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-8b69731f-d7a1-4173-a865-ad8a0c9e9c85 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:04.102204 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-8b69731f-d7a1-4173-a865-ad8a0c9e9c85 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:04.108501 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8b69731f-d7a1-4173-a865-ad8a0c9e9c85 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:04.108955 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8b69731f-d7a1-4173-a865-ad8a0c9e9c85 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:04.109722 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8b69731f-d7a1-4173-a865-ad8a0c9e9c85 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:04.110195 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8b69731f-d7a1-4173-a865-ad8a0c9e9c85 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:04.170284 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-8b69731f-d7a1-4173-a865-ad8a0c9e9c85 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:04.178413 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-8b69731f-d7a1-4173-a865-ad8a0c9e9c85 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:04.179911 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-8b69731f-d7a1-4173-a865-ad8a0c9e9c85 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:04.181039 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-8b69731f-d7a1-4173-a865-ad8a0c9e9c85 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.083942 Mar 08 15:24:04.181615 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1122/2245] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:04 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:04.456189 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d8d2011b-cc76-4677-827e-6056f2554040 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:04.457837 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d8d2011b-cc76-4677-827e-6056f2554040 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:04.464125 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d8d2011b-cc76-4677-827e-6056f2554040 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:04.464570 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d8d2011b-cc76-4677-827e-6056f2554040 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:04.465341 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d8d2011b-cc76-4677-827e-6056f2554040 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:04.465779 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d8d2011b-cc76-4677-827e-6056f2554040 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:04.525485 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d8d2011b-cc76-4677-827e-6056f2554040 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:04.533423 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d8d2011b-cc76-4677-827e-6056f2554040 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.081091 Mar 08 15:24:04.534017 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1123/2246] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:04 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:24:05.198997 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d832bf6d-66bd-4618-adfb-6157ee47479f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:05.199553 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d832bf6d-66bd-4618-adfb-6157ee47479f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:05.205796 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d832bf6d-66bd-4618-adfb-6157ee47479f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:05.206281 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d832bf6d-66bd-4618-adfb-6157ee47479f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:05.207571 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d832bf6d-66bd-4618-adfb-6157ee47479f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:05.208004 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d832bf6d-66bd-4618-adfb-6157ee47479f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:05.266130 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d832bf6d-66bd-4618-adfb-6157ee47479f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:05.274909 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d832bf6d-66bd-4618-adfb-6157ee47479f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:05.276410 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d832bf6d-66bd-4618-adfb-6157ee47479f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:05.277533 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d832bf6d-66bd-4618-adfb-6157ee47479f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.082578 Mar 08 15:24:05.278126 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1124/2247] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:05 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:05.550163 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-440b3f16-ca18-4a3a-b8c1-d614665dcfc2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:05.551120 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-440b3f16-ca18-4a3a-b8c1-d614665dcfc2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:05.556906 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-440b3f16-ca18-4a3a-b8c1-d614665dcfc2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:05.557358 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-440b3f16-ca18-4a3a-b8c1-d614665dcfc2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:05.558155 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-440b3f16-ca18-4a3a-b8c1-d614665dcfc2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:05.558595 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-440b3f16-ca18-4a3a-b8c1-d614665dcfc2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:05.617658 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-440b3f16-ca18-4a3a-b8c1-d614665dcfc2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:05.625235 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-440b3f16-ca18-4a3a-b8c1-d614665dcfc2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.078916 Mar 08 15:24:05.625791 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1125/2248] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:05 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:24:06.295656 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d073427f-79b7-4331-9968-306a67ea7260 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:06.296269 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d073427f-79b7-4331-9968-306a67ea7260 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:06.302864 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d073427f-79b7-4331-9968-306a67ea7260 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:06.303319 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d073427f-79b7-4331-9968-306a67ea7260 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:06.304084 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d073427f-79b7-4331-9968-306a67ea7260 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:06.304525 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d073427f-79b7-4331-9968-306a67ea7260 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:06.362271 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d073427f-79b7-4331-9968-306a67ea7260 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:06.370942 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d073427f-79b7-4331-9968-306a67ea7260 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:06.372451 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d073427f-79b7-4331-9968-306a67ea7260 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:06.373569 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d073427f-79b7-4331-9968-306a67ea7260 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.082016 Mar 08 15:24:06.374169 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1126/2249] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:06 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:06.641767 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5ef40464-00d2-4d99-bdf0-e807eb3cb6b8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:06.642455 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5ef40464-00d2-4d99-bdf0-e807eb3cb6b8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:06.648706 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5ef40464-00d2-4d99-bdf0-e807eb3cb6b8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:06.649157 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5ef40464-00d2-4d99-bdf0-e807eb3cb6b8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:06.649952 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5ef40464-00d2-4d99-bdf0-e807eb3cb6b8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:06.650392 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5ef40464-00d2-4d99-bdf0-e807eb3cb6b8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:06.714967 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-5ef40464-00d2-4d99-bdf0-e807eb3cb6b8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:06.723491 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5ef40464-00d2-4d99-bdf0-e807eb3cb6b8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.085636 Mar 08 15:24:06.724069 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1127/2250] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:06 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:24:07.392084 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f094b6d4-b7cf-4cc2-8bb1-09dcbf3e5461 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:07.392693 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f094b6d4-b7cf-4cc2-8bb1-09dcbf3e5461 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:07.400437 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f094b6d4-b7cf-4cc2-8bb1-09dcbf3e5461 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:07.400890 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f094b6d4-b7cf-4cc2-8bb1-09dcbf3e5461 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:07.401652 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f094b6d4-b7cf-4cc2-8bb1-09dcbf3e5461 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:07.402117 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f094b6d4-b7cf-4cc2-8bb1-09dcbf3e5461 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:07.461435 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f094b6d4-b7cf-4cc2-8bb1-09dcbf3e5461 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:07.469611 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f094b6d4-b7cf-4cc2-8bb1-09dcbf3e5461 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:07.471150 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f094b6d4-b7cf-4cc2-8bb1-09dcbf3e5461 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:07.473439 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f094b6d4-b7cf-4cc2-8bb1-09dcbf3e5461 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.084436 Mar 08 15:24:07.474036 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1128/2251] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:07 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:07.739942 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5be960c6-54e7-4b1e-a93f-41eed1ed962f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:07.740588 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5be960c6-54e7-4b1e-a93f-41eed1ed962f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:07.746718 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5be960c6-54e7-4b1e-a93f-41eed1ed962f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:07.747171 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5be960c6-54e7-4b1e-a93f-41eed1ed962f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:07.747931 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5be960c6-54e7-4b1e-a93f-41eed1ed962f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:07.748363 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5be960c6-54e7-4b1e-a93f-41eed1ed962f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:07.808600 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-5be960c6-54e7-4b1e-a93f-41eed1ed962f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:07.816794 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5be960c6-54e7-4b1e-a93f-41eed1ed962f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.080844 Mar 08 15:24:07.817362 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1129/2252] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:07 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:24:08.492147 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-db0a3ba8-d35c-42ad-bf2a-2acde3f445f7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:08.492754 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-db0a3ba8-d35c-42ad-bf2a-2acde3f445f7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:08.499042 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-db0a3ba8-d35c-42ad-bf2a-2acde3f445f7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:08.499502 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-db0a3ba8-d35c-42ad-bf2a-2acde3f445f7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:08.500270 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-db0a3ba8-d35c-42ad-bf2a-2acde3f445f7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:08.500711 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-db0a3ba8-d35c-42ad-bf2a-2acde3f445f7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:08.560195 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-db0a3ba8-d35c-42ad-bf2a-2acde3f445f7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:08.569000 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-db0a3ba8-d35c-42ad-bf2a-2acde3f445f7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:08.570484 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-db0a3ba8-d35c-42ad-bf2a-2acde3f445f7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:08.571609 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-db0a3ba8-d35c-42ad-bf2a-2acde3f445f7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.084374 Mar 08 15:24:08.572164 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1130/2253] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:08 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:08.834150 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5a5e3e82-2298-44c4-b907-9de5b0f48428 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:08.834783 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5a5e3e82-2298-44c4-b907-9de5b0f48428 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:08.840785 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5a5e3e82-2298-44c4-b907-9de5b0f48428 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:08.841241 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5a5e3e82-2298-44c4-b907-9de5b0f48428 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:08.842042 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5a5e3e82-2298-44c4-b907-9de5b0f48428 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:08.842481 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5a5e3e82-2298-44c4-b907-9de5b0f48428 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:08.902383 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-5a5e3e82-2298-44c4-b907-9de5b0f48428 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:08.911121 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5a5e3e82-2298-44c4-b907-9de5b0f48428 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.081457 Mar 08 15:24:08.911692 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1131/2254] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:08 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:24:09.589095 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-70d149ae-44cd-4e5e-80fd-e51a753ee078 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:09.589705 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-70d149ae-44cd-4e5e-80fd-e51a753ee078 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:09.595992 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-70d149ae-44cd-4e5e-80fd-e51a753ee078 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:09.596463 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-70d149ae-44cd-4e5e-80fd-e51a753ee078 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:09.598416 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-70d149ae-44cd-4e5e-80fd-e51a753ee078 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:09.598866 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-70d149ae-44cd-4e5e-80fd-e51a753ee078 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:09.658039 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-70d149ae-44cd-4e5e-80fd-e51a753ee078 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:09.666995 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-70d149ae-44cd-4e5e-80fd-e51a753ee078 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:09.668511 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-70d149ae-44cd-4e5e-80fd-e51a753ee078 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:09.669643 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-70d149ae-44cd-4e5e-80fd-e51a753ee078 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.084465 Mar 08 15:24:09.670246 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1132/2255] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:09 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:09.927924 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-8187eae6-be0a-4041-816f-0a21479ace83 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:09.928561 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-8187eae6-be0a-4041-816f-0a21479ace83 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:09.934399 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8187eae6-be0a-4041-816f-0a21479ace83 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:09.934853 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8187eae6-be0a-4041-816f-0a21479ace83 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:09.935621 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8187eae6-be0a-4041-816f-0a21479ace83 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:09.936060 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8187eae6-be0a-4041-816f-0a21479ace83 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:09.998961 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-8187eae6-be0a-4041-816f-0a21479ace83 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:10.007077 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-8187eae6-be0a-4041-816f-0a21479ace83 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.083295 Mar 08 15:24:10.007638 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1133/2256] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:09 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:24:10.687633 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ae89811f-2d82-4509-98fe-4b6ca5e08a93 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:10.688179 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ae89811f-2d82-4509-98fe-4b6ca5e08a93 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:10.694961 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ae89811f-2d82-4509-98fe-4b6ca5e08a93 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:10.695414 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ae89811f-2d82-4509-98fe-4b6ca5e08a93 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:10.696185 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ae89811f-2d82-4509-98fe-4b6ca5e08a93 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:10.696621 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ae89811f-2d82-4509-98fe-4b6ca5e08a93 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:10.756303 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ae89811f-2d82-4509-98fe-4b6ca5e08a93 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:10.764445 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ae89811f-2d82-4509-98fe-4b6ca5e08a93 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:10.765976 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ae89811f-2d82-4509-98fe-4b6ca5e08a93 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:10.767105 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ae89811f-2d82-4509-98fe-4b6ca5e08a93 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.083484 Mar 08 15:24:10.767658 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1134/2257] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:10 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:11.023733 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-6ed15011-f37a-4377-a317-d29ccc5b5fa3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:11.024345 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-6ed15011-f37a-4377-a317-d29ccc5b5fa3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:11.030158 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6ed15011-f37a-4377-a317-d29ccc5b5fa3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:11.030616 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6ed15011-f37a-4377-a317-d29ccc5b5fa3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:11.031380 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6ed15011-f37a-4377-a317-d29ccc5b5fa3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:11.031815 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6ed15011-f37a-4377-a317-d29ccc5b5fa3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:11.089527 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-6ed15011-f37a-4377-a317-d29ccc5b5fa3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:11.097210 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-6ed15011-f37a-4377-a317-d29ccc5b5fa3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.077299 Mar 08 15:24:11.097779 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1135/2258] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:11 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:24:11.785358 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f49e33de-4754-41c6-b971-49e039c7d214 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:11.786020 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f49e33de-4754-41c6-b971-49e039c7d214 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:11.792212 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f49e33de-4754-41c6-b971-49e039c7d214 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:11.792668 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f49e33de-4754-41c6-b971-49e039c7d214 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:11.793428 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f49e33de-4754-41c6-b971-49e039c7d214 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:11.793878 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f49e33de-4754-41c6-b971-49e039c7d214 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:11.853686 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f49e33de-4754-41c6-b971-49e039c7d214 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:11.861668 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f49e33de-4754-41c6-b971-49e039c7d214 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:11.863829 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f49e33de-4754-41c6-b971-49e039c7d214 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:11.864942 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f49e33de-4754-41c6-b971-49e039c7d214 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.084352 Mar 08 15:24:11.865494 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1136/2259] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:11 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:12.114353 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b2a8c641-8a2f-49d9-8b90-c1242c9dedb1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:12.115041 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b2a8c641-8a2f-49d9-8b90-c1242c9dedb1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:12.121191 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b2a8c641-8a2f-49d9-8b90-c1242c9dedb1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:12.121645 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b2a8c641-8a2f-49d9-8b90-c1242c9dedb1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:12.122450 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b2a8c641-8a2f-49d9-8b90-c1242c9dedb1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:12.122891 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b2a8c641-8a2f-49d9-8b90-c1242c9dedb1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:12.181166 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b2a8c641-8a2f-49d9-8b90-c1242c9dedb1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:12.188823 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b2a8c641-8a2f-49d9-8b90-c1242c9dedb1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.078908 Mar 08 15:24:12.189376 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1137/2260] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:12 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:24:12.883579 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-cb687833-3c46-4bb7-8acc-e625b586a898 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:12.884190 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-cb687833-3c46-4bb7-8acc-e625b586a898 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:12.890444 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cb687833-3c46-4bb7-8acc-e625b586a898 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:12.890894 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cb687833-3c46-4bb7-8acc-e625b586a898 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:12.891658 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cb687833-3c46-4bb7-8acc-e625b586a898 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:12.892096 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cb687833-3c46-4bb7-8acc-e625b586a898 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:12.951766 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-cb687833-3c46-4bb7-8acc-e625b586a898 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:12.960842 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-cb687833-3c46-4bb7-8acc-e625b586a898 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:12.962362 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-cb687833-3c46-4bb7-8acc-e625b586a898 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:12.963486 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-cb687833-3c46-4bb7-8acc-e625b586a898 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.083822 Mar 08 15:24:12.964035 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1138/2261] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:12 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:13.205484 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-0403cbd7-2e2b-4fc5-b788-0942b5136cc7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:13.206133 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-0403cbd7-2e2b-4fc5-b788-0942b5136cc7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:13.211923 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0403cbd7-2e2b-4fc5-b788-0942b5136cc7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:13.212382 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0403cbd7-2e2b-4fc5-b788-0942b5136cc7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:13.213152 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0403cbd7-2e2b-4fc5-b788-0942b5136cc7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:13.213594 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0403cbd7-2e2b-4fc5-b788-0942b5136cc7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:13.279914 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-0403cbd7-2e2b-4fc5-b788-0942b5136cc7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:13.287947 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-0403cbd7-2e2b-4fc5-b788-0942b5136cc7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.086240 Mar 08 15:24:13.288515 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1139/2262] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:13 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:24:13.981759 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-e077e55a-89a7-4a86-95b2-e607b3e885b1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:13.982393 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-e077e55a-89a7-4a86-95b2-e607b3e885b1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:13.988752 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e077e55a-89a7-4a86-95b2-e607b3e885b1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:13.989199 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e077e55a-89a7-4a86-95b2-e607b3e885b1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:13.989979 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e077e55a-89a7-4a86-95b2-e607b3e885b1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:13.990414 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e077e55a-89a7-4a86-95b2-e607b3e885b1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:14.048584 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-e077e55a-89a7-4a86-95b2-e607b3e885b1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:14.056885 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-e077e55a-89a7-4a86-95b2-e607b3e885b1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:14.058421 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-e077e55a-89a7-4a86-95b2-e607b3e885b1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:14.059571 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-e077e55a-89a7-4a86-95b2-e607b3e885b1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.081687 Mar 08 15:24:14.060118 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1140/2263] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:13 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:14.304740 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-8e9125a9-d6b2-4137-bc97-dfadac7650fe tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:14.305393 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-8e9125a9-d6b2-4137-bc97-dfadac7650fe tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:14.311173 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8e9125a9-d6b2-4137-bc97-dfadac7650fe tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:14.311619 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8e9125a9-d6b2-4137-bc97-dfadac7650fe tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:14.312382 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8e9125a9-d6b2-4137-bc97-dfadac7650fe tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:14.312822 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8e9125a9-d6b2-4137-bc97-dfadac7650fe tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:14.370867 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-8e9125a9-d6b2-4137-bc97-dfadac7650fe tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:14.379346 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-8e9125a9-d6b2-4137-bc97-dfadac7650fe tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.078396 Mar 08 15:24:14.379915 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1141/2264] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:14 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:24:15.076555 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-0fbaccf1-a81d-4e43-95a2-ae8f9b35d7f2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:15.077189 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-0fbaccf1-a81d-4e43-95a2-ae8f9b35d7f2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:15.083653 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0fbaccf1-a81d-4e43-95a2-ae8f9b35d7f2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:15.084104 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0fbaccf1-a81d-4e43-95a2-ae8f9b35d7f2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:15.084862 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0fbaccf1-a81d-4e43-95a2-ae8f9b35d7f2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:15.085292 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0fbaccf1-a81d-4e43-95a2-ae8f9b35d7f2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:15.145510 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-0fbaccf1-a81d-4e43-95a2-ae8f9b35d7f2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:15.153613 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-0fbaccf1-a81d-4e43-95a2-ae8f9b35d7f2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:15.155185 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-0fbaccf1-a81d-4e43-95a2-ae8f9b35d7f2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:15.156317 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-0fbaccf1-a81d-4e43-95a2-ae8f9b35d7f2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.083661 Mar 08 15:24:15.156870 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1142/2265] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:15 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:15.396392 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-1e466135-892e-4fa4-899a-38dac8bf8a95 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:15.397076 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-1e466135-892e-4fa4-899a-38dac8bf8a95 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:15.402873 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1e466135-892e-4fa4-899a-38dac8bf8a95 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:15.403324 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1e466135-892e-4fa4-899a-38dac8bf8a95 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:15.404092 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1e466135-892e-4fa4-899a-38dac8bf8a95 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:15.404532 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1e466135-892e-4fa4-899a-38dac8bf8a95 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:15.464436 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-1e466135-892e-4fa4-899a-38dac8bf8a95 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:15.472720 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-1e466135-892e-4fa4-899a-38dac8bf8a95 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.079536 Mar 08 15:24:15.473283 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1143/2266] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:15 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:24:16.175713 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-46d8ea38-5beb-4cf4-adaf-5b230859daf5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:16.176329 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-46d8ea38-5beb-4cf4-adaf-5b230859daf5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:16.182698 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-46d8ea38-5beb-4cf4-adaf-5b230859daf5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:16.183155 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-46d8ea38-5beb-4cf4-adaf-5b230859daf5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:16.183924 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-46d8ea38-5beb-4cf4-adaf-5b230859daf5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:16.184367 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-46d8ea38-5beb-4cf4-adaf-5b230859daf5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:16.243463 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-46d8ea38-5beb-4cf4-adaf-5b230859daf5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:16.251596 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-46d8ea38-5beb-4cf4-adaf-5b230859daf5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:16.253128 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-46d8ea38-5beb-4cf4-adaf-5b230859daf5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:16.254291 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-46d8ea38-5beb-4cf4-adaf-5b230859daf5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.083065 Mar 08 15:24:16.254853 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1144/2267] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:16 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:16.488409 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f88ab14c-0013-41c7-88d9-33034a73c8e3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:16.489043 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f88ab14c-0013-41c7-88d9-33034a73c8e3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:16.494956 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f88ab14c-0013-41c7-88d9-33034a73c8e3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:16.495413 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f88ab14c-0013-41c7-88d9-33034a73c8e3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:16.496185 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f88ab14c-0013-41c7-88d9-33034a73c8e3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:16.496627 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f88ab14c-0013-41c7-88d9-33034a73c8e3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:16.558469 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f88ab14c-0013-41c7-88d9-33034a73c8e3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:16.566918 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f88ab14c-0013-41c7-88d9-33034a73c8e3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.082222 Mar 08 15:24:16.567499 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1145/2268] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:16 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:24:17.272622 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-6b37d0e3-6d48-4844-9d5a-357c74cde38b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:17.273232 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-6b37d0e3-6d48-4844-9d5a-357c74cde38b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:17.279486 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6b37d0e3-6d48-4844-9d5a-357c74cde38b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:17.279942 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6b37d0e3-6d48-4844-9d5a-357c74cde38b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:17.280704 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6b37d0e3-6d48-4844-9d5a-357c74cde38b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:17.281141 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6b37d0e3-6d48-4844-9d5a-357c74cde38b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:17.340532 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-6b37d0e3-6d48-4844-9d5a-357c74cde38b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:17.348754 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-6b37d0e3-6d48-4844-9d5a-357c74cde38b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:17.350284 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-6b37d0e3-6d48-4844-9d5a-357c74cde38b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:17.351415 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-6b37d0e3-6d48-4844-9d5a-357c74cde38b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.083231 Mar 08 15:24:17.351970 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1146/2269] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:17 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:17.584662 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f254c47e-e32a-457e-bb10-23122e071a0e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:17.585290 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f254c47e-e32a-457e-bb10-23122e071a0e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:17.591008 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f254c47e-e32a-457e-bb10-23122e071a0e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:17.591459 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f254c47e-e32a-457e-bb10-23122e071a0e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:17.592224 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f254c47e-e32a-457e-bb10-23122e071a0e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:17.592661 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f254c47e-e32a-457e-bb10-23122e071a0e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:17.653007 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f254c47e-e32a-457e-bb10-23122e071a0e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:17.661079 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f254c47e-e32a-457e-bb10-23122e071a0e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.081366 Mar 08 15:24:17.661642 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1147/2270] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:17 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:24:18.370075 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-818ea04c-d460-4e13-8d96-ef659c1b6bfe tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:18.370686 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-818ea04c-d460-4e13-8d96-ef659c1b6bfe tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:18.376872 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-818ea04c-d460-4e13-8d96-ef659c1b6bfe tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:18.377326 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-818ea04c-d460-4e13-8d96-ef659c1b6bfe tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:18.378119 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-818ea04c-d460-4e13-8d96-ef659c1b6bfe tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:18.378559 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-818ea04c-d460-4e13-8d96-ef659c1b6bfe tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:18.439124 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-818ea04c-d460-4e13-8d96-ef659c1b6bfe tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:18.447591 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-818ea04c-d460-4e13-8d96-ef659c1b6bfe tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:18.449102 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-818ea04c-d460-4e13-8d96-ef659c1b6bfe tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:18.450267 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-818ea04c-d460-4e13-8d96-ef659c1b6bfe tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.084128 Mar 08 15:24:18.450825 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1148/2271] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:18 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:24:18.677150 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-33b21bfb-3ef9-4d80-ab09-5fa8650849d3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:18.677780 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-33b21bfb-3ef9-4d80-ab09-5fa8650849d3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:18.683537 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-33b21bfb-3ef9-4d80-ab09-5fa8650849d3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:18.683995 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-33b21bfb-3ef9-4d80-ab09-5fa8650849d3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:18.684767 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-33b21bfb-3ef9-4d80-ab09-5fa8650849d3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:18.685207 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-33b21bfb-3ef9-4d80-ab09-5fa8650849d3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:18.743317 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-33b21bfb-3ef9-4d80-ab09-5fa8650849d3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:18.751270 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-33b21bfb-3ef9-4d80-ab09-5fa8650849d3 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.078105 Mar 08 15:24:18.751833 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1149/2272] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:18 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:24:19.468463 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-29e5376d-63e9-43af-9c6a-eb2a93123b46 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:19.469084 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-29e5376d-63e9-43af-9c6a-eb2a93123b46 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:19.475893 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-29e5376d-63e9-43af-9c6a-eb2a93123b46 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:19.476342 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-29e5376d-63e9-43af-9c6a-eb2a93123b46 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:19.477098 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-29e5376d-63e9-43af-9c6a-eb2a93123b46 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:19.477531 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-29e5376d-63e9-43af-9c6a-eb2a93123b46 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:19.536140 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-29e5376d-63e9-43af-9c6a-eb2a93123b46 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:19.544381 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-29e5376d-63e9-43af-9c6a-eb2a93123b46 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:19.545879 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-29e5376d-63e9-43af-9c6a-eb2a93123b46 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:19.546996 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-29e5376d-63e9-43af-9c6a-eb2a93123b46 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.082411 Mar 08 15:24:19.547544 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1150/2273] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:19 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:19.767649 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-2c4d2f51-16f6-4370-8f8f-e7738a76c7dc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:19.768308 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-2c4d2f51-16f6-4370-8f8f-e7738a76c7dc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:19.774723 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2c4d2f51-16f6-4370-8f8f-e7738a76c7dc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:19.775167 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2c4d2f51-16f6-4370-8f8f-e7738a76c7dc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:19.775921 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2c4d2f51-16f6-4370-8f8f-e7738a76c7dc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:19.776353 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2c4d2f51-16f6-4370-8f8f-e7738a76c7dc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:19.839605 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-2c4d2f51-16f6-4370-8f8f-e7738a76c7dc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:19.847389 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-2c4d2f51-16f6-4370-8f8f-e7738a76c7dc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.083459 Mar 08 15:24:19.847949 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1151/2274] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:19 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:24:20.564462 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-520f9f4a-bab2-4c3f-9b6b-e11ea5bd25b9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:20.565074 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-520f9f4a-bab2-4c3f-9b6b-e11ea5bd25b9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:20.571798 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-520f9f4a-bab2-4c3f-9b6b-e11ea5bd25b9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:20.572224 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-520f9f4a-bab2-4c3f-9b6b-e11ea5bd25b9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:20.572990 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-520f9f4a-bab2-4c3f-9b6b-e11ea5bd25b9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:20.573376 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-520f9f4a-bab2-4c3f-9b6b-e11ea5bd25b9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:20.631881 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-520f9f4a-bab2-4c3f-9b6b-e11ea5bd25b9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:20.640060 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-520f9f4a-bab2-4c3f-9b6b-e11ea5bd25b9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:20.641573 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-520f9f4a-bab2-4c3f-9b6b-e11ea5bd25b9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:20.642729 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-520f9f4a-bab2-4c3f-9b6b-e11ea5bd25b9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.082177 Mar 08 15:24:20.643300 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1152/2275] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:20 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:20.864626 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-8e3b6c5d-f23e-48ac-98e2-02c266720088 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:20.865262 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-8e3b6c5d-f23e-48ac-98e2-02c266720088 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:20.871048 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8e3b6c5d-f23e-48ac-98e2-02c266720088 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:20.871501 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8e3b6c5d-f23e-48ac-98e2-02c266720088 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:20.872263 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8e3b6c5d-f23e-48ac-98e2-02c266720088 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:20.872699 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8e3b6c5d-f23e-48ac-98e2-02c266720088 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:20.931986 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-8e3b6c5d-f23e-48ac-98e2-02c266720088 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:20.939747 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-8e3b6c5d-f23e-48ac-98e2-02c266720088 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.079560 Mar 08 15:24:20.940474 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1153/2276] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:20 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:24:21.661782 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-0ff6ce95-1eed-47a4-8eff-92679467e52f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:21.662443 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-0ff6ce95-1eed-47a4-8eff-92679467e52f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:21.668645 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0ff6ce95-1eed-47a4-8eff-92679467e52f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:21.669095 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0ff6ce95-1eed-47a4-8eff-92679467e52f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:21.669869 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0ff6ce95-1eed-47a4-8eff-92679467e52f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:21.670307 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0ff6ce95-1eed-47a4-8eff-92679467e52f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:21.729981 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-0ff6ce95-1eed-47a4-8eff-92679467e52f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:21.738060 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-0ff6ce95-1eed-47a4-8eff-92679467e52f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:21.739670 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-0ff6ce95-1eed-47a4-8eff-92679467e52f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:21.740796 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-0ff6ce95-1eed-47a4-8eff-92679467e52f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.083954 Mar 08 15:24:21.741342 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1154/2277] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:21 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:21.956453 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-81190a1a-5e17-488d-a15d-54371b0c6d4e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:21.957071 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-81190a1a-5e17-488d-a15d-54371b0c6d4e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:21.963561 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-81190a1a-5e17-488d-a15d-54371b0c6d4e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:21.964010 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-81190a1a-5e17-488d-a15d-54371b0c6d4e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:21.964770 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-81190a1a-5e17-488d-a15d-54371b0c6d4e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:21.965199 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-81190a1a-5e17-488d-a15d-54371b0c6d4e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:22.024153 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-81190a1a-5e17-488d-a15d-54371b0c6d4e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:22.031833 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-81190a1a-5e17-488d-a15d-54371b0c6d4e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.079196 Mar 08 15:24:22.032643 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1155/2278] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:21 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:24:22.758969 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-aa1c7318-d7cf-40a5-a667-c5780eb7ef0d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:22.759577 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-aa1c7318-d7cf-40a5-a667-c5780eb7ef0d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:22.766250 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-aa1c7318-d7cf-40a5-a667-c5780eb7ef0d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:22.766699 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-aa1c7318-d7cf-40a5-a667-c5780eb7ef0d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:22.767465 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-aa1c7318-d7cf-40a5-a667-c5780eb7ef0d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:22.767897 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-aa1c7318-d7cf-40a5-a667-c5780eb7ef0d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:22.826210 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-aa1c7318-d7cf-40a5-a667-c5780eb7ef0d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:22.834362 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-aa1c7318-d7cf-40a5-a667-c5780eb7ef0d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:22.835861 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-aa1c7318-d7cf-40a5-a667-c5780eb7ef0d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:22.836985 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-aa1c7318-d7cf-40a5-a667-c5780eb7ef0d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.082289 Mar 08 15:24:22.837535 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1156/2279] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:22 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:23.048883 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-900b5799-95bb-468b-b128-119457827a2f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:23.049493 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-900b5799-95bb-468b-b128-119457827a2f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:23.055818 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-900b5799-95bb-468b-b128-119457827a2f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:23.056270 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-900b5799-95bb-468b-b128-119457827a2f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:23.057038 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-900b5799-95bb-468b-b128-119457827a2f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:23.057479 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-900b5799-95bb-468b-b128-119457827a2f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:23.119473 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-900b5799-95bb-468b-b128-119457827a2f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:23.127201 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-900b5799-95bb-468b-b128-119457827a2f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.082236 Mar 08 15:24:23.127761 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1157/2280] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:23 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:24:23.854829 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5c1c75f8-4450-4a5f-9d08-a2aa47e59903 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:23.855435 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5c1c75f8-4450-4a5f-9d08-a2aa47e59903 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:23.861661 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5c1c75f8-4450-4a5f-9d08-a2aa47e59903 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:23.862138 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5c1c75f8-4450-4a5f-9d08-a2aa47e59903 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:23.862900 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5c1c75f8-4450-4a5f-9d08-a2aa47e59903 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:23.863337 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5c1c75f8-4450-4a5f-9d08-a2aa47e59903 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:23.922496 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-5c1c75f8-4450-4a5f-9d08-a2aa47e59903 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:23.931258 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-5c1c75f8-4450-4a5f-9d08-a2aa47e59903 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:23.932750 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-5c1c75f8-4450-4a5f-9d08-a2aa47e59903 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:23.933919 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5c1c75f8-4450-4a5f-9d08-a2aa47e59903 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.082931 Mar 08 15:24:23.934485 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1158/2281] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:23 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:24.144563 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d1c8f209-bd88-4312-abe5-8210f4cae1a8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:24.145278 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d1c8f209-bd88-4312-abe5-8210f4cae1a8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:24.151267 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d1c8f209-bd88-4312-abe5-8210f4cae1a8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:24.151727 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d1c8f209-bd88-4312-abe5-8210f4cae1a8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:24.152500 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d1c8f209-bd88-4312-abe5-8210f4cae1a8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:24.152974 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d1c8f209-bd88-4312-abe5-8210f4cae1a8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:24.211230 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d1c8f209-bd88-4312-abe5-8210f4cae1a8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:24.218893 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d1c8f209-bd88-4312-abe5-8210f4cae1a8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.078253 Mar 08 15:24:24.219446 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1159/2282] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:24 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:24:24.953656 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b46c3313-8915-47f1-b1d6-fbf8e7b655aa tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:24.954305 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b46c3313-8915-47f1-b1d6-fbf8e7b655aa tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:24.961549 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b46c3313-8915-47f1-b1d6-fbf8e7b655aa tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:24.962043 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b46c3313-8915-47f1-b1d6-fbf8e7b655aa tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:24.962826 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b46c3313-8915-47f1-b1d6-fbf8e7b655aa tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:24.963266 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b46c3313-8915-47f1-b1d6-fbf8e7b655aa tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:25.022562 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b46c3313-8915-47f1-b1d6-fbf8e7b655aa tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:25.030887 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b46c3313-8915-47f1-b1d6-fbf8e7b655aa tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:25.032666 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b46c3313-8915-47f1-b1d6-fbf8e7b655aa tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:25.033801 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b46c3313-8915-47f1-b1d6-fbf8e7b655aa tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.084101 Mar 08 15:24:25.034405 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1160/2283] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:24 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:25.235983 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3d434178-8cf7-4b3b-b22a-1dd67120dd7a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:25.236647 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-3d434178-8cf7-4b3b-b22a-1dd67120dd7a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:25.243144 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3d434178-8cf7-4b3b-b22a-1dd67120dd7a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:25.243601 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3d434178-8cf7-4b3b-b22a-1dd67120dd7a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:25.244367 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3d434178-8cf7-4b3b-b22a-1dd67120dd7a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:25.244804 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3d434178-8cf7-4b3b-b22a-1dd67120dd7a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:25.303510 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-3d434178-8cf7-4b3b-b22a-1dd67120dd7a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:25.311103 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-3d434178-8cf7-4b3b-b22a-1dd67120dd7a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.078951 Mar 08 15:24:25.311661 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1161/2284] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:25 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:24:25.529244 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 15:24:25.529458 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: Tue Mar 8 15:24:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 15:24:26.051595 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-26215bf1-b68e-4365-aa59-1b51ac8b0893 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:26.052180 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-26215bf1-b68e-4365-aa59-1b51ac8b0893 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:26.058471 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-26215bf1-b68e-4365-aa59-1b51ac8b0893 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:26.058925 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-26215bf1-b68e-4365-aa59-1b51ac8b0893 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:26.059690 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-26215bf1-b68e-4365-aa59-1b51ac8b0893 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:26.060127 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-26215bf1-b68e-4365-aa59-1b51ac8b0893 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:26.119039 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-26215bf1-b68e-4365-aa59-1b51ac8b0893 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:26.127057 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-26215bf1-b68e-4365-aa59-1b51ac8b0893 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:26.128567 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-26215bf1-b68e-4365-aa59-1b51ac8b0893 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:26.130247 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-26215bf1-b68e-4365-aa59-1b51ac8b0893 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.082054 Mar 08 15:24:26.130804 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1162/2285] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:26 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:26.328465 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c4dc7b7b-a1e5-45b4-ada8-90971aaedff8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:26.329076 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-c4dc7b7b-a1e5-45b4-ada8-90971aaedff8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:26.335819 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c4dc7b7b-a1e5-45b4-ada8-90971aaedff8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:26.336266 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c4dc7b7b-a1e5-45b4-ada8-90971aaedff8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:26.337027 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c4dc7b7b-a1e5-45b4-ada8-90971aaedff8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:26.337462 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c4dc7b7b-a1e5-45b4-ada8-90971aaedff8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:26.401039 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-c4dc7b7b-a1e5-45b4-ada8-90971aaedff8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:26.409048 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-c4dc7b7b-a1e5-45b4-ada8-90971aaedff8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.084443 Mar 08 15:24:26.409601 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1163/2286] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:26 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:24:27.148357 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-33a262cf-497e-4046-9047-478c886e13cc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:27.148974 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-33a262cf-497e-4046-9047-478c886e13cc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:27.155293 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-33a262cf-497e-4046-9047-478c886e13cc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:27.155736 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-33a262cf-497e-4046-9047-478c886e13cc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:27.156499 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-33a262cf-497e-4046-9047-478c886e13cc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:27.156928 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-33a262cf-497e-4046-9047-478c886e13cc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:27.217405 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-33a262cf-497e-4046-9047-478c886e13cc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:27.226339 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-33a262cf-497e-4046-9047-478c886e13cc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:27.227833 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-33a262cf-497e-4046-9047-478c886e13cc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:27.228956 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-33a262cf-497e-4046-9047-478c886e13cc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.084639 Mar 08 15:24:27.229670 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1164/2287] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:27 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:27.425033 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-862ee9eb-aa40-43f1-a650-ac98a6eeac7a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:27.425678 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-862ee9eb-aa40-43f1-a650-ac98a6eeac7a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:27.431795 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-862ee9eb-aa40-43f1-a650-ac98a6eeac7a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:27.432244 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-862ee9eb-aa40-43f1-a650-ac98a6eeac7a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:27.432999 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-862ee9eb-aa40-43f1-a650-ac98a6eeac7a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:27.433434 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-862ee9eb-aa40-43f1-a650-ac98a6eeac7a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:27.491996 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-862ee9eb-aa40-43f1-a650-ac98a6eeac7a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:27.499780 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-862ee9eb-aa40-43f1-a650-ac98a6eeac7a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.078544 Mar 08 15:24:27.500348 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1165/2288] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:27 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:24:28.247637 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c4fdee5e-faeb-44c1-80af-6f1f46a5ca39 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:28.248252 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-c4fdee5e-faeb-44c1-80af-6f1f46a5ca39 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:28.255191 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c4fdee5e-faeb-44c1-80af-6f1f46a5ca39 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:28.255646 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c4fdee5e-faeb-44c1-80af-6f1f46a5ca39 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:28.256419 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c4fdee5e-faeb-44c1-80af-6f1f46a5ca39 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:28.256857 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c4fdee5e-faeb-44c1-80af-6f1f46a5ca39 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:28.321405 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-c4fdee5e-faeb-44c1-80af-6f1f46a5ca39 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:28.330286 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-c4fdee5e-faeb-44c1-80af-6f1f46a5ca39 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:28.331811 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-c4fdee5e-faeb-44c1-80af-6f1f46a5ca39 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:28.332954 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-c4fdee5e-faeb-44c1-80af-6f1f46a5ca39 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.089247 Mar 08 15:24:28.333515 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1166/2289] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:28 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:28.516648 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f5da2012-332c-4a76-8d6a-e04fab5e6657 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:28.517335 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f5da2012-332c-4a76-8d6a-e04fab5e6657 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:28.523140 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f5da2012-332c-4a76-8d6a-e04fab5e6657 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:28.523590 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f5da2012-332c-4a76-8d6a-e04fab5e6657 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:28.524363 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f5da2012-332c-4a76-8d6a-e04fab5e6657 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:28.524801 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f5da2012-332c-4a76-8d6a-e04fab5e6657 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:28.591400 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f5da2012-332c-4a76-8d6a-e04fab5e6657 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:28.600300 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f5da2012-332c-4a76-8d6a-e04fab5e6657 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.087559 Mar 08 15:24:28.600942 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1167/2290] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:28 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:24:29.350794 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-2bfdde7c-2c07-4f42-a5d4-113caef0b317 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:29.351408 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-2bfdde7c-2c07-4f42-a5d4-113caef0b317 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:29.357682 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2bfdde7c-2c07-4f42-a5d4-113caef0b317 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:29.358176 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2bfdde7c-2c07-4f42-a5d4-113caef0b317 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:29.358947 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2bfdde7c-2c07-4f42-a5d4-113caef0b317 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:29.359388 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2bfdde7c-2c07-4f42-a5d4-113caef0b317 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:29.418392 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-2bfdde7c-2c07-4f42-a5d4-113caef0b317 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:29.427819 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-2bfdde7c-2c07-4f42-a5d4-113caef0b317 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:29.429350 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-2bfdde7c-2c07-4f42-a5d4-113caef0b317 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:29.430530 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-2bfdde7c-2c07-4f42-a5d4-113caef0b317 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.083625 Mar 08 15:24:29.431090 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1168/2291] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:29 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:29.617847 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-89a8e362-05e7-49aa-be7e-727c2ea5d93a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:29.618522 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-89a8e362-05e7-49aa-be7e-727c2ea5d93a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:29.624236 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-89a8e362-05e7-49aa-be7e-727c2ea5d93a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:29.624689 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-89a8e362-05e7-49aa-be7e-727c2ea5d93a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:29.625451 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-89a8e362-05e7-49aa-be7e-727c2ea5d93a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:29.625919 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-89a8e362-05e7-49aa-be7e-727c2ea5d93a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:29.687552 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-89a8e362-05e7-49aa-be7e-727c2ea5d93a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:29.695924 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-89a8e362-05e7-49aa-be7e-727c2ea5d93a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.082499 Mar 08 15:24:29.696487 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1169/2292] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:29 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:24:30.448858 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-37a72b42-51b4-44e8-b052-1d15920398e1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:30.449465 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-37a72b42-51b4-44e8-b052-1d15920398e1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:30.455746 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-37a72b42-51b4-44e8-b052-1d15920398e1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:30.456200 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-37a72b42-51b4-44e8-b052-1d15920398e1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:30.456970 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-37a72b42-51b4-44e8-b052-1d15920398e1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:30.457503 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-37a72b42-51b4-44e8-b052-1d15920398e1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:30.515637 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-37a72b42-51b4-44e8-b052-1d15920398e1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:30.523743 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-37a72b42-51b4-44e8-b052-1d15920398e1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:30.525256 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-37a72b42-51b4-44e8-b052-1d15920398e1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:30.526419 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-37a72b42-51b4-44e8-b052-1d15920398e1 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.081485 Mar 08 15:24:30.526966 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1170/2293] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:30 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:30.712791 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-261f2bda-f2d0-4d98-a0e2-6c6ee04071db tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:30.713526 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-261f2bda-f2d0-4d98-a0e2-6c6ee04071db tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:30.719694 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-261f2bda-f2d0-4d98-a0e2-6c6ee04071db tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:30.720147 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-261f2bda-f2d0-4d98-a0e2-6c6ee04071db tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:30.720915 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-261f2bda-f2d0-4d98-a0e2-6c6ee04071db tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:30.721354 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-261f2bda-f2d0-4d98-a0e2-6c6ee04071db tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:30.781029 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-261f2bda-f2d0-4d98-a0e2-6c6ee04071db tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:30.789508 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-261f2bda-f2d0-4d98-a0e2-6c6ee04071db tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.080509 Mar 08 15:24:30.790104 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1171/2294] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:30 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:24:31.544581 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d0a035e5-1af5-45c1-bae6-40740c2d4bab tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:31.545223 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d0a035e5-1af5-45c1-bae6-40740c2d4bab tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:31.551523 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d0a035e5-1af5-45c1-bae6-40740c2d4bab tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:31.551971 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d0a035e5-1af5-45c1-bae6-40740c2d4bab tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:31.552734 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d0a035e5-1af5-45c1-bae6-40740c2d4bab tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:31.553177 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d0a035e5-1af5-45c1-bae6-40740c2d4bab tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:31.612026 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d0a035e5-1af5-45c1-bae6-40740c2d4bab tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:31.620239 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d0a035e5-1af5-45c1-bae6-40740c2d4bab tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:31.621733 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d0a035e5-1af5-45c1-bae6-40740c2d4bab tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:31.622897 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d0a035e5-1af5-45c1-bae6-40740c2d4bab tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.082164 Mar 08 15:24:31.623453 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1172/2295] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:31 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:31.806504 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-a11cc6ca-8bbd-4c33-b7aa-3914779b8934 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:31.807174 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-a11cc6ca-8bbd-4c33-b7aa-3914779b8934 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:31.812786 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a11cc6ca-8bbd-4c33-b7aa-3914779b8934 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:31.813234 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a11cc6ca-8bbd-4c33-b7aa-3914779b8934 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:31.814015 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a11cc6ca-8bbd-4c33-b7aa-3914779b8934 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:31.814449 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a11cc6ca-8bbd-4c33-b7aa-3914779b8934 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:31.873415 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-a11cc6ca-8bbd-4c33-b7aa-3914779b8934 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:31.881648 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-a11cc6ca-8bbd-4c33-b7aa-3914779b8934 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.078952 Mar 08 15:24:31.882233 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1173/2296] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:31 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:24:32.641456 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-554f991c-a386-488d-baa3-9da21b21a6d4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:32.642016 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-554f991c-a386-488d-baa3-9da21b21a6d4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:32.649260 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-554f991c-a386-488d-baa3-9da21b21a6d4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:32.649711 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-554f991c-a386-488d-baa3-9da21b21a6d4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:32.650515 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-554f991c-a386-488d-baa3-9da21b21a6d4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:32.650950 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-554f991c-a386-488d-baa3-9da21b21a6d4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:32.711018 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-554f991c-a386-488d-baa3-9da21b21a6d4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:32.719105 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-554f991c-a386-488d-baa3-9da21b21a6d4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:32.720604 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-554f991c-a386-488d-baa3-9da21b21a6d4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:32.721733 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-554f991c-a386-488d-baa3-9da21b21a6d4 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.084247 Mar 08 15:24:32.722321 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1174/2297] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:32 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:32.899570 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-4e08cedc-eb2f-4c1c-af81-152092a54448 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:32.900207 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-4e08cedc-eb2f-4c1c-af81-152092a54448 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:32.906029 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4e08cedc-eb2f-4c1c-af81-152092a54448 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:32.906483 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4e08cedc-eb2f-4c1c-af81-152092a54448 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:32.907498 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4e08cedc-eb2f-4c1c-af81-152092a54448 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:32.907935 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4e08cedc-eb2f-4c1c-af81-152092a54448 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:32.971033 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-4e08cedc-eb2f-4c1c-af81-152092a54448 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:32.979372 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-4e08cedc-eb2f-4c1c-af81-152092a54448 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.084963 Mar 08 15:24:32.979935 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1175/2298] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:32 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:24:33.741428 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-60c9d705-5e2c-4acf-8aa6-4de7b41b5ae6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:33.742111 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-60c9d705-5e2c-4acf-8aa6-4de7b41b5ae6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:33.748396 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-60c9d705-5e2c-4acf-8aa6-4de7b41b5ae6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:33.748851 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-60c9d705-5e2c-4acf-8aa6-4de7b41b5ae6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:33.749618 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-60c9d705-5e2c-4acf-8aa6-4de7b41b5ae6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:33.750106 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-60c9d705-5e2c-4acf-8aa6-4de7b41b5ae6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:33.808832 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-60c9d705-5e2c-4acf-8aa6-4de7b41b5ae6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:33.816974 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-60c9d705-5e2c-4acf-8aa6-4de7b41b5ae6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:33.818532 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-60c9d705-5e2c-4acf-8aa6-4de7b41b5ae6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:33.819662 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-60c9d705-5e2c-4acf-8aa6-4de7b41b5ae6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.082777 Mar 08 15:24:33.820213 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1176/2299] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:33 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:33.996511 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-148d0dfa-538f-4fd8-8eae-01dc576761c6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:33.997105 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-148d0dfa-538f-4fd8-8eae-01dc576761c6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:34.002844 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-148d0dfa-538f-4fd8-8eae-01dc576761c6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:34.003399 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-148d0dfa-538f-4fd8-8eae-01dc576761c6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:34.004045 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-148d0dfa-538f-4fd8-8eae-01dc576761c6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:34.004555 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-148d0dfa-538f-4fd8-8eae-01dc576761c6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:34.063914 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-148d0dfa-538f-4fd8-8eae-01dc576761c6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:34.071530 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-148d0dfa-538f-4fd8-8eae-01dc576761c6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.078935 Mar 08 15:24:34.072086 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1177/2300] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:33 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:24:34.837692 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3772d2da-eb1e-4346-9867-02ce0038fe07 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:34.838513 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-3772d2da-eb1e-4346-9867-02ce0038fe07 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:34.844790 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3772d2da-eb1e-4346-9867-02ce0038fe07 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:34.845244 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3772d2da-eb1e-4346-9867-02ce0038fe07 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:34.846047 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3772d2da-eb1e-4346-9867-02ce0038fe07 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:34.846486 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3772d2da-eb1e-4346-9867-02ce0038fe07 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:34.942727 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-3772d2da-eb1e-4346-9867-02ce0038fe07 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:34.951657 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-3772d2da-eb1e-4346-9867-02ce0038fe07 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:34.953451 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-3772d2da-eb1e-4346-9867-02ce0038fe07 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:34.954705 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-3772d2da-eb1e-4346-9867-02ce0038fe07 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.121328 Mar 08 15:24:34.955263 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1178/2301] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:34 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:35.088730 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-862acc3b-51e6-45d2-8541-389b64931235 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:35.089369 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-862acc3b-51e6-45d2-8541-389b64931235 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:35.095115 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-862acc3b-51e6-45d2-8541-389b64931235 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:35.095566 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-862acc3b-51e6-45d2-8541-389b64931235 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:35.096321 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-862acc3b-51e6-45d2-8541-389b64931235 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:35.096755 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-862acc3b-51e6-45d2-8541-389b64931235 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:35.155799 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-862acc3b-51e6-45d2-8541-389b64931235 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:35.164272 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-862acc3b-51e6-45d2-8541-389b64931235 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.079492 Mar 08 15:24:35.164824 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1179/2302] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:35 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:24:35.973868 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ce8d5a5a-7e43-4a37-81bf-3a0bccdef1cd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:35.974482 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ce8d5a5a-7e43-4a37-81bf-3a0bccdef1cd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:35.980657 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ce8d5a5a-7e43-4a37-81bf-3a0bccdef1cd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:35.981105 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ce8d5a5a-7e43-4a37-81bf-3a0bccdef1cd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:35.981923 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ce8d5a5a-7e43-4a37-81bf-3a0bccdef1cd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:35.982360 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ce8d5a5a-7e43-4a37-81bf-3a0bccdef1cd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:36.044774 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ce8d5a5a-7e43-4a37-81bf-3a0bccdef1cd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:36.053444 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ce8d5a5a-7e43-4a37-81bf-3a0bccdef1cd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:36.054969 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ce8d5a5a-7e43-4a37-81bf-3a0bccdef1cd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:36.056093 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ce8d5a5a-7e43-4a37-81bf-3a0bccdef1cd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.086701 Mar 08 15:24:36.056637 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1180/2303] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:35 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:36.180726 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-7da27123-5723-4493-8e6e-53c7d7ef5735 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:36.181347 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-7da27123-5723-4493-8e6e-53c7d7ef5735 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:36.187086 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7da27123-5723-4493-8e6e-53c7d7ef5735 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:36.187567 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7da27123-5723-4493-8e6e-53c7d7ef5735 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:36.188328 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7da27123-5723-4493-8e6e-53c7d7ef5735 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:36.188759 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7da27123-5723-4493-8e6e-53c7d7ef5735 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:36.246312 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-7da27123-5723-4493-8e6e-53c7d7ef5735 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:36.254235 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-7da27123-5723-4493-8e6e-53c7d7ef5735 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.077672 Mar 08 15:24:36.255015 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1181/2304] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:36 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:24:37.073576 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-220b1232-bf30-4b14-9343-5509285f6f1d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:37.074270 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-220b1232-bf30-4b14-9343-5509285f6f1d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:37.080104 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-220b1232-bf30-4b14-9343-5509285f6f1d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:37.080564 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-220b1232-bf30-4b14-9343-5509285f6f1d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:37.081325 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-220b1232-bf30-4b14-9343-5509285f6f1d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:37.081764 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-220b1232-bf30-4b14-9343-5509285f6f1d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:37.141082 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-220b1232-bf30-4b14-9343-5509285f6f1d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:37.152783 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-220b1232-bf30-4b14-9343-5509285f6f1d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:37.154322 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-220b1232-bf30-4b14-9343-5509285f6f1d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:37.155456 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-220b1232-bf30-4b14-9343-5509285f6f1d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.085864 Mar 08 15:24:37.156013 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1182/2305] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:37 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:37.271336 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-9b93482c-5715-4d1a-a68f-39ae6688fff0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:37.272040 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-9b93482c-5715-4d1a-a68f-39ae6688fff0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:37.278146 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9b93482c-5715-4d1a-a68f-39ae6688fff0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:37.278600 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9b93482c-5715-4d1a-a68f-39ae6688fff0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:37.279368 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9b93482c-5715-4d1a-a68f-39ae6688fff0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:37.279802 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9b93482c-5715-4d1a-a68f-39ae6688fff0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:37.340042 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-9b93482c-5715-4d1a-a68f-39ae6688fff0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:37.347729 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-9b93482c-5715-4d1a-a68f-39ae6688fff0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.081061 Mar 08 15:24:37.349419 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1183/2306] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:37 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:24:38.174247 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-57374e9c-1ee6-4dae-bc0c-826972f7fdb2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:38.174853 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-57374e9c-1ee6-4dae-bc0c-826972f7fdb2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:38.181179 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-57374e9c-1ee6-4dae-bc0c-826972f7fdb2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:38.181624 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-57374e9c-1ee6-4dae-bc0c-826972f7fdb2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:38.182410 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-57374e9c-1ee6-4dae-bc0c-826972f7fdb2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:38.182842 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-57374e9c-1ee6-4dae-bc0c-826972f7fdb2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:38.240900 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-57374e9c-1ee6-4dae-bc0c-826972f7fdb2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:38.248942 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-57374e9c-1ee6-4dae-bc0c-826972f7fdb2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:38.250464 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-57374e9c-1ee6-4dae-bc0c-826972f7fdb2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:38.251584 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-57374e9c-1ee6-4dae-bc0c-826972f7fdb2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.081367 Mar 08 15:24:38.252131 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1184/2307] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:38 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:38.365152 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-9fbd2f87-3cba-4d5a-b5ca-a6ec65147b8f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:38.365768 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-9fbd2f87-3cba-4d5a-b5ca-a6ec65147b8f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:38.372044 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9fbd2f87-3cba-4d5a-b5ca-a6ec65147b8f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:38.372501 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9fbd2f87-3cba-4d5a-b5ca-a6ec65147b8f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:38.373276 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9fbd2f87-3cba-4d5a-b5ca-a6ec65147b8f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:38.373718 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9fbd2f87-3cba-4d5a-b5ca-a6ec65147b8f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:38.431320 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-9fbd2f87-3cba-4d5a-b5ca-a6ec65147b8f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:38.438929 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-9fbd2f87-3cba-4d5a-b5ca-a6ec65147b8f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.077689 Mar 08 15:24:38.439496 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1185/2308] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:38 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:24:39.269838 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b1ff2917-62de-41d4-8b18-0d4966799577 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:39.270945 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b1ff2917-62de-41d4-8b18-0d4966799577 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:39.277000 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b1ff2917-62de-41d4-8b18-0d4966799577 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:39.277446 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b1ff2917-62de-41d4-8b18-0d4966799577 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:39.278254 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b1ff2917-62de-41d4-8b18-0d4966799577 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:39.278688 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b1ff2917-62de-41d4-8b18-0d4966799577 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:39.340803 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b1ff2917-62de-41d4-8b18-0d4966799577 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:39.349537 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b1ff2917-62de-41d4-8b18-0d4966799577 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:39.351077 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b1ff2917-62de-41d4-8b18-0d4966799577 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:39.352198 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b1ff2917-62de-41d4-8b18-0d4966799577 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.086336 Mar 08 15:24:39.352748 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1186/2309] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:39 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:39.456141 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5073491a-928d-4868-b14c-510b03c7cf1d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:39.456800 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5073491a-928d-4868-b14c-510b03c7cf1d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:39.464074 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5073491a-928d-4868-b14c-510b03c7cf1d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:39.464526 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5073491a-928d-4868-b14c-510b03c7cf1d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:39.465292 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5073491a-928d-4868-b14c-510b03c7cf1d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:39.465731 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5073491a-928d-4868-b14c-510b03c7cf1d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:39.524279 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-5073491a-928d-4868-b14c-510b03c7cf1d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:39.532257 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5073491a-928d-4868-b14c-510b03c7cf1d tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.079597 Mar 08 15:24:39.532819 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1187/2310] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:39 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:24:40.369883 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c55fa300-ba16-4f0e-9195-ccc9da2575a0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:40.370498 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-c55fa300-ba16-4f0e-9195-ccc9da2575a0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:40.376300 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c55fa300-ba16-4f0e-9195-ccc9da2575a0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:40.376754 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c55fa300-ba16-4f0e-9195-ccc9da2575a0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:40.377516 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c55fa300-ba16-4f0e-9195-ccc9da2575a0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:40.377980 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c55fa300-ba16-4f0e-9195-ccc9da2575a0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:40.438007 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-c55fa300-ba16-4f0e-9195-ccc9da2575a0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:40.446298 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-c55fa300-ba16-4f0e-9195-ccc9da2575a0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:40.447842 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-c55fa300-ba16-4f0e-9195-ccc9da2575a0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:40.448968 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-c55fa300-ba16-4f0e-9195-ccc9da2575a0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.082961 Mar 08 15:24:40.449521 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1188/2311] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:40 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:40.549284 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-92fc0013-22a1-44e3-bd48-8e027865c9ef tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:40.549939 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-92fc0013-22a1-44e3-bd48-8e027865c9ef tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:40.556181 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-92fc0013-22a1-44e3-bd48-8e027865c9ef tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:40.556628 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-92fc0013-22a1-44e3-bd48-8e027865c9ef tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:40.557389 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-92fc0013-22a1-44e3-bd48-8e027865c9ef tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:40.557826 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-92fc0013-22a1-44e3-bd48-8e027865c9ef tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:40.615503 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-92fc0013-22a1-44e3-bd48-8e027865c9ef tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:40.623256 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-92fc0013-22a1-44e3-bd48-8e027865c9ef tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.077555 Mar 08 15:24:40.623810 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1189/2312] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:40 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:24:41.467643 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b64c79af-14ea-4151-9c55-b803866118a8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:41.468257 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b64c79af-14ea-4151-9c55-b803866118a8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:41.474311 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b64c79af-14ea-4151-9c55-b803866118a8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:41.474769 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b64c79af-14ea-4151-9c55-b803866118a8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:41.475547 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b64c79af-14ea-4151-9c55-b803866118a8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:41.475988 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b64c79af-14ea-4151-9c55-b803866118a8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:41.534818 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b64c79af-14ea-4151-9c55-b803866118a8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:41.543119 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b64c79af-14ea-4151-9c55-b803866118a8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:41.544633 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b64c79af-14ea-4151-9c55-b803866118a8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:41.545768 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b64c79af-14ea-4151-9c55-b803866118a8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.082074 Mar 08 15:24:41.546363 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1190/2313] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:41 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:41.640161 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-0032f994-a505-446d-86c5-6a04d839060b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:41.640779 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-0032f994-a505-446d-86c5-6a04d839060b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:41.647329 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0032f994-a505-446d-86c5-6a04d839060b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:41.647791 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0032f994-a505-446d-86c5-6a04d839060b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:41.648595 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0032f994-a505-446d-86c5-6a04d839060b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:41.649044 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0032f994-a505-446d-86c5-6a04d839060b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:41.708159 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-0032f994-a505-446d-86c5-6a04d839060b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:41.715764 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-0032f994-a505-446d-86c5-6a04d839060b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.079278 Mar 08 15:24:41.716315 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1191/2314] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:41 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:24:42.563646 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-70e35101-ae4f-4bfa-8784-bdc49b6563b0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:42.564255 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-70e35101-ae4f-4bfa-8784-bdc49b6563b0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:42.570243 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-70e35101-ae4f-4bfa-8784-bdc49b6563b0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:42.570696 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-70e35101-ae4f-4bfa-8784-bdc49b6563b0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:42.571458 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-70e35101-ae4f-4bfa-8784-bdc49b6563b0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:42.571895 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-70e35101-ae4f-4bfa-8784-bdc49b6563b0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:42.634550 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-70e35101-ae4f-4bfa-8784-bdc49b6563b0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:42.642677 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-70e35101-ae4f-4bfa-8784-bdc49b6563b0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:42.644183 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-70e35101-ae4f-4bfa-8784-bdc49b6563b0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:42.645824 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-70e35101-ae4f-4bfa-8784-bdc49b6563b0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.086129 Mar 08 15:24:42.646397 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1192/2315] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:42 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:42.732010 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-790265f9-7789-46dc-b01d-fd5ffee7e825 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:42.732633 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-790265f9-7789-46dc-b01d-fd5ffee7e825 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:42.738862 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-790265f9-7789-46dc-b01d-fd5ffee7e825 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:42.739324 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-790265f9-7789-46dc-b01d-fd5ffee7e825 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:42.740089 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-790265f9-7789-46dc-b01d-fd5ffee7e825 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:42.740529 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-790265f9-7789-46dc-b01d-fd5ffee7e825 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:42.800317 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-790265f9-7789-46dc-b01d-fd5ffee7e825 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:42.807926 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-790265f9-7789-46dc-b01d-fd5ffee7e825 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.079440 Mar 08 15:24:42.808487 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1193/2316] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:42 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:24:43.664307 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-e6da46eb-b9ef-4bbd-846a-867046d109fc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:43.664983 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-e6da46eb-b9ef-4bbd-846a-867046d109fc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:43.670989 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e6da46eb-b9ef-4bbd-846a-867046d109fc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:43.671443 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e6da46eb-b9ef-4bbd-846a-867046d109fc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:43.672207 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e6da46eb-b9ef-4bbd-846a-867046d109fc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:43.672640 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e6da46eb-b9ef-4bbd-846a-867046d109fc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:43.730728 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-e6da46eb-b9ef-4bbd-846a-867046d109fc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:43.739216 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-e6da46eb-b9ef-4bbd-846a-867046d109fc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:43.740720 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-e6da46eb-b9ef-4bbd-846a-867046d109fc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:43.741842 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-e6da46eb-b9ef-4bbd-846a-867046d109fc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.081796 Mar 08 15:24:43.742417 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1194/2317] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:43 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:43.824022 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-7371be71-70aa-4077-be21-2da3d928060e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:43.824630 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-7371be71-70aa-4077-be21-2da3d928060e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:43.830299 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7371be71-70aa-4077-be21-2da3d928060e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:43.830750 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7371be71-70aa-4077-be21-2da3d928060e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:43.831518 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7371be71-70aa-4077-be21-2da3d928060e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:43.831959 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7371be71-70aa-4077-be21-2da3d928060e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:43.891297 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-7371be71-70aa-4077-be21-2da3d928060e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:43.898986 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-7371be71-70aa-4077-be21-2da3d928060e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.078550 Mar 08 15:24:43.899541 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1195/2318] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:43 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:24:44.759636 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-18799044-c756-4781-ae2b-c162f483c6e8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:44.760388 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-18799044-c756-4781-ae2b-c162f483c6e8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:44.767273 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-18799044-c756-4781-ae2b-c162f483c6e8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:44.767733 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-18799044-c756-4781-ae2b-c162f483c6e8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:44.768544 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-18799044-c756-4781-ae2b-c162f483c6e8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:44.768994 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-18799044-c756-4781-ae2b-c162f483c6e8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:44.828108 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-18799044-c756-4781-ae2b-c162f483c6e8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:44.837298 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-18799044-c756-4781-ae2b-c162f483c6e8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:44.838853 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-18799044-c756-4781-ae2b-c162f483c6e8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:44.839986 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-18799044-c756-4781-ae2b-c162f483c6e8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.084285 Mar 08 15:24:44.840547 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1196/2319] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:44 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:44.917077 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-66dc9e79-2e57-4d74-a92a-3fb6f259b901 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:44.918713 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-66dc9e79-2e57-4d74-a92a-3fb6f259b901 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:44.924588 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-66dc9e79-2e57-4d74-a92a-3fb6f259b901 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:44.925045 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-66dc9e79-2e57-4d74-a92a-3fb6f259b901 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:44.925871 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-66dc9e79-2e57-4d74-a92a-3fb6f259b901 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:44.926319 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-66dc9e79-2e57-4d74-a92a-3fb6f259b901 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:44.984735 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-66dc9e79-2e57-4d74-a92a-3fb6f259b901 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:44.992874 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-66dc9e79-2e57-4d74-a92a-3fb6f259b901 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.080039 Mar 08 15:24:44.993429 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1197/2320] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:44 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:24:45.022528 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 15:24:45.023001 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: Tue Mar 8 15:24:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52/os-volume_attachments/67fc183b-4d10-4f71-9e5d-14819fc5becd (ip 10.222.0.30) !!! Mar 08 15:24:45.858018 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ce9f55e4-843e-43e2-b770-b4ee98e2edd6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:45.858594 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ce9f55e4-843e-43e2-b770-b4ee98e2edd6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:45.865446 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ce9f55e4-843e-43e2-b770-b4ee98e2edd6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:45.865927 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ce9f55e4-843e-43e2-b770-b4ee98e2edd6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:45.866703 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ce9f55e4-843e-43e2-b770-b4ee98e2edd6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:45.867147 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ce9f55e4-843e-43e2-b770-b4ee98e2edd6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:45.930085 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ce9f55e4-843e-43e2-b770-b4ee98e2edd6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:45.938473 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ce9f55e4-843e-43e2-b770-b4ee98e2edd6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:45.940343 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ce9f55e4-843e-43e2-b770-b4ee98e2edd6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:45.941118 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ce9f55e4-843e-43e2-b770-b4ee98e2edd6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.087130 Mar 08 15:24:45.941753 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1198/2321] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:45 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:46.009439 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-8a4eee4e-eaff-476e-a03e-984c64721d7f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:46.010085 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-8a4eee4e-eaff-476e-a03e-984c64721d7f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:46.015970 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8a4eee4e-eaff-476e-a03e-984c64721d7f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:46.016429 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8a4eee4e-eaff-476e-a03e-984c64721d7f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:46.017202 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8a4eee4e-eaff-476e-a03e-984c64721d7f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:46.017647 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8a4eee4e-eaff-476e-a03e-984c64721d7f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:46.076717 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-8a4eee4e-eaff-476e-a03e-984c64721d7f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:46.084809 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-8a4eee4e-eaff-476e-a03e-984c64721d7f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.079106 Mar 08 15:24:46.085364 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1199/2322] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:46 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:24:46.959611 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ece23902-2907-41a1-9203-cf4e7d5fe071 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:46.960224 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ece23902-2907-41a1-9203-cf4e7d5fe071 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:46.966420 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ece23902-2907-41a1-9203-cf4e7d5fe071 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:46.966866 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ece23902-2907-41a1-9203-cf4e7d5fe071 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:46.967626 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ece23902-2907-41a1-9203-cf4e7d5fe071 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:46.968058 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ece23902-2907-41a1-9203-cf4e7d5fe071 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:47.027109 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ece23902-2907-41a1-9203-cf4e7d5fe071 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:47.036219 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ece23902-2907-41a1-9203-cf4e7d5fe071 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:47.037724 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ece23902-2907-41a1-9203-cf4e7d5fe071 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:47.038899 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ece23902-2907-41a1-9203-cf4e7d5fe071 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.083721 Mar 08 15:24:47.039459 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1200/2323] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:46 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:47.102665 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f7215411-30b6-40bb-965e-af82588550fe tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:47.103309 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f7215411-30b6-40bb-965e-af82588550fe tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:47.109002 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f7215411-30b6-40bb-965e-af82588550fe tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:47.109460 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f7215411-30b6-40bb-965e-af82588550fe tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:47.110267 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f7215411-30b6-40bb-965e-af82588550fe tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:47.110719 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f7215411-30b6-40bb-965e-af82588550fe tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:47.171117 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f7215411-30b6-40bb-965e-af82588550fe tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:47.178899 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f7215411-30b6-40bb-965e-af82588550fe tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.079812 Mar 08 15:24:47.179467 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1201/2324] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:47 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:24:48.056217 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-34ec2a4f-55ae-42ee-8265-fcf31b4ee1fe tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:48.056875 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-34ec2a4f-55ae-42ee-8265-fcf31b4ee1fe tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:48.063075 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-34ec2a4f-55ae-42ee-8265-fcf31b4ee1fe tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:48.063522 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-34ec2a4f-55ae-42ee-8265-fcf31b4ee1fe tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:48.064280 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-34ec2a4f-55ae-42ee-8265-fcf31b4ee1fe tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:48.064711 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-34ec2a4f-55ae-42ee-8265-fcf31b4ee1fe tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:48.126785 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-34ec2a4f-55ae-42ee-8265-fcf31b4ee1fe tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:48.135329 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-34ec2a4f-55ae-42ee-8265-fcf31b4ee1fe tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:48.136820 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-34ec2a4f-55ae-42ee-8265-fcf31b4ee1fe tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:48.137970 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-34ec2a4f-55ae-42ee-8265-fcf31b4ee1fe tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.085667 Mar 08 15:24:48.138523 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1202/2325] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:48 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:48.195871 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-698fe891-87a5-4ca1-b8f6-bda834cbbacf tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:48.196400 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-698fe891-87a5-4ca1-b8f6-bda834cbbacf tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:48.202278 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-698fe891-87a5-4ca1-b8f6-bda834cbbacf tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:48.202729 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-698fe891-87a5-4ca1-b8f6-bda834cbbacf tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:48.203491 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-698fe891-87a5-4ca1-b8f6-bda834cbbacf tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:48.203921 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-698fe891-87a5-4ca1-b8f6-bda834cbbacf tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:48.262270 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-698fe891-87a5-4ca1-b8f6-bda834cbbacf tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:48.270729 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-698fe891-87a5-4ca1-b8f6-bda834cbbacf tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.078976 Mar 08 15:24:48.271283 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1203/2326] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:48 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:24:49.155632 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-85e4ea9d-7b40-427b-ad22-70225ad16995 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:49.156343 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-85e4ea9d-7b40-427b-ad22-70225ad16995 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:49.163730 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-85e4ea9d-7b40-427b-ad22-70225ad16995 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:49.164178 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-85e4ea9d-7b40-427b-ad22-70225ad16995 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:49.164949 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-85e4ea9d-7b40-427b-ad22-70225ad16995 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:49.165378 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-85e4ea9d-7b40-427b-ad22-70225ad16995 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:49.231228 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-85e4ea9d-7b40-427b-ad22-70225ad16995 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:49.240123 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-85e4ea9d-7b40-427b-ad22-70225ad16995 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:49.241629 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-85e4ea9d-7b40-427b-ad22-70225ad16995 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:49.242812 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-85e4ea9d-7b40-427b-ad22-70225ad16995 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.091171 Mar 08 15:24:49.243364 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1204/2327] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:49 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:49.288286 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-6273f069-371d-4750-bad2-1cd98970e87b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:49.288899 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-6273f069-371d-4750-bad2-1cd98970e87b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:49.294794 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6273f069-371d-4750-bad2-1cd98970e87b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:49.295242 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6273f069-371d-4750-bad2-1cd98970e87b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:49.296002 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6273f069-371d-4750-bad2-1cd98970e87b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:49.296437 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6273f069-371d-4750-bad2-1cd98970e87b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:49.354552 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-6273f069-371d-4750-bad2-1cd98970e87b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:49.362224 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-6273f069-371d-4750-bad2-1cd98970e87b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.078501 Mar 08 15:24:49.362774 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1205/2328] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:49 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:24:50.261153 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ca6084e3-dac5-43bb-be7c-32e1826b5554 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:50.261877 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ca6084e3-dac5-43bb-be7c-32e1826b5554 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:50.268103 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ca6084e3-dac5-43bb-be7c-32e1826b5554 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:50.268554 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ca6084e3-dac5-43bb-be7c-32e1826b5554 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:50.269389 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ca6084e3-dac5-43bb-be7c-32e1826b5554 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:50.269951 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ca6084e3-dac5-43bb-be7c-32e1826b5554 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:50.342395 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ca6084e3-dac5-43bb-be7c-32e1826b5554 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:50.351613 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ca6084e3-dac5-43bb-be7c-32e1826b5554 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:50.353140 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ca6084e3-dac5-43bb-be7c-32e1826b5554 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:50.354290 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ca6084e3-dac5-43bb-be7c-32e1826b5554 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.097105 Mar 08 15:24:50.354851 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1206/2329] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:50 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:50.380484 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-05d83f7c-2054-4e03-8569-b1978568b0ed tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:50.381087 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-05d83f7c-2054-4e03-8569-b1978568b0ed tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:50.386775 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-05d83f7c-2054-4e03-8569-b1978568b0ed tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:50.387227 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-05d83f7c-2054-4e03-8569-b1978568b0ed tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:50.387986 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-05d83f7c-2054-4e03-8569-b1978568b0ed tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:50.388422 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-05d83f7c-2054-4e03-8569-b1978568b0ed tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:50.446322 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-05d83f7c-2054-4e03-8569-b1978568b0ed tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:50.454060 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-05d83f7c-2054-4e03-8569-b1978568b0ed tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.077644 Mar 08 15:24:50.454624 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1207/2330] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:50 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:24:51.372582 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ae5c2aff-f3ec-467b-933c-a64f96fe64a3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:51.373268 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ae5c2aff-f3ec-467b-933c-a64f96fe64a3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:51.380315 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ae5c2aff-f3ec-467b-933c-a64f96fe64a3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:51.380758 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ae5c2aff-f3ec-467b-933c-a64f96fe64a3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:51.381518 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ae5c2aff-f3ec-467b-933c-a64f96fe64a3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:51.382022 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ae5c2aff-f3ec-467b-933c-a64f96fe64a3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:51.442954 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ae5c2aff-f3ec-467b-933c-a64f96fe64a3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:51.451199 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ae5c2aff-f3ec-467b-933c-a64f96fe64a3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:51.452698 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ae5c2aff-f3ec-467b-933c-a64f96fe64a3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:51.453827 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ae5c2aff-f3ec-467b-933c-a64f96fe64a3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.085158 Mar 08 15:24:51.454406 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1208/2331] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:51 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:51.470919 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-e4d66858-0a19-484c-a916-a85bc9194ce9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:51.471539 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-e4d66858-0a19-484c-a916-a85bc9194ce9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:51.477237 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e4d66858-0a19-484c-a916-a85bc9194ce9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:51.477685 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e4d66858-0a19-484c-a916-a85bc9194ce9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:51.478482 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e4d66858-0a19-484c-a916-a85bc9194ce9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:51.478913 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e4d66858-0a19-484c-a916-a85bc9194ce9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:51.536488 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-e4d66858-0a19-484c-a916-a85bc9194ce9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:51.544041 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-e4d66858-0a19-484c-a916-a85bc9194ce9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.076677 Mar 08 15:24:51.544592 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1209/2332] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:51 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:24:52.472257 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-8f51c6e1-33a5-4919-ba41-b241a3636427 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:52.473751 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-8f51c6e1-33a5-4919-ba41-b241a3636427 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:52.480075 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8f51c6e1-33a5-4919-ba41-b241a3636427 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:52.480529 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8f51c6e1-33a5-4919-ba41-b241a3636427 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:52.481299 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8f51c6e1-33a5-4919-ba41-b241a3636427 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:52.481739 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8f51c6e1-33a5-4919-ba41-b241a3636427 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:52.543661 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-8f51c6e1-33a5-4919-ba41-b241a3636427 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:52.552634 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-8f51c6e1-33a5-4919-ba41-b241a3636427 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:52.554162 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-8f51c6e1-33a5-4919-ba41-b241a3636427 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:52.555295 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-8f51c6e1-33a5-4919-ba41-b241a3636427 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.086957 Mar 08 15:24:52.555878 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1210/2333] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:52 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:52.561418 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-045c28ab-30e6-4169-8bc3-d35c5345a5ea tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:52.562044 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-045c28ab-30e6-4169-8bc3-d35c5345a5ea tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:52.567675 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-045c28ab-30e6-4169-8bc3-d35c5345a5ea tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:52.568120 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-045c28ab-30e6-4169-8bc3-d35c5345a5ea tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:52.568877 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-045c28ab-30e6-4169-8bc3-d35c5345a5ea tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:52.569309 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-045c28ab-30e6-4169-8bc3-d35c5345a5ea tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:52.626232 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-045c28ab-30e6-4169-8bc3-d35c5345a5ea tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:52.634372 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-045c28ab-30e6-4169-8bc3-d35c5345a5ea tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.076445 Mar 08 15:24:52.634922 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1211/2334] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:52 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:24:53.572762 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c00a9602-9c35-48b8-93d7-071cdbf8959f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:53.573507 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-c00a9602-9c35-48b8-93d7-071cdbf8959f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:53.579945 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c00a9602-9c35-48b8-93d7-071cdbf8959f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:53.580400 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c00a9602-9c35-48b8-93d7-071cdbf8959f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:53.581189 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c00a9602-9c35-48b8-93d7-071cdbf8959f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:53.581661 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c00a9602-9c35-48b8-93d7-071cdbf8959f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:53.641381 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-c00a9602-9c35-48b8-93d7-071cdbf8959f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:53.650231 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-c00a9602-9c35-48b8-93d7-071cdbf8959f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:53.651743 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-c00a9602-9c35-48b8-93d7-071cdbf8959f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:53.652881 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-c00a9602-9c35-48b8-93d7-071cdbf8959f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.084046 Mar 08 15:24:53.653434 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1212/2335] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:53 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:53.658022 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-7a478c6d-f05d-4e9f-aa1f-dcc0f4cb7fd6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:53.658629 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-7a478c6d-f05d-4e9f-aa1f-dcc0f4cb7fd6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:53.664819 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7a478c6d-f05d-4e9f-aa1f-dcc0f4cb7fd6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:53.665271 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7a478c6d-f05d-4e9f-aa1f-dcc0f4cb7fd6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:53.666094 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7a478c6d-f05d-4e9f-aa1f-dcc0f4cb7fd6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:53.666538 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7a478c6d-f05d-4e9f-aa1f-dcc0f4cb7fd6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:53.724072 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-7a478c6d-f05d-4e9f-aa1f-dcc0f4cb7fd6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:53.731615 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-7a478c6d-f05d-4e9f-aa1f-dcc0f4cb7fd6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.077220 Mar 08 15:24:53.732171 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1213/2336] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:53 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:24:54.671712 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-9f3e64e6-3690-4ec1-80a7-4406653d6d2c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:54.672323 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-9f3e64e6-3690-4ec1-80a7-4406653d6d2c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:54.678988 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9f3e64e6-3690-4ec1-80a7-4406653d6d2c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:54.679449 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9f3e64e6-3690-4ec1-80a7-4406653d6d2c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:54.680216 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9f3e64e6-3690-4ec1-80a7-4406653d6d2c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:54.680651 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9f3e64e6-3690-4ec1-80a7-4406653d6d2c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:54.740322 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-9f3e64e6-3690-4ec1-80a7-4406653d6d2c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:54.748558 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-9f3e64e6-3690-4ec1-80a7-4406653d6d2c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:54.750094 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-9f3e64e6-3690-4ec1-80a7-4406653d6d2c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:54.751233 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-9f3e64e6-3690-4ec1-80a7-4406653d6d2c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.083566 Mar 08 15:24:54.751784 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1214/2337] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:54 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:54.756262 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-8123d40d-a319-4791-8eb3-55ed5104f42e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:54.756866 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-8123d40d-a319-4791-8eb3-55ed5104f42e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:54.762282 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8123d40d-a319-4791-8eb3-55ed5104f42e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:54.762729 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8123d40d-a319-4791-8eb3-55ed5104f42e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:54.763494 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8123d40d-a319-4791-8eb3-55ed5104f42e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:54.763936 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8123d40d-a319-4791-8eb3-55ed5104f42e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:54.822113 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-8123d40d-a319-4791-8eb3-55ed5104f42e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:54.829779 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-8123d40d-a319-4791-8eb3-55ed5104f42e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.077078 Mar 08 15:24:54.830368 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1215/2338] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:54 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:24:55.768564 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d81357e9-72f6-45bb-b63b-c2f77685ce44 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:55.769242 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d81357e9-72f6-45bb-b63b-c2f77685ce44 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:55.776096 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d81357e9-72f6-45bb-b63b-c2f77685ce44 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:55.776548 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d81357e9-72f6-45bb-b63b-c2f77685ce44 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:55.777315 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d81357e9-72f6-45bb-b63b-c2f77685ce44 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:55.777751 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d81357e9-72f6-45bb-b63b-c2f77685ce44 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:55.841041 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d81357e9-72f6-45bb-b63b-c2f77685ce44 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:55.849990 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d81357e9-72f6-45bb-b63b-c2f77685ce44 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:55.851495 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d81357e9-72f6-45bb-b63b-c2f77685ce44 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:55.852626 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d81357e9-72f6-45bb-b63b-c2f77685ce44 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.087952 Mar 08 15:24:55.853181 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1216/2339] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:55 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:55.857441 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-327ee3e7-7078-44de-aaf3-df884a8df686 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:55.858070 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-327ee3e7-7078-44de-aaf3-df884a8df686 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:55.864667 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-327ee3e7-7078-44de-aaf3-df884a8df686 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:55.865116 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-327ee3e7-7078-44de-aaf3-df884a8df686 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:55.865909 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-327ee3e7-7078-44de-aaf3-df884a8df686 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:55.866353 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-327ee3e7-7078-44de-aaf3-df884a8df686 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:55.923843 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-327ee3e7-7078-44de-aaf3-df884a8df686 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:55.932351 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-327ee3e7-7078-44de-aaf3-df884a8df686 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.078247 Mar 08 15:24:55.932952 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1217/2340] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:55 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:24:56.869928 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-7ec865b1-397f-4635-813f-67a6835be246 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:56.870567 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-7ec865b1-397f-4635-813f-67a6835be246 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:56.876742 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7ec865b1-397f-4635-813f-67a6835be246 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:56.877187 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7ec865b1-397f-4635-813f-67a6835be246 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:56.877983 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7ec865b1-397f-4635-813f-67a6835be246 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:56.878456 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7ec865b1-397f-4635-813f-67a6835be246 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:56.937550 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-7ec865b1-397f-4635-813f-67a6835be246 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:56.946261 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-7ec865b1-397f-4635-813f-67a6835be246 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:56.947755 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-7ec865b1-397f-4635-813f-67a6835be246 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:56.948899 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-7ec865b1-397f-4635-813f-67a6835be246 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.082887 Mar 08 15:24:56.949442 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1218/2341] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:56 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:56.953801 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-fb5ef696-4e25-4f69-aa49-b90ed15e8c51 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:56.954426 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-fb5ef696-4e25-4f69-aa49-b90ed15e8c51 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:56.961112 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fb5ef696-4e25-4f69-aa49-b90ed15e8c51 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:56.961570 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fb5ef696-4e25-4f69-aa49-b90ed15e8c51 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:56.962368 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fb5ef696-4e25-4f69-aa49-b90ed15e8c51 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:56.962814 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fb5ef696-4e25-4f69-aa49-b90ed15e8c51 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:57.021376 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-fb5ef696-4e25-4f69-aa49-b90ed15e8c51 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:57.028969 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-fb5ef696-4e25-4f69-aa49-b90ed15e8c51 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.078583 Mar 08 15:24:57.029521 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1219/2342] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:56 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:24:57.966451 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f900e2e6-9650-4c14-bb4c-315f9094deab tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:57.967051 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f900e2e6-9650-4c14-bb4c-315f9094deab tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:57.973415 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f900e2e6-9650-4c14-bb4c-315f9094deab tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:57.973899 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f900e2e6-9650-4c14-bb4c-315f9094deab tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:57.974667 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f900e2e6-9650-4c14-bb4c-315f9094deab tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:57.975100 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f900e2e6-9650-4c14-bb4c-315f9094deab tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:58.033489 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f900e2e6-9650-4c14-bb4c-315f9094deab tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:58.041677 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f900e2e6-9650-4c14-bb4c-315f9094deab tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:58.043195 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f900e2e6-9650-4c14-bb4c-315f9094deab tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:58.044313 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f900e2e6-9650-4c14-bb4c-315f9094deab tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.081826 Mar 08 15:24:58.044862 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1220/2343] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:57 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:58.049087 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-bffdbe11-b15a-4363-8f2f-a116dd1469db tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:58.049678 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-bffdbe11-b15a-4363-8f2f-a116dd1469db tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:58.055305 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bffdbe11-b15a-4363-8f2f-a116dd1469db tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:58.055752 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bffdbe11-b15a-4363-8f2f-a116dd1469db tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:58.056503 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bffdbe11-b15a-4363-8f2f-a116dd1469db tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:58.056934 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bffdbe11-b15a-4363-8f2f-a116dd1469db tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:58.115710 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-bffdbe11-b15a-4363-8f2f-a116dd1469db tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:58.123346 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-bffdbe11-b15a-4363-8f2f-a116dd1469db tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.077553 Mar 08 15:24:58.123907 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1221/2344] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:58 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:24:59.062071 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-0055cf86-0b70-41fe-8b2e-3a10cb11b06a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:59.062711 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-0055cf86-0b70-41fe-8b2e-3a10cb11b06a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:59.069333 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0055cf86-0b70-41fe-8b2e-3a10cb11b06a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:59.069762 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0055cf86-0b70-41fe-8b2e-3a10cb11b06a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:59.070565 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0055cf86-0b70-41fe-8b2e-3a10cb11b06a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:59.071000 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0055cf86-0b70-41fe-8b2e-3a10cb11b06a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:59.133805 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-0055cf86-0b70-41fe-8b2e-3a10cb11b06a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:59.142099 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-0055cf86-0b70-41fe-8b2e-3a10cb11b06a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:59.143608 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-0055cf86-0b70-41fe-8b2e-3a10cb11b06a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:59.145813 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-0055cf86-0b70-41fe-8b2e-3a10cb11b06a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.087625 Mar 08 15:24:59.146388 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1222/2345] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:24:59 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:24:59.150778 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-a2cda607-a6bf-4a66-8dfe-03edd4363c5a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:24:59.151381 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-a2cda607-a6bf-4a66-8dfe-03edd4363c5a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:24:59.157021 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a2cda607-a6bf-4a66-8dfe-03edd4363c5a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:59.157472 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a2cda607-a6bf-4a66-8dfe-03edd4363c5a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:59.158265 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a2cda607-a6bf-4a66-8dfe-03edd4363c5a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:24:59.158796 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a2cda607-a6bf-4a66-8dfe-03edd4363c5a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:24:59.217622 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-a2cda607-a6bf-4a66-8dfe-03edd4363c5a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:24:59.225962 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-a2cda607-a6bf-4a66-8dfe-03edd4363c5a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.078589 Mar 08 15:24:59.226522 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1223/2346] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:24:59 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:25:00.164008 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-715aac6d-789a-4387-954d-9ec05b0fa4e7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:00.164684 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-715aac6d-789a-4387-954d-9ec05b0fa4e7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:00.170827 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-715aac6d-789a-4387-954d-9ec05b0fa4e7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:00.171282 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-715aac6d-789a-4387-954d-9ec05b0fa4e7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:00.172050 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-715aac6d-789a-4387-954d-9ec05b0fa4e7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:00.172488 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-715aac6d-789a-4387-954d-9ec05b0fa4e7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:00.234094 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-715aac6d-789a-4387-954d-9ec05b0fa4e7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:00.243221 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-715aac6d-789a-4387-954d-9ec05b0fa4e7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:00.244716 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-715aac6d-789a-4387-954d-9ec05b0fa4e7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:00.245901 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-715aac6d-789a-4387-954d-9ec05b0fa4e7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.086257 Mar 08 15:25:00.246449 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1224/2347] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:00 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:25:00.250794 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-1c1cc431-39e9-45e8-9816-1f8cef2d2c8a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:00.251395 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-1c1cc431-39e9-45e8-9816-1f8cef2d2c8a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:00.258151 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1c1cc431-39e9-45e8-9816-1f8cef2d2c8a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:00.258635 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1c1cc431-39e9-45e8-9816-1f8cef2d2c8a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:00.259401 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1c1cc431-39e9-45e8-9816-1f8cef2d2c8a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:00.259841 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1c1cc431-39e9-45e8-9816-1f8cef2d2c8a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:00.319001 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-1c1cc431-39e9-45e8-9816-1f8cef2d2c8a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:00.326633 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-1c1cc431-39e9-45e8-9816-1f8cef2d2c8a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.079260 Mar 08 15:25:00.327190 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1225/2348] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:00 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:25:01.264546 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-fb36bec7-4e4a-4ae3-aa42-44050ffaf336 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:01.265223 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-fb36bec7-4e4a-4ae3-aa42-44050ffaf336 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:01.272183 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fb36bec7-4e4a-4ae3-aa42-44050ffaf336 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:01.272628 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fb36bec7-4e4a-4ae3-aa42-44050ffaf336 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:01.273416 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fb36bec7-4e4a-4ae3-aa42-44050ffaf336 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:01.273918 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fb36bec7-4e4a-4ae3-aa42-44050ffaf336 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:01.333236 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-fb36bec7-4e4a-4ae3-aa42-44050ffaf336 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:01.341552 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-fb36bec7-4e4a-4ae3-aa42-44050ffaf336 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:01.343079 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-fb36bec7-4e4a-4ae3-aa42-44050ffaf336 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:01.344205 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-fb36bec7-4e4a-4ae3-aa42-44050ffaf336 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.083609 Mar 08 15:25:01.344744 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1226/2349] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:01 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:25:01.349784 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-07b143e6-15e2-4301-8e9a-ac7c4627a55c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:01.350418 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-07b143e6-15e2-4301-8e9a-ac7c4627a55c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:01.356255 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-07b143e6-15e2-4301-8e9a-ac7c4627a55c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:01.356740 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-07b143e6-15e2-4301-8e9a-ac7c4627a55c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:01.357509 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-07b143e6-15e2-4301-8e9a-ac7c4627a55c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:01.357982 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-07b143e6-15e2-4301-8e9a-ac7c4627a55c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:01.416179 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-07b143e6-15e2-4301-8e9a-ac7c4627a55c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:01.423777 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-07b143e6-15e2-4301-8e9a-ac7c4627a55c tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.078121 Mar 08 15:25:01.424330 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1227/2350] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:01 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:25:02.363200 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-a978ee63-4fd4-40b7-b913-d6316724cdff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:02.363820 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-a978ee63-4fd4-40b7-b913-d6316724cdff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:02.370147 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a978ee63-4fd4-40b7-b913-d6316724cdff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:02.370604 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a978ee63-4fd4-40b7-b913-d6316724cdff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:02.371374 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a978ee63-4fd4-40b7-b913-d6316724cdff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:02.371817 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a978ee63-4fd4-40b7-b913-d6316724cdff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:02.434408 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-a978ee63-4fd4-40b7-b913-d6316724cdff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:02.443282 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-a978ee63-4fd4-40b7-b913-d6316724cdff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:02.444801 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-a978ee63-4fd4-40b7-b913-d6316724cdff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:02.445975 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-a978ee63-4fd4-40b7-b913-d6316724cdff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.086645 Mar 08 15:25:02.446537 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1228/2351] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:02 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:25:02.450884 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5583a712-d73a-4ce8-ba7f-ab1a3340e7c1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:02.451488 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5583a712-d73a-4ce8-ba7f-ab1a3340e7c1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:02.457589 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5583a712-d73a-4ce8-ba7f-ab1a3340e7c1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:02.458072 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5583a712-d73a-4ce8-ba7f-ab1a3340e7c1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:02.458842 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5583a712-d73a-4ce8-ba7f-ab1a3340e7c1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:02.459286 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5583a712-d73a-4ce8-ba7f-ab1a3340e7c1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:02.516791 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-5583a712-d73a-4ce8-ba7f-ab1a3340e7c1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:02.524928 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5583a712-d73a-4ce8-ba7f-ab1a3340e7c1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.077466 Mar 08 15:25:02.525480 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1229/2352] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:02 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:25:03.464168 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-49dedc69-ef5e-49a8-aa64-8212908d6479 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:03.464836 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-49dedc69-ef5e-49a8-aa64-8212908d6479 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:03.471018 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-49dedc69-ef5e-49a8-aa64-8212908d6479 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:03.471471 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-49dedc69-ef5e-49a8-aa64-8212908d6479 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:03.473492 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-49dedc69-ef5e-49a8-aa64-8212908d6479 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:03.474151 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-49dedc69-ef5e-49a8-aa64-8212908d6479 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:03.532814 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-49dedc69-ef5e-49a8-aa64-8212908d6479 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:03.541820 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-49dedc69-ef5e-49a8-aa64-8212908d6479 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:03.543346 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-49dedc69-ef5e-49a8-aa64-8212908d6479 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:03.544477 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-49dedc69-ef5e-49a8-aa64-8212908d6479 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.084390 Mar 08 15:25:03.545035 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1230/2353] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:03 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:25:03.549484 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c605032f-b0e9-4f54-8dba-0687cc749cf0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:03.550335 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-c605032f-b0e9-4f54-8dba-0687cc749cf0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:03.556124 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c605032f-b0e9-4f54-8dba-0687cc749cf0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:03.556582 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c605032f-b0e9-4f54-8dba-0687cc749cf0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:03.557351 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c605032f-b0e9-4f54-8dba-0687cc749cf0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:03.557795 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c605032f-b0e9-4f54-8dba-0687cc749cf0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:03.617762 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-c605032f-b0e9-4f54-8dba-0687cc749cf0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:03.625365 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-c605032f-b0e9-4f54-8dba-0687cc749cf0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.079345 Mar 08 15:25:03.625943 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1231/2354] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:03 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:25:04.562293 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-598a02d4-7d4a-470c-9cd7-0bc4eb1aa9e3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:04.562961 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-598a02d4-7d4a-470c-9cd7-0bc4eb1aa9e3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:04.570013 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-598a02d4-7d4a-470c-9cd7-0bc4eb1aa9e3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:04.570464 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-598a02d4-7d4a-470c-9cd7-0bc4eb1aa9e3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:04.571232 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-598a02d4-7d4a-470c-9cd7-0bc4eb1aa9e3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:04.571673 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-598a02d4-7d4a-470c-9cd7-0bc4eb1aa9e3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:04.632052 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-598a02d4-7d4a-470c-9cd7-0bc4eb1aa9e3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:04.640315 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-598a02d4-7d4a-470c-9cd7-0bc4eb1aa9e3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:04.641826 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-598a02d4-7d4a-470c-9cd7-0bc4eb1aa9e3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:04.642990 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-598a02d4-7d4a-470c-9cd7-0bc4eb1aa9e3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.084579 Mar 08 15:25:04.643546 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1232/2355] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:04 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:25:04.648660 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-1eef6d02-83fe-449d-950c-debd2301df2f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:04.649272 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-1eef6d02-83fe-449d-950c-debd2301df2f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:04.654995 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1eef6d02-83fe-449d-950c-debd2301df2f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:04.655461 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1eef6d02-83fe-449d-950c-debd2301df2f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:04.656233 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1eef6d02-83fe-449d-950c-debd2301df2f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:04.656928 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1eef6d02-83fe-449d-950c-debd2301df2f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:04.714839 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-1eef6d02-83fe-449d-950c-debd2301df2f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:04.722539 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-1eef6d02-83fe-449d-950c-debd2301df2f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.077303 Mar 08 15:25:04.723101 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1233/2356] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:04 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:25:05.662067 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f475cca2-c4a2-42e0-aac2-a582681f3f60 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:05.662714 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f475cca2-c4a2-42e0-aac2-a582681f3f60 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:05.668899 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f475cca2-c4a2-42e0-aac2-a582681f3f60 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:05.669347 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f475cca2-c4a2-42e0-aac2-a582681f3f60 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:05.670136 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f475cca2-c4a2-42e0-aac2-a582681f3f60 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:05.670573 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f475cca2-c4a2-42e0-aac2-a582681f3f60 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:05.732565 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f475cca2-c4a2-42e0-aac2-a582681f3f60 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:05.740850 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f475cca2-c4a2-42e0-aac2-a582681f3f60 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:05.742363 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f475cca2-c4a2-42e0-aac2-a582681f3f60 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:05.743483 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f475cca2-c4a2-42e0-aac2-a582681f3f60 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.086075 Mar 08 15:25:05.744029 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1234/2357] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:05 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:25:05.748336 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-11b75632-122d-4502-96b7-edcaaf1f75d1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:05.748929 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-11b75632-122d-4502-96b7-edcaaf1f75d1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:05.754421 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-11b75632-122d-4502-96b7-edcaaf1f75d1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:05.754866 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-11b75632-122d-4502-96b7-edcaaf1f75d1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:05.755620 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-11b75632-122d-4502-96b7-edcaaf1f75d1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:05.756051 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-11b75632-122d-4502-96b7-edcaaf1f75d1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:05.813341 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-11b75632-122d-4502-96b7-edcaaf1f75d1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:05.821029 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-11b75632-122d-4502-96b7-edcaaf1f75d1 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.076083 Mar 08 15:25:05.821585 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1235/2358] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:05 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:25:06.760604 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-76fca83d-b048-40dd-9896-3fe039c42baf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:06.761294 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-76fca83d-b048-40dd-9896-3fe039c42baf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:06.767350 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-76fca83d-b048-40dd-9896-3fe039c42baf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:06.767808 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-76fca83d-b048-40dd-9896-3fe039c42baf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:06.768583 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-76fca83d-b048-40dd-9896-3fe039c42baf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:06.769025 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-76fca83d-b048-40dd-9896-3fe039c42baf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:06.828025 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-76fca83d-b048-40dd-9896-3fe039c42baf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:06.836274 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-76fca83d-b048-40dd-9896-3fe039c42baf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:06.837788 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-76fca83d-b048-40dd-9896-3fe039c42baf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:06.838954 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-76fca83d-b048-40dd-9896-3fe039c42baf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.082291 Mar 08 15:25:06.839507 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1236/2359] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:06 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:25:06.843855 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f5d40c51-3a2e-4471-83b8-4fedff830b6b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:06.844458 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f5d40c51-3a2e-4471-83b8-4fedff830b6b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:06.850523 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f5d40c51-3a2e-4471-83b8-4fedff830b6b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:06.850982 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f5d40c51-3a2e-4471-83b8-4fedff830b6b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:06.851754 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f5d40c51-3a2e-4471-83b8-4fedff830b6b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:06.852194 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f5d40c51-3a2e-4471-83b8-4fedff830b6b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:06.911876 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f5d40c51-3a2e-4471-83b8-4fedff830b6b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:06.919496 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f5d40c51-3a2e-4471-83b8-4fedff830b6b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.079070 Mar 08 15:25:06.920052 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1237/2360] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:06 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:25:08.067118 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5179338e-6e00-412a-97aa-6c879a6a010a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:08.067765 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5179338e-6e00-412a-97aa-6c879a6a010a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:08.073568 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5179338e-6e00-412a-97aa-6c879a6a010a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:08.074121 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5179338e-6e00-412a-97aa-6c879a6a010a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:08.074891 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5179338e-6e00-412a-97aa-6c879a6a010a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:08.075329 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5179338e-6e00-412a-97aa-6c879a6a010a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:08.134449 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-5179338e-6e00-412a-97aa-6c879a6a010a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:08.142542 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-5179338e-6e00-412a-97aa-6c879a6a010a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:08.145172 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-5179338e-6e00-412a-97aa-6c879a6a010a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:08.146346 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5179338e-6e00-412a-97aa-6c879a6a010a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.293077 Mar 08 15:25:08.146909 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1238/2361] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:07 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:25:08.151188 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5ad77716-5e20-4b12-9252-0a34db2e7b83 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:08.151789 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5ad77716-5e20-4b12-9252-0a34db2e7b83 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:08.157391 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5ad77716-5e20-4b12-9252-0a34db2e7b83 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:08.157842 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5ad77716-5e20-4b12-9252-0a34db2e7b83 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:08.158630 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5ad77716-5e20-4b12-9252-0a34db2e7b83 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:08.159067 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5ad77716-5e20-4b12-9252-0a34db2e7b83 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:08.225799 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-5ad77716-5e20-4b12-9252-0a34db2e7b83 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:08.233430 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5ad77716-5e20-4b12-9252-0a34db2e7b83 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.085589 Mar 08 15:25:08.234013 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1239/2362] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:08 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:25:09.164117 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-2ee0b728-11af-41c8-8166-9567625fa5bc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:09.164790 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-2ee0b728-11af-41c8-8166-9567625fa5bc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:09.171324 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2ee0b728-11af-41c8-8166-9567625fa5bc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:09.171777 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2ee0b728-11af-41c8-8166-9567625fa5bc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:09.172554 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2ee0b728-11af-41c8-8166-9567625fa5bc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:09.172992 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2ee0b728-11af-41c8-8166-9567625fa5bc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:09.236358 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-2ee0b728-11af-41c8-8166-9567625fa5bc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:09.244929 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-2ee0b728-11af-41c8-8166-9567625fa5bc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:09.246505 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-2ee0b728-11af-41c8-8166-9567625fa5bc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:09.247653 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-2ee0b728-11af-41c8-8166-9567625fa5bc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.087517 Mar 08 15:25:09.248210 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1240/2363] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:09 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:25:09.252495 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f66a3b51-65f6-4767-b43a-0b64d4e1d73f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:09.253611 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f66a3b51-65f6-4767-b43a-0b64d4e1d73f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:09.259216 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f66a3b51-65f6-4767-b43a-0b64d4e1d73f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:09.259669 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f66a3b51-65f6-4767-b43a-0b64d4e1d73f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:09.260432 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f66a3b51-65f6-4767-b43a-0b64d4e1d73f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:09.260871 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f66a3b51-65f6-4767-b43a-0b64d4e1d73f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:09.320789 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f66a3b51-65f6-4767-b43a-0b64d4e1d73f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:09.328483 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f66a3b51-65f6-4767-b43a-0b64d4e1d73f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.079347 Mar 08 15:25:09.329043 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1241/2364] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:09 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:25:10.266201 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-1ef6ae7b-4912-4520-b19b-9ca5e4a88b52 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:10.266848 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-1ef6ae7b-4912-4520-b19b-9ca5e4a88b52 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:10.273671 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1ef6ae7b-4912-4520-b19b-9ca5e4a88b52 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:10.274165 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1ef6ae7b-4912-4520-b19b-9ca5e4a88b52 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:10.274944 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1ef6ae7b-4912-4520-b19b-9ca5e4a88b52 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:10.275385 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1ef6ae7b-4912-4520-b19b-9ca5e4a88b52 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:10.335907 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-1ef6ae7b-4912-4520-b19b-9ca5e4a88b52 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:10.344175 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-1ef6ae7b-4912-4520-b19b-9ca5e4a88b52 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:10.345980 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-1ef6ae7b-4912-4520-b19b-9ca5e4a88b52 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:10.347556 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-1ef6ae7b-4912-4520-b19b-9ca5e4a88b52 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.084671 Mar 08 15:25:10.348135 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1242/2365] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:10 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:25:10.352502 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-9413e432-cb69-40f0-8489-c34564b14b06 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:10.353112 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-9413e432-cb69-40f0-8489-c34564b14b06 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:10.358730 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9413e432-cb69-40f0-8489-c34564b14b06 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:10.359192 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9413e432-cb69-40f0-8489-c34564b14b06 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:10.359961 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9413e432-cb69-40f0-8489-c34564b14b06 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:10.360403 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9413e432-cb69-40f0-8489-c34564b14b06 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:10.418853 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-9413e432-cb69-40f0-8489-c34564b14b06 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:10.426789 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-9413e432-cb69-40f0-8489-c34564b14b06 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.077720 Mar 08 15:25:10.427352 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1243/2366] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:10 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:25:11.365384 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-4e118dfa-da88-4edf-b976-c6f784a4066c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:11.366078 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-4e118dfa-da88-4edf-b976-c6f784a4066c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:11.372295 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4e118dfa-da88-4edf-b976-c6f784a4066c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:11.372752 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4e118dfa-da88-4edf-b976-c6f784a4066c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:11.373529 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4e118dfa-da88-4edf-b976-c6f784a4066c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:11.373999 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4e118dfa-da88-4edf-b976-c6f784a4066c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:11.433129 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-4e118dfa-da88-4edf-b976-c6f784a4066c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:11.442256 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-4e118dfa-da88-4edf-b976-c6f784a4066c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:11.443786 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-4e118dfa-da88-4edf-b976-c6f784a4066c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:11.444920 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-4e118dfa-da88-4edf-b976-c6f784a4066c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.083611 Mar 08 15:25:11.445471 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1244/2367] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:11 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:25:11.449741 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5efd3797-dc51-47a5-9a6e-6e3062314843 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:11.450374 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5efd3797-dc51-47a5-9a6e-6e3062314843 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:11.455818 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5efd3797-dc51-47a5-9a6e-6e3062314843 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:11.456271 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5efd3797-dc51-47a5-9a6e-6e3062314843 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:11.458050 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5efd3797-dc51-47a5-9a6e-6e3062314843 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:11.458499 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5efd3797-dc51-47a5-9a6e-6e3062314843 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:11.515716 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-5efd3797-dc51-47a5-9a6e-6e3062314843 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:11.524217 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5efd3797-dc51-47a5-9a6e-6e3062314843 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.077774 Mar 08 15:25:11.524777 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1245/2368] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:11 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:25:12.462686 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-761f195f-7ce1-4ad4-bad7-8fbb36e2f8b6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:12.463309 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-761f195f-7ce1-4ad4-bad7-8fbb36e2f8b6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:12.469588 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-761f195f-7ce1-4ad4-bad7-8fbb36e2f8b6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:12.470071 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-761f195f-7ce1-4ad4-bad7-8fbb36e2f8b6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:12.470842 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-761f195f-7ce1-4ad4-bad7-8fbb36e2f8b6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:12.471273 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-761f195f-7ce1-4ad4-bad7-8fbb36e2f8b6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:12.533564 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-761f195f-7ce1-4ad4-bad7-8fbb36e2f8b6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:12.541909 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-761f195f-7ce1-4ad4-bad7-8fbb36e2f8b6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:12.543408 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-761f195f-7ce1-4ad4-bad7-8fbb36e2f8b6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:12.544524 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-761f195f-7ce1-4ad4-bad7-8fbb36e2f8b6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.085738 Mar 08 15:25:12.545079 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1246/2369] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:12 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:25:12.549451 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-2ddbf2fa-4e73-4466-a277-ffd66d129720 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:12.550598 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-2ddbf2fa-4e73-4466-a277-ffd66d129720 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:12.556026 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2ddbf2fa-4e73-4466-a277-ffd66d129720 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:12.556587 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2ddbf2fa-4e73-4466-a277-ffd66d129720 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:12.557354 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2ddbf2fa-4e73-4466-a277-ffd66d129720 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:12.557783 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2ddbf2fa-4e73-4466-a277-ffd66d129720 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:12.615117 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-2ddbf2fa-4e73-4466-a277-ffd66d129720 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:12.623102 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-2ddbf2fa-4e73-4466-a277-ffd66d129720 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.077017 Mar 08 15:25:12.623675 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1247/2370] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:12 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:25:13.562729 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-8521ef7d-68a3-4d92-860c-c2d83782713c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:13.563415 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-8521ef7d-68a3-4d92-860c-c2d83782713c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:13.570183 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8521ef7d-68a3-4d92-860c-c2d83782713c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:13.570630 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8521ef7d-68a3-4d92-860c-c2d83782713c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:13.571390 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8521ef7d-68a3-4d92-860c-c2d83782713c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:13.571822 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8521ef7d-68a3-4d92-860c-c2d83782713c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:13.631889 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-8521ef7d-68a3-4d92-860c-c2d83782713c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:13.640299 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-8521ef7d-68a3-4d92-860c-c2d83782713c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:13.641808 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-8521ef7d-68a3-4d92-860c-c2d83782713c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:13.642963 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-8521ef7d-68a3-4d92-860c-c2d83782713c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.084189 Mar 08 15:25:13.643512 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1248/2371] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:13 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:25:13.649003 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-4538c3fd-b70b-484f-8e98-53f83ab1068e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:13.649601 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-4538c3fd-b70b-484f-8e98-53f83ab1068e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:13.655106 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4538c3fd-b70b-484f-8e98-53f83ab1068e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:13.655561 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4538c3fd-b70b-484f-8e98-53f83ab1068e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:13.656588 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4538c3fd-b70b-484f-8e98-53f83ab1068e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:13.657026 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4538c3fd-b70b-484f-8e98-53f83ab1068e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:13.717117 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-4538c3fd-b70b-484f-8e98-53f83ab1068e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:13.725539 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-4538c3fd-b70b-484f-8e98-53f83ab1068e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.079918 Mar 08 15:25:13.726134 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1249/2372] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:13 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:25:14.661786 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-7a2d61cf-b1ff-48a4-b7bb-5e3b8cda6234 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:14.662455 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-7a2d61cf-b1ff-48a4-b7bb-5e3b8cda6234 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:14.668595 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7a2d61cf-b1ff-48a4-b7bb-5e3b8cda6234 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:14.669047 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7a2d61cf-b1ff-48a4-b7bb-5e3b8cda6234 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:14.669818 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7a2d61cf-b1ff-48a4-b7bb-5e3b8cda6234 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:14.670283 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7a2d61cf-b1ff-48a4-b7bb-5e3b8cda6234 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:14.728780 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-7a2d61cf-b1ff-48a4-b7bb-5e3b8cda6234 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:14.736856 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-7a2d61cf-b1ff-48a4-b7bb-5e3b8cda6234 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:14.738531 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-7a2d61cf-b1ff-48a4-b7bb-5e3b8cda6234 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:14.739669 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-7a2d61cf-b1ff-48a4-b7bb-5e3b8cda6234 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.082737 Mar 08 15:25:14.740223 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1250/2373] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:14 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:25:14.744499 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-2264bf53-8979-44a8-ab1c-16f15b73c7ec tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:14.745097 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-2264bf53-8979-44a8-ab1c-16f15b73c7ec tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:14.750643 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2264bf53-8979-44a8-ab1c-16f15b73c7ec tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:14.751097 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2264bf53-8979-44a8-ab1c-16f15b73c7ec tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:14.751862 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2264bf53-8979-44a8-ab1c-16f15b73c7ec tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:14.752298 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2264bf53-8979-44a8-ab1c-16f15b73c7ec tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:14.810509 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-2264bf53-8979-44a8-ab1c-16f15b73c7ec tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:14.817987 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-2264bf53-8979-44a8-ab1c-16f15b73c7ec tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.076820 Mar 08 15:25:14.818552 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1251/2374] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:14 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:25:15.757021 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-fa2d763b-b288-4e42-a7c5-cb881da7c897 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:15.757619 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-fa2d763b-b288-4e42-a7c5-cb881da7c897 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:15.763912 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fa2d763b-b288-4e42-a7c5-cb881da7c897 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:15.764364 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fa2d763b-b288-4e42-a7c5-cb881da7c897 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:15.765136 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fa2d763b-b288-4e42-a7c5-cb881da7c897 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:15.765576 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fa2d763b-b288-4e42-a7c5-cb881da7c897 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:15.829239 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-fa2d763b-b288-4e42-a7c5-cb881da7c897 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:15.837986 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-fa2d763b-b288-4e42-a7c5-cb881da7c897 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:15.839485 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-fa2d763b-b288-4e42-a7c5-cb881da7c897 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:15.840614 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-fa2d763b-b288-4e42-a7c5-cb881da7c897 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.088038 Mar 08 15:25:15.841168 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1252/2375] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:15 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:25:15.845429 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ac0408da-e07c-489c-ac7f-94fff066c235 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:15.846061 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ac0408da-e07c-489c-ac7f-94fff066c235 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:15.853041 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ac0408da-e07c-489c-ac7f-94fff066c235 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:15.853498 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ac0408da-e07c-489c-ac7f-94fff066c235 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:15.854371 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ac0408da-e07c-489c-ac7f-94fff066c235 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:15.854810 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ac0408da-e07c-489c-ac7f-94fff066c235 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:15.914087 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ac0408da-e07c-489c-ac7f-94fff066c235 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:15.921599 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ac0408da-e07c-489c-ac7f-94fff066c235 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.079515 Mar 08 15:25:15.922191 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1253/2376] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:15 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:25:16.858932 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-013eeb49-80bd-46c1-bb02-de8ae6303e88 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:16.859603 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-013eeb49-80bd-46c1-bb02-de8ae6303e88 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:16.866422 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-013eeb49-80bd-46c1-bb02-de8ae6303e88 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:16.866880 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-013eeb49-80bd-46c1-bb02-de8ae6303e88 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:16.867651 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-013eeb49-80bd-46c1-bb02-de8ae6303e88 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:16.868094 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-013eeb49-80bd-46c1-bb02-de8ae6303e88 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:16.928916 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-013eeb49-80bd-46c1-bb02-de8ae6303e88 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:16.937791 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-013eeb49-80bd-46c1-bb02-de8ae6303e88 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:16.939323 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-013eeb49-80bd-46c1-bb02-de8ae6303e88 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:16.940466 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-013eeb49-80bd-46c1-bb02-de8ae6303e88 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.085490 Mar 08 15:25:16.941758 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1254/2377] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:16 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:25:16.946167 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-44334f76-8830-4d8d-9359-aadab9ddf0d6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:16.946774 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-44334f76-8830-4d8d-9359-aadab9ddf0d6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:16.952640 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-44334f76-8830-4d8d-9359-aadab9ddf0d6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:16.953089 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-44334f76-8830-4d8d-9359-aadab9ddf0d6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:16.953881 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-44334f76-8830-4d8d-9359-aadab9ddf0d6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:16.954323 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-44334f76-8830-4d8d-9359-aadab9ddf0d6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:17.013064 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-44334f76-8830-4d8d-9359-aadab9ddf0d6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:17.021346 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-44334f76-8830-4d8d-9359-aadab9ddf0d6 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.078627 Mar 08 15:25:17.021930 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1255/2378] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:16 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:25:17.959237 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-0f93b3be-9ab3-4b25-86cf-d56a788d3570 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:17.959885 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-0f93b3be-9ab3-4b25-86cf-d56a788d3570 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:17.966239 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0f93b3be-9ab3-4b25-86cf-d56a788d3570 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:17.966696 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0f93b3be-9ab3-4b25-86cf-d56a788d3570 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:17.967474 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0f93b3be-9ab3-4b25-86cf-d56a788d3570 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:17.967916 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0f93b3be-9ab3-4b25-86cf-d56a788d3570 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:18.028252 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-0f93b3be-9ab3-4b25-86cf-d56a788d3570 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:18.037426 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-0f93b3be-9ab3-4b25-86cf-d56a788d3570 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:18.038972 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-0f93b3be-9ab3-4b25-86cf-d56a788d3570 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:18.040125 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-0f93b3be-9ab3-4b25-86cf-d56a788d3570 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.084958 Mar 08 15:25:18.040666 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1256/2379] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:17 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:25:18.044958 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-9ff76eed-caf6-4b1c-ad0b-9e6cd98f3616 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:18.045571 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-9ff76eed-caf6-4b1c-ad0b-9e6cd98f3616 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:18.051750 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9ff76eed-caf6-4b1c-ad0b-9e6cd98f3616 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:18.052213 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9ff76eed-caf6-4b1c-ad0b-9e6cd98f3616 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:18.052986 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9ff76eed-caf6-4b1c-ad0b-9e6cd98f3616 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:18.053431 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9ff76eed-caf6-4b1c-ad0b-9e6cd98f3616 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:18.111197 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-9ff76eed-caf6-4b1c-ad0b-9e6cd98f3616 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:18.119645 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-9ff76eed-caf6-4b1c-ad0b-9e6cd98f3616 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.078048 Mar 08 15:25:18.120212 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1257/2380] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:18 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:25:19.058661 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-38dd7f3f-faf7-402d-bc3e-7c4271662811 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:19.059293 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-38dd7f3f-faf7-402d-bc3e-7c4271662811 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:19.066581 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-38dd7f3f-faf7-402d-bc3e-7c4271662811 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:19.067046 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-38dd7f3f-faf7-402d-bc3e-7c4271662811 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:19.067813 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-38dd7f3f-faf7-402d-bc3e-7c4271662811 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:19.068254 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-38dd7f3f-faf7-402d-bc3e-7c4271662811 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:19.131563 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-38dd7f3f-faf7-402d-bc3e-7c4271662811 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:19.139899 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-38dd7f3f-faf7-402d-bc3e-7c4271662811 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:19.141396 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-38dd7f3f-faf7-402d-bc3e-7c4271662811 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:19.142558 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-38dd7f3f-faf7-402d-bc3e-7c4271662811 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.087814 Mar 08 15:25:19.143108 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1258/2381] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:19 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:25:19.147615 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b01a5e58-1feb-49ba-a2a4-70479cf005aa tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:19.148222 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b01a5e58-1feb-49ba-a2a4-70479cf005aa tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:19.153546 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b01a5e58-1feb-49ba-a2a4-70479cf005aa tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:19.154050 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b01a5e58-1feb-49ba-a2a4-70479cf005aa tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:19.154817 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b01a5e58-1feb-49ba-a2a4-70479cf005aa tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:19.155260 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b01a5e58-1feb-49ba-a2a4-70479cf005aa tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:19.219736 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b01a5e58-1feb-49ba-a2a4-70479cf005aa tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:19.231100 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b01a5e58-1feb-49ba-a2a4-70479cf005aa tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.086841 Mar 08 15:25:19.231782 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1259/2382] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:19 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:25:20.161590 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-74511963-1335-4b05-81f9-91e6ca835038 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:20.162323 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-74511963-1335-4b05-81f9-91e6ca835038 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:20.168502 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-74511963-1335-4b05-81f9-91e6ca835038 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:20.168958 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-74511963-1335-4b05-81f9-91e6ca835038 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:20.169730 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-74511963-1335-4b05-81f9-91e6ca835038 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:20.170199 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-74511963-1335-4b05-81f9-91e6ca835038 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:20.229054 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-74511963-1335-4b05-81f9-91e6ca835038 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:20.237202 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-74511963-1335-4b05-81f9-91e6ca835038 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:20.238957 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-74511963-1335-4b05-81f9-91e6ca835038 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:20.240091 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-74511963-1335-4b05-81f9-91e6ca835038 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.083205 Mar 08 15:25:20.240644 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1260/2383] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:20 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:25:20.247819 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-22e69784-564c-439c-981a-8bd3170e3036 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:20.248425 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-22e69784-564c-439c-981a-8bd3170e3036 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:20.254429 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-22e69784-564c-439c-981a-8bd3170e3036 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:20.254879 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-22e69784-564c-439c-981a-8bd3170e3036 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:20.255652 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-22e69784-564c-439c-981a-8bd3170e3036 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:20.256091 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-22e69784-564c-439c-981a-8bd3170e3036 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:20.312928 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-22e69784-564c-439c-981a-8bd3170e3036 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:20.321452 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-22e69784-564c-439c-981a-8bd3170e3036 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.077049 Mar 08 15:25:20.322040 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1261/2384] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:20 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:25:21.258604 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-e60733a2-a097-4deb-90a9-565485b73676 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:21.259295 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-e60733a2-a097-4deb-90a9-565485b73676 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:21.265479 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e60733a2-a097-4deb-90a9-565485b73676 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:21.265966 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e60733a2-a097-4deb-90a9-565485b73676 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:21.266736 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e60733a2-a097-4deb-90a9-565485b73676 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:21.267174 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e60733a2-a097-4deb-90a9-565485b73676 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:21.326242 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-e60733a2-a097-4deb-90a9-565485b73676 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:21.335535 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-e60733a2-a097-4deb-90a9-565485b73676 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:21.337203 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-e60733a2-a097-4deb-90a9-565485b73676 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:21.338392 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-e60733a2-a097-4deb-90a9-565485b73676 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.083806 Mar 08 15:25:21.338943 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1262/2385] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:21 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:25:21.343223 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d510e428-cb57-4a6e-80c3-f4778d9eaab7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:21.343835 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d510e428-cb57-4a6e-80c3-f4778d9eaab7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:21.350107 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d510e428-cb57-4a6e-80c3-f4778d9eaab7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:21.350565 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d510e428-cb57-4a6e-80c3-f4778d9eaab7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:21.351328 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d510e428-cb57-4a6e-80c3-f4778d9eaab7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:21.351766 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d510e428-cb57-4a6e-80c3-f4778d9eaab7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:21.409010 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d510e428-cb57-4a6e-80c3-f4778d9eaab7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:21.417505 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d510e428-cb57-4a6e-80c3-f4778d9eaab7 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.077638 Mar 08 15:25:21.418101 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1263/2386] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:21 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:25:22.357155 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-0ee159cb-e8de-4303-b73d-a43f3c388eef tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:22.357894 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-0ee159cb-e8de-4303-b73d-a43f3c388eef tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:22.365083 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0ee159cb-e8de-4303-b73d-a43f3c388eef tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:22.365543 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0ee159cb-e8de-4303-b73d-a43f3c388eef tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:22.366363 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0ee159cb-e8de-4303-b73d-a43f3c388eef tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:22.366807 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0ee159cb-e8de-4303-b73d-a43f3c388eef tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:22.437027 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-0ee159cb-e8de-4303-b73d-a43f3c388eef tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:22.446612 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-0ee159cb-e8de-4303-b73d-a43f3c388eef tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:22.448110 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-0ee159cb-e8de-4303-b73d-a43f3c388eef tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:22.449241 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-0ee159cb-e8de-4303-b73d-a43f3c388eef tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.096361 Mar 08 15:25:22.449799 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1264/2387] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:22 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:25:22.454500 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-1e87fe47-33f2-441e-a7b1-4af904b18a59 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:22.455102 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-1e87fe47-33f2-441e-a7b1-4af904b18a59 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:22.461452 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1e87fe47-33f2-441e-a7b1-4af904b18a59 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:22.461968 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1e87fe47-33f2-441e-a7b1-4af904b18a59 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:22.462745 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1e87fe47-33f2-441e-a7b1-4af904b18a59 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:22.463188 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1e87fe47-33f2-441e-a7b1-4af904b18a59 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:22.522190 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-1e87fe47-33f2-441e-a7b1-4af904b18a59 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:22.529880 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-1e87fe47-33f2-441e-a7b1-4af904b18a59 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.079114 Mar 08 15:25:22.530448 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1265/2388] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:22 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:25:23.466852 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ca925d6f-0b4d-4588-89a5-add20f7aa6a7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:23.467540 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ca925d6f-0b4d-4588-89a5-add20f7aa6a7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:23.474869 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ca925d6f-0b4d-4588-89a5-add20f7aa6a7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:23.475323 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ca925d6f-0b4d-4588-89a5-add20f7aa6a7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:23.476088 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ca925d6f-0b4d-4588-89a5-add20f7aa6a7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:23.476525 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ca925d6f-0b4d-4588-89a5-add20f7aa6a7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:23.536427 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ca925d6f-0b4d-4588-89a5-add20f7aa6a7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:23.544580 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ca925d6f-0b4d-4588-89a5-add20f7aa6a7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:23.546117 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ca925d6f-0b4d-4588-89a5-add20f7aa6a7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:23.547276 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ca925d6f-0b4d-4588-89a5-add20f7aa6a7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.084348 Mar 08 15:25:23.547829 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1266/2389] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:23 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:25:23.553216 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-4d1842d3-cbd2-4bbc-be3e-0af701b98396 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:23.553811 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-4d1842d3-cbd2-4bbc-be3e-0af701b98396 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:23.559217 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4d1842d3-cbd2-4bbc-be3e-0af701b98396 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:23.559669 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4d1842d3-cbd2-4bbc-be3e-0af701b98396 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:23.560440 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4d1842d3-cbd2-4bbc-be3e-0af701b98396 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:23.560873 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4d1842d3-cbd2-4bbc-be3e-0af701b98396 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:23.617358 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-4d1842d3-cbd2-4bbc-be3e-0af701b98396 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:23.624880 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-4d1842d3-cbd2-4bbc-be3e-0af701b98396 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.076131 Mar 08 15:25:23.625428 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1267/2390] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:23 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:25:24.566540 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-6ea45594-6b09-4ec2-8b0f-131b8cf760fc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:24.567205 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-6ea45594-6b09-4ec2-8b0f-131b8cf760fc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:24.573344 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6ea45594-6b09-4ec2-8b0f-131b8cf760fc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:24.573793 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6ea45594-6b09-4ec2-8b0f-131b8cf760fc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:24.574603 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6ea45594-6b09-4ec2-8b0f-131b8cf760fc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:24.575041 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6ea45594-6b09-4ec2-8b0f-131b8cf760fc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:24.634638 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-6ea45594-6b09-4ec2-8b0f-131b8cf760fc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:24.643036 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-6ea45594-6b09-4ec2-8b0f-131b8cf760fc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:24.644887 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-6ea45594-6b09-4ec2-8b0f-131b8cf760fc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:24.646061 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-6ea45594-6b09-4ec2-8b0f-131b8cf760fc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.084451 Mar 08 15:25:24.646608 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1268/2391] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:24 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:25:24.651091 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-4e9a00c4-6668-445d-a689-eabee3e0a20b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:24.651690 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-4e9a00c4-6668-445d-a689-eabee3e0a20b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:24.657472 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4e9a00c4-6668-445d-a689-eabee3e0a20b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:24.657948 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4e9a00c4-6668-445d-a689-eabee3e0a20b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:24.658704 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4e9a00c4-6668-445d-a689-eabee3e0a20b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:24.659177 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4e9a00c4-6668-445d-a689-eabee3e0a20b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:24.716491 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-4e9a00c4-6668-445d-a689-eabee3e0a20b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:24.724596 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-4e9a00c4-6668-445d-a689-eabee3e0a20b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.077007 Mar 08 15:25:24.725152 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1269/2392] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:24 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:25:25.665082 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-4d984fe6-eeed-47bf-8f13-8eaefb4280e7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:25.665766 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-4d984fe6-eeed-47bf-8f13-8eaefb4280e7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:25.671887 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4d984fe6-eeed-47bf-8f13-8eaefb4280e7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:25.672331 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4d984fe6-eeed-47bf-8f13-8eaefb4280e7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:25.673089 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4d984fe6-eeed-47bf-8f13-8eaefb4280e7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:25.673522 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4d984fe6-eeed-47bf-8f13-8eaefb4280e7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:25.735640 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-4d984fe6-eeed-47bf-8f13-8eaefb4280e7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:25.744773 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-4d984fe6-eeed-47bf-8f13-8eaefb4280e7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:25.746290 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-4d984fe6-eeed-47bf-8f13-8eaefb4280e7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:25.747408 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-4d984fe6-eeed-47bf-8f13-8eaefb4280e7 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.086229 Mar 08 15:25:25.747960 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1270/2393] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:25 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:25:25.752339 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-de85dd64-b92e-43d3-b38f-c55a084f03bf tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:25.752961 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-de85dd64-b92e-43d3-b38f-c55a084f03bf tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:25.758452 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-de85dd64-b92e-43d3-b38f-c55a084f03bf tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:25.758902 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-de85dd64-b92e-43d3-b38f-c55a084f03bf tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:25.759694 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-de85dd64-b92e-43d3-b38f-c55a084f03bf tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:25.760127 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-de85dd64-b92e-43d3-b38f-c55a084f03bf tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:25.818086 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-de85dd64-b92e-43d3-b38f-c55a084f03bf tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:25.825843 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-de85dd64-b92e-43d3-b38f-c55a084f03bf tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.076869 Mar 08 15:25:25.826429 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1271/2394] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:25 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:25:25.882964 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.objects.instance [None req-5ae2be2e-89b1-492a-a253-7ecaade05e65 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lazy-loading 'services' on Instance uuid ecac51d1-33c3-49df-9926-d953f7315f52 {{(pid=128351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 15:25:26.765338 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ff9908bb-4934-4e29-81f5-e967eb6c79ea tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:26.765976 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ff9908bb-4934-4e29-81f5-e967eb6c79ea tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:26.772454 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ff9908bb-4934-4e29-81f5-e967eb6c79ea tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:26.772904 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ff9908bb-4934-4e29-81f5-e967eb6c79ea tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:26.773666 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ff9908bb-4934-4e29-81f5-e967eb6c79ea tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:26.774154 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ff9908bb-4934-4e29-81f5-e967eb6c79ea tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:26.833412 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ff9908bb-4934-4e29-81f5-e967eb6c79ea tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:26.841625 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ff9908bb-4934-4e29-81f5-e967eb6c79ea tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:26.843156 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ff9908bb-4934-4e29-81f5-e967eb6c79ea tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:26.844287 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ff9908bb-4934-4e29-81f5-e967eb6c79ea tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.082880 Mar 08 15:25:26.844837 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1272/2395] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:26 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:25:26.849655 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-87d3ab8e-babe-42a4-8457-9016092fa0cf tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:26.850292 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-87d3ab8e-babe-42a4-8457-9016092fa0cf tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:26.855913 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-87d3ab8e-babe-42a4-8457-9016092fa0cf tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:26.856363 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-87d3ab8e-babe-42a4-8457-9016092fa0cf tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:26.857125 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-87d3ab8e-babe-42a4-8457-9016092fa0cf tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:26.857562 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-87d3ab8e-babe-42a4-8457-9016092fa0cf tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:26.917725 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-87d3ab8e-babe-42a4-8457-9016092fa0cf tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:26.925923 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-87d3ab8e-babe-42a4-8457-9016092fa0cf tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.080133 Mar 08 15:25:26.926483 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1273/2396] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:26 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:25:27.862361 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-8e12c37b-7922-4884-bbca-c20400ef3985 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:27.863037 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-8e12c37b-7922-4884-bbca-c20400ef3985 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:27.869187 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8e12c37b-7922-4884-bbca-c20400ef3985 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:27.869645 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8e12c37b-7922-4884-bbca-c20400ef3985 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:27.870441 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8e12c37b-7922-4884-bbca-c20400ef3985 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:27.870886 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8e12c37b-7922-4884-bbca-c20400ef3985 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:27.930209 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-8e12c37b-7922-4884-bbca-c20400ef3985 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:27.938581 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-8e12c37b-7922-4884-bbca-c20400ef3985 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:27.940602 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-8e12c37b-7922-4884-bbca-c20400ef3985 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:27.942043 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-8e12c37b-7922-4884-bbca-c20400ef3985 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.083429 Mar 08 15:25:27.942507 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1274/2397] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:27 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:25:27.946956 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-256803c3-473d-449a-998d-08402c3415bc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:27.947570 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-256803c3-473d-449a-998d-08402c3415bc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:27.953472 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-256803c3-473d-449a-998d-08402c3415bc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:27.953962 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-256803c3-473d-449a-998d-08402c3415bc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:27.954740 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-256803c3-473d-449a-998d-08402c3415bc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:27.955181 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-256803c3-473d-449a-998d-08402c3415bc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:28.014236 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-256803c3-473d-449a-998d-08402c3415bc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:28.022707 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-256803c3-473d-449a-998d-08402c3415bc tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.079264 Mar 08 15:25:28.023262 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1275/2398] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:27 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:25:28.960582 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-99fcb1a8-9b91-412a-82af-bc143d54a53d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:28.961211 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-99fcb1a8-9b91-412a-82af-bc143d54a53d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:28.967378 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-99fcb1a8-9b91-412a-82af-bc143d54a53d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:28.967822 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-99fcb1a8-9b91-412a-82af-bc143d54a53d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:28.968577 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-99fcb1a8-9b91-412a-82af-bc143d54a53d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:28.969010 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-99fcb1a8-9b91-412a-82af-bc143d54a53d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:29.036976 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-99fcb1a8-9b91-412a-82af-bc143d54a53d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:29.045189 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-99fcb1a8-9b91-412a-82af-bc143d54a53d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:29.046715 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-99fcb1a8-9b91-412a-82af-bc143d54a53d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:29.047850 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-99fcb1a8-9b91-412a-82af-bc143d54a53d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.091916 Mar 08 15:25:29.048428 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1276/2399] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:28 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:25:29.052816 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-41f699d4-6aad-4cbd-ba58-f18de0c8fbaa tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:29.053417 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-41f699d4-6aad-4cbd-ba58-f18de0c8fbaa tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:29.058964 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-41f699d4-6aad-4cbd-ba58-f18de0c8fbaa tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:29.059416 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-41f699d4-6aad-4cbd-ba58-f18de0c8fbaa tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:29.060183 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-41f699d4-6aad-4cbd-ba58-f18de0c8fbaa tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:29.060619 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-41f699d4-6aad-4cbd-ba58-f18de0c8fbaa tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:29.118527 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-41f699d4-6aad-4cbd-ba58-f18de0c8fbaa tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:29.126250 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-41f699d4-6aad-4cbd-ba58-f18de0c8fbaa tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.076878 Mar 08 15:25:29.126815 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1277/2400] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:29 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:25:30.066467 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-06b38503-0b10-41fd-890c-2ce5a30d3a9e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:30.067118 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-06b38503-0b10-41fd-890c-2ce5a30d3a9e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:30.073323 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-06b38503-0b10-41fd-890c-2ce5a30d3a9e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:30.073776 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-06b38503-0b10-41fd-890c-2ce5a30d3a9e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:30.074572 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-06b38503-0b10-41fd-890c-2ce5a30d3a9e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:30.075012 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-06b38503-0b10-41fd-890c-2ce5a30d3a9e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:30.133574 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-06b38503-0b10-41fd-890c-2ce5a30d3a9e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:30.141749 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-06b38503-0b10-41fd-890c-2ce5a30d3a9e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:30.143930 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-06b38503-0b10-41fd-890c-2ce5a30d3a9e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:30.145142 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-06b38503-0b10-41fd-890c-2ce5a30d3a9e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.083228 Mar 08 15:25:30.145692 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1278/2401] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:30 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:25:30.150152 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5261e49e-f141-4105-a34a-fbe1f2f6e1a0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:30.150764 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5261e49e-f141-4105-a34a-fbe1f2f6e1a0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:30.157673 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5261e49e-f141-4105-a34a-fbe1f2f6e1a0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:30.158307 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5261e49e-f141-4105-a34a-fbe1f2f6e1a0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:30.160402 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5261e49e-f141-4105-a34a-fbe1f2f6e1a0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:30.160402 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5261e49e-f141-4105-a34a-fbe1f2f6e1a0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:30.218694 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-5261e49e-f141-4105-a34a-fbe1f2f6e1a0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:30.226663 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5261e49e-f141-4105-a34a-fbe1f2f6e1a0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.079918 Mar 08 15:25:30.227232 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1279/2402] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:30 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:25:31.163646 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-6a8f8be4-398b-422b-a7b2-f7270812b84a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:31.164259 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-6a8f8be4-398b-422b-a7b2-f7270812b84a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:31.170547 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6a8f8be4-398b-422b-a7b2-f7270812b84a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:31.171007 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6a8f8be4-398b-422b-a7b2-f7270812b84a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:31.171781 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6a8f8be4-398b-422b-a7b2-f7270812b84a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:31.172222 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6a8f8be4-398b-422b-a7b2-f7270812b84a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:31.230911 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-6a8f8be4-398b-422b-a7b2-f7270812b84a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:31.239457 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-6a8f8be4-398b-422b-a7b2-f7270812b84a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:31.240947 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-6a8f8be4-398b-422b-a7b2-f7270812b84a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:31.242123 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-6a8f8be4-398b-422b-a7b2-f7270812b84a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.082994 Mar 08 15:25:31.242671 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1280/2403] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:31 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:25:31.246924 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-497d3541-0311-41ea-ac79-9cfc8888a622 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:31.247521 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-497d3541-0311-41ea-ac79-9cfc8888a622 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:31.253038 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-497d3541-0311-41ea-ac79-9cfc8888a622 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:31.253666 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-497d3541-0311-41ea-ac79-9cfc8888a622 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:31.254451 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-497d3541-0311-41ea-ac79-9cfc8888a622 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:31.254884 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-497d3541-0311-41ea-ac79-9cfc8888a622 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:31.314075 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-497d3541-0311-41ea-ac79-9cfc8888a622 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:31.322018 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-497d3541-0311-41ea-ac79-9cfc8888a622 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.078321 Mar 08 15:25:31.322595 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1281/2404] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:31 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:25:32.260479 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d159d3a5-12a3-43c9-bc20-6fe38e32195b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:32.261049 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d159d3a5-12a3-43c9-bc20-6fe38e32195b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:32.267291 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d159d3a5-12a3-43c9-bc20-6fe38e32195b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:32.267743 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d159d3a5-12a3-43c9-bc20-6fe38e32195b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:32.268550 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d159d3a5-12a3-43c9-bc20-6fe38e32195b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:32.269007 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d159d3a5-12a3-43c9-bc20-6fe38e32195b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:32.331541 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d159d3a5-12a3-43c9-bc20-6fe38e32195b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:32.339866 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d159d3a5-12a3-43c9-bc20-6fe38e32195b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:32.341369 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d159d3a5-12a3-43c9-bc20-6fe38e32195b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:32.342533 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d159d3a5-12a3-43c9-bc20-6fe38e32195b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.086514 Mar 08 15:25:32.343091 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1282/2405] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:32 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:25:32.348076 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-a2be7950-2d1d-4f16-9f48-5a99ba44ea02 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:32.348683 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-a2be7950-2d1d-4f16-9f48-5a99ba44ea02 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:32.354123 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a2be7950-2d1d-4f16-9f48-5a99ba44ea02 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:32.354578 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a2be7950-2d1d-4f16-9f48-5a99ba44ea02 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:32.355348 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a2be7950-2d1d-4f16-9f48-5a99ba44ea02 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:32.355783 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a2be7950-2d1d-4f16-9f48-5a99ba44ea02 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:32.414135 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-a2be7950-2d1d-4f16-9f48-5a99ba44ea02 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:32.421838 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-a2be7950-2d1d-4f16-9f48-5a99ba44ea02 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.077794 Mar 08 15:25:32.422437 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1283/2406] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:32 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:25:33.362992 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-7a31d66b-fcde-44f9-9436-e627aa8dcdc0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:33.363688 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-7a31d66b-fcde-44f9-9436-e627aa8dcdc0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:33.369910 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7a31d66b-fcde-44f9-9436-e627aa8dcdc0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:33.370374 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7a31d66b-fcde-44f9-9436-e627aa8dcdc0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:33.371149 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7a31d66b-fcde-44f9-9436-e627aa8dcdc0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:33.371590 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7a31d66b-fcde-44f9-9436-e627aa8dcdc0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:33.430860 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-7a31d66b-fcde-44f9-9436-e627aa8dcdc0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:33.439112 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-7a31d66b-fcde-44f9-9436-e627aa8dcdc0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:33.441206 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-7a31d66b-fcde-44f9-9436-e627aa8dcdc0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:33.442373 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-7a31d66b-fcde-44f9-9436-e627aa8dcdc0 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.083860 Mar 08 15:25:33.442928 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1284/2407] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:33 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:25:33.447248 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-999fc83c-ae14-4f3b-a37e-73ee93719f37 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:33.447881 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-999fc83c-ae14-4f3b-a37e-73ee93719f37 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:33.453615 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-999fc83c-ae14-4f3b-a37e-73ee93719f37 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:33.454116 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-999fc83c-ae14-4f3b-a37e-73ee93719f37 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:33.454894 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-999fc83c-ae14-4f3b-a37e-73ee93719f37 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:33.455328 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-999fc83c-ae14-4f3b-a37e-73ee93719f37 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:33.513705 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-999fc83c-ae14-4f3b-a37e-73ee93719f37 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:33.521414 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-999fc83c-ae14-4f3b-a37e-73ee93719f37 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.077566 Mar 08 15:25:33.521998 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1285/2408] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:33 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:25:34.460632 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-563150f2-a865-4234-add0-a7e436a3249c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:34.461468 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-563150f2-a865-4234-add0-a7e436a3249c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:34.467902 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-563150f2-a865-4234-add0-a7e436a3249c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:34.468356 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-563150f2-a865-4234-add0-a7e436a3249c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:34.469133 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-563150f2-a865-4234-add0-a7e436a3249c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:34.469577 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-563150f2-a865-4234-add0-a7e436a3249c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:34.531022 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-563150f2-a865-4234-add0-a7e436a3249c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:34.539735 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-563150f2-a865-4234-add0-a7e436a3249c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:34.541249 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-563150f2-a865-4234-add0-a7e436a3249c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:34.542432 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-563150f2-a865-4234-add0-a7e436a3249c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.085734 Mar 08 15:25:34.542990 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1286/2409] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:34 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:25:34.547290 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c26d8be4-066b-4bf1-9b4b-90ef658a64fe tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:34.547891 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-c26d8be4-066b-4bf1-9b4b-90ef658a64fe tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:34.553475 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c26d8be4-066b-4bf1-9b4b-90ef658a64fe tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:34.553967 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c26d8be4-066b-4bf1-9b4b-90ef658a64fe tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:34.554759 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c26d8be4-066b-4bf1-9b4b-90ef658a64fe tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:34.555184 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c26d8be4-066b-4bf1-9b4b-90ef658a64fe tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:34.612456 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-c26d8be4-066b-4bf1-9b4b-90ef658a64fe tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:34.620116 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-c26d8be4-066b-4bf1-9b4b-90ef658a64fe tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.076202 Mar 08 15:25:34.620690 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1287/2410] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:34 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:25:35.560984 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-1341197a-da4e-4c7d-ad83-8234a3d5bc6e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:35.561662 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-1341197a-da4e-4c7d-ad83-8234a3d5bc6e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:35.568000 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1341197a-da4e-4c7d-ad83-8234a3d5bc6e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:35.568449 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1341197a-da4e-4c7d-ad83-8234a3d5bc6e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:35.569211 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1341197a-da4e-4c7d-ad83-8234a3d5bc6e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:35.569642 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1341197a-da4e-4c7d-ad83-8234a3d5bc6e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:35.631595 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-1341197a-da4e-4c7d-ad83-8234a3d5bc6e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:35.639652 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-1341197a-da4e-4c7d-ad83-8234a3d5bc6e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:35.641137 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-1341197a-da4e-4c7d-ad83-8234a3d5bc6e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:35.642286 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-1341197a-da4e-4c7d-ad83-8234a3d5bc6e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.085143 Mar 08 15:25:35.642833 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1288/2411] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:35 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:25:35.647928 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5af1fc76-0328-4e47-a3f6-068e32598aeb tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:35.648526 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5af1fc76-0328-4e47-a3f6-068e32598aeb tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:35.654261 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5af1fc76-0328-4e47-a3f6-068e32598aeb tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:35.654722 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5af1fc76-0328-4e47-a3f6-068e32598aeb tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:35.655500 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5af1fc76-0328-4e47-a3f6-068e32598aeb tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:35.656220 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5af1fc76-0328-4e47-a3f6-068e32598aeb tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:35.715777 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-5af1fc76-0328-4e47-a3f6-068e32598aeb tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:35.724435 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5af1fc76-0328-4e47-a3f6-068e32598aeb tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.079851 Mar 08 15:25:35.725002 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1289/2412] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:35 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:25:36.661721 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-36b731e6-974d-4a12-8709-e344c5dd7a8a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:36.662430 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-36b731e6-974d-4a12-8709-e344c5dd7a8a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:36.668197 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-36b731e6-974d-4a12-8709-e344c5dd7a8a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:36.668647 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-36b731e6-974d-4a12-8709-e344c5dd7a8a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:36.669408 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-36b731e6-974d-4a12-8709-e344c5dd7a8a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:36.669866 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-36b731e6-974d-4a12-8709-e344c5dd7a8a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:36.729566 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-36b731e6-974d-4a12-8709-e344c5dd7a8a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:36.737960 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-36b731e6-974d-4a12-8709-e344c5dd7a8a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:36.739454 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-36b731e6-974d-4a12-8709-e344c5dd7a8a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:36.740579 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-36b731e6-974d-4a12-8709-e344c5dd7a8a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.083670 Mar 08 15:25:36.741133 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1290/2413] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:36 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:25:36.745493 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d3328c07-c2a2-4dc7-bafd-6dea4f947d5b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:36.746218 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d3328c07-c2a2-4dc7-bafd-6dea4f947d5b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:36.751681 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d3328c07-c2a2-4dc7-bafd-6dea4f947d5b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:36.752140 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d3328c07-c2a2-4dc7-bafd-6dea4f947d5b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:36.753810 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d3328c07-c2a2-4dc7-bafd-6dea4f947d5b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:36.754244 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d3328c07-c2a2-4dc7-bafd-6dea4f947d5b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:36.813210 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d3328c07-c2a2-4dc7-bafd-6dea4f947d5b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:36.821346 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d3328c07-c2a2-4dc7-bafd-6dea4f947d5b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.079293 Mar 08 15:25:36.821923 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1291/2414] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:36 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:25:37.758837 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-fe13be09-8c01-4267-b5f9-01dd6189d966 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:37.759488 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-fe13be09-8c01-4267-b5f9-01dd6189d966 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:37.765722 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fe13be09-8c01-4267-b5f9-01dd6189d966 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:37.766206 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fe13be09-8c01-4267-b5f9-01dd6189d966 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:37.766973 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fe13be09-8c01-4267-b5f9-01dd6189d966 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:37.767414 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fe13be09-8c01-4267-b5f9-01dd6189d966 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:37.827342 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-fe13be09-8c01-4267-b5f9-01dd6189d966 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:37.836476 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-fe13be09-8c01-4267-b5f9-01dd6189d966 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:37.838010 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-fe13be09-8c01-4267-b5f9-01dd6189d966 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:37.839460 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-fe13be09-8c01-4267-b5f9-01dd6189d966 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.084531 Mar 08 15:25:37.840025 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1292/2415] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:37 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:25:37.844294 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5f2f32d4-b058-46b7-bbf5-57d0ee963834 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:37.844895 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5f2f32d4-b058-46b7-bbf5-57d0ee963834 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:37.850838 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5f2f32d4-b058-46b7-bbf5-57d0ee963834 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:37.851284 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5f2f32d4-b058-46b7-bbf5-57d0ee963834 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:37.852043 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5f2f32d4-b058-46b7-bbf5-57d0ee963834 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:37.852477 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5f2f32d4-b058-46b7-bbf5-57d0ee963834 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:37.913829 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-5f2f32d4-b058-46b7-bbf5-57d0ee963834 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:37.921578 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5f2f32d4-b058-46b7-bbf5-57d0ee963834 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.080627 Mar 08 15:25:37.922191 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1293/2416] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:37 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:25:38.800178 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 15:25:38.800761 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: Tue Mar 8 15:25:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52/os-volume_attachments/67fc183b-4d10-4f71-9e5d-14819fc5becd (ip 10.222.0.30) !!! Mar 08 15:25:38.857880 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-a01603d8-e1cd-4a64-b6ad-eb11665535ac tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:38.858493 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-a01603d8-e1cd-4a64-b6ad-eb11665535ac tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:38.865126 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a01603d8-e1cd-4a64-b6ad-eb11665535ac tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:38.865571 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a01603d8-e1cd-4a64-b6ad-eb11665535ac tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:38.866356 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a01603d8-e1cd-4a64-b6ad-eb11665535ac tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:38.866787 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a01603d8-e1cd-4a64-b6ad-eb11665535ac tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:38.927428 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-a01603d8-e1cd-4a64-b6ad-eb11665535ac tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:38.935709 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-a01603d8-e1cd-4a64-b6ad-eb11665535ac tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:38.937206 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-a01603d8-e1cd-4a64-b6ad-eb11665535ac tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:38.938380 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-a01603d8-e1cd-4a64-b6ad-eb11665535ac tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.084422 Mar 08 15:25:38.938933 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1294/2417] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:38 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:25:38.943881 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-e69031e5-c5dc-46ef-b203-9dcc294848d8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:38.944477 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-e69031e5-c5dc-46ef-b203-9dcc294848d8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:38.953330 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e69031e5-c5dc-46ef-b203-9dcc294848d8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:38.953778 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e69031e5-c5dc-46ef-b203-9dcc294848d8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:38.954575 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e69031e5-c5dc-46ef-b203-9dcc294848d8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:38.955008 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e69031e5-c5dc-46ef-b203-9dcc294848d8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:39.013445 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-e69031e5-c5dc-46ef-b203-9dcc294848d8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:39.022123 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-e69031e5-c5dc-46ef-b203-9dcc294848d8 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.082196 Mar 08 15:25:39.022696 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1295/2418] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:38 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:25:39.957947 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b7888ea9-eaad-4909-bd98-502c704798fc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:39.958583 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b7888ea9-eaad-4909-bd98-502c704798fc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:39.964739 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b7888ea9-eaad-4909-bd98-502c704798fc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:39.965188 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b7888ea9-eaad-4909-bd98-502c704798fc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:39.965979 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b7888ea9-eaad-4909-bd98-502c704798fc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:39.966413 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b7888ea9-eaad-4909-bd98-502c704798fc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:40.025371 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b7888ea9-eaad-4909-bd98-502c704798fc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:40.034409 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b7888ea9-eaad-4909-bd98-502c704798fc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:40.035921 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b7888ea9-eaad-4909-bd98-502c704798fc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:40.037123 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b7888ea9-eaad-4909-bd98-502c704798fc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.083290 Mar 08 15:25:40.037677 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1296/2419] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:39 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:25:40.041961 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3ccbe569-e091-4836-8fed-54540f81ded2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:40.042562 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-3ccbe569-e091-4836-8fed-54540f81ded2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:40.048229 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3ccbe569-e091-4836-8fed-54540f81ded2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:40.048677 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3ccbe569-e091-4836-8fed-54540f81ded2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:40.050170 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3ccbe569-e091-4836-8fed-54540f81ded2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:40.050602 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3ccbe569-e091-4836-8fed-54540f81ded2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:40.107237 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-3ccbe569-e091-4836-8fed-54540f81ded2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:40.115749 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-3ccbe569-e091-4836-8fed-54540f81ded2 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.077100 Mar 08 15:25:40.116322 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1297/2420] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:40 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:25:41.055577 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-44d7ee64-7735-4335-86c4-dd055b372048 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:41.056258 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-44d7ee64-7735-4335-86c4-dd055b372048 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:41.062455 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-44d7ee64-7735-4335-86c4-dd055b372048 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:41.062909 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-44d7ee64-7735-4335-86c4-dd055b372048 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:41.063680 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-44d7ee64-7735-4335-86c4-dd055b372048 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:41.064119 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-44d7ee64-7735-4335-86c4-dd055b372048 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:41.123470 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-44d7ee64-7735-4335-86c4-dd055b372048 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:41.132633 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-44d7ee64-7735-4335-86c4-dd055b372048 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:41.134164 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-44d7ee64-7735-4335-86c4-dd055b372048 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:41.135298 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-44d7ee64-7735-4335-86c4-dd055b372048 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.083615 Mar 08 15:25:41.135853 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1298/2421] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:41 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:25:41.140111 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-8b45ab69-d55c-4967-abe0-0fb819dd0ba9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:41.140716 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-8b45ab69-d55c-4967-abe0-0fb819dd0ba9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:41.146707 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8b45ab69-d55c-4967-abe0-0fb819dd0ba9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:41.147162 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8b45ab69-d55c-4967-abe0-0fb819dd0ba9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:41.147927 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8b45ab69-d55c-4967-abe0-0fb819dd0ba9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:41.148369 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8b45ab69-d55c-4967-abe0-0fb819dd0ba9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:41.210020 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-8b45ab69-d55c-4967-abe0-0fb819dd0ba9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:41.217755 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-8b45ab69-d55c-4967-abe0-0fb819dd0ba9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.080971 Mar 08 15:25:41.218369 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1299/2422] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:41 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:25:42.153355 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-a7e677af-90d5-4758-8bb0-84e52d5e9550 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:42.154079 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-a7e677af-90d5-4758-8bb0-84e52d5e9550 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:42.160858 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a7e677af-90d5-4758-8bb0-84e52d5e9550 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:42.161310 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a7e677af-90d5-4758-8bb0-84e52d5e9550 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:42.162109 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a7e677af-90d5-4758-8bb0-84e52d5e9550 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:42.162548 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a7e677af-90d5-4758-8bb0-84e52d5e9550 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:42.221058 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-a7e677af-90d5-4758-8bb0-84e52d5e9550 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:42.229518 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-a7e677af-90d5-4758-8bb0-84e52d5e9550 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:42.231075 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-a7e677af-90d5-4758-8bb0-84e52d5e9550 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:42.232217 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-a7e677af-90d5-4758-8bb0-84e52d5e9550 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.082731 Mar 08 15:25:42.232774 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1300/2423] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:42 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:25:42.237097 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-28a4596c-d1b6-42d8-bcf4-082ce2460f4a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:42.237701 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-28a4596c-d1b6-42d8-bcf4-082ce2460f4a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:42.243160 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-28a4596c-d1b6-42d8-bcf4-082ce2460f4a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:42.243621 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-28a4596c-d1b6-42d8-bcf4-082ce2460f4a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:42.244394 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-28a4596c-d1b6-42d8-bcf4-082ce2460f4a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:42.244855 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-28a4596c-d1b6-42d8-bcf4-082ce2460f4a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:42.302446 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-28a4596c-d1b6-42d8-bcf4-082ce2460f4a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:42.310349 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-28a4596c-d1b6-42d8-bcf4-082ce2460f4a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.076625 Mar 08 15:25:42.310918 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1301/2424] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:42 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:25:43.250437 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3153ecc5-d8a7-4258-b8c7-e953c43a60d8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:43.251113 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-3153ecc5-d8a7-4258-b8c7-e953c43a60d8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:43.258017 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3153ecc5-d8a7-4258-b8c7-e953c43a60d8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:43.258476 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3153ecc5-d8a7-4258-b8c7-e953c43a60d8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:43.259246 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3153ecc5-d8a7-4258-b8c7-e953c43a60d8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:43.259688 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3153ecc5-d8a7-4258-b8c7-e953c43a60d8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:43.318770 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-3153ecc5-d8a7-4258-b8c7-e953c43a60d8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:43.327017 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-3153ecc5-d8a7-4258-b8c7-e953c43a60d8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:43.328513 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-3153ecc5-d8a7-4258-b8c7-e953c43a60d8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:43.329636 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-3153ecc5-d8a7-4258-b8c7-e953c43a60d8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.083147 Mar 08 15:25:43.330251 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1302/2425] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:43 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:25:43.334712 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-4db2d15a-1c40-4a28-b9ae-c4ce42d47c60 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:43.335305 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-4db2d15a-1c40-4a28-b9ae-c4ce42d47c60 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:43.340647 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4db2d15a-1c40-4a28-b9ae-c4ce42d47c60 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:43.341091 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4db2d15a-1c40-4a28-b9ae-c4ce42d47c60 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:43.341906 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4db2d15a-1c40-4a28-b9ae-c4ce42d47c60 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:43.342341 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4db2d15a-1c40-4a28-b9ae-c4ce42d47c60 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:43.402399 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-4db2d15a-1c40-4a28-b9ae-c4ce42d47c60 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:43.411932 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-4db2d15a-1c40-4a28-b9ae-c4ce42d47c60 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.080549 Mar 08 15:25:43.412506 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1303/2426] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:43 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:25:44.347455 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ac293460-a88c-4565-806d-5ab67a65b300 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:44.348124 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ac293460-a88c-4565-806d-5ab67a65b300 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:44.354315 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ac293460-a88c-4565-806d-5ab67a65b300 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:44.354766 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ac293460-a88c-4565-806d-5ab67a65b300 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:44.355529 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ac293460-a88c-4565-806d-5ab67a65b300 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:44.355967 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ac293460-a88c-4565-806d-5ab67a65b300 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:44.416082 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ac293460-a88c-4565-806d-5ab67a65b300 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:44.424233 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ac293460-a88c-4565-806d-5ab67a65b300 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:44.425695 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ac293460-a88c-4565-806d-5ab67a65b300 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:44.426859 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ac293460-a88c-4565-806d-5ab67a65b300 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.084000 Mar 08 15:25:44.427411 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1304/2427] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:44 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:25:44.431643 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d9345d63-59dc-4d6d-b38b-eea97bd496a9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:44.432239 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d9345d63-59dc-4d6d-b38b-eea97bd496a9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:44.437881 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d9345d63-59dc-4d6d-b38b-eea97bd496a9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:44.438331 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d9345d63-59dc-4d6d-b38b-eea97bd496a9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:44.439086 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d9345d63-59dc-4d6d-b38b-eea97bd496a9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:44.440005 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d9345d63-59dc-4d6d-b38b-eea97bd496a9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:44.502586 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d9345d63-59dc-4d6d-b38b-eea97bd496a9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:44.510195 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d9345d63-59dc-4d6d-b38b-eea97bd496a9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.081837 Mar 08 15:25:44.510753 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1305/2428] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:44 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:25:45.444930 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-13aa98b7-6e42-4658-a438-ffa6b55666bf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:45.445599 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-13aa98b7-6e42-4658-a438-ffa6b55666bf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:45.451862 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-13aa98b7-6e42-4658-a438-ffa6b55666bf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:45.452310 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-13aa98b7-6e42-4658-a438-ffa6b55666bf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:45.453067 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-13aa98b7-6e42-4658-a438-ffa6b55666bf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:45.453502 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-13aa98b7-6e42-4658-a438-ffa6b55666bf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:45.514011 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-13aa98b7-6e42-4658-a438-ffa6b55666bf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:45.522680 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-13aa98b7-6e42-4658-a438-ffa6b55666bf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:45.524190 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-13aa98b7-6e42-4658-a438-ffa6b55666bf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:45.525328 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-13aa98b7-6e42-4658-a438-ffa6b55666bf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.084272 Mar 08 15:25:45.525893 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1306/2429] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:45 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:25:45.530161 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-41ae98fb-993a-46fd-9369-fb2ddfc138be tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:45.531044 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-41ae98fb-993a-46fd-9369-fb2ddfc138be tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:45.536743 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-41ae98fb-993a-46fd-9369-fb2ddfc138be tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:45.537197 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-41ae98fb-993a-46fd-9369-fb2ddfc138be tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:45.537996 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-41ae98fb-993a-46fd-9369-fb2ddfc138be tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:45.538434 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-41ae98fb-993a-46fd-9369-fb2ddfc138be tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:45.597145 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-41ae98fb-993a-46fd-9369-fb2ddfc138be tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:45.605047 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-41ae98fb-993a-46fd-9369-fb2ddfc138be tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.078228 Mar 08 15:25:45.605598 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1307/2430] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:45 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:25:46.543574 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-bf928161-3b9f-4952-8a27-ca73ed4a40e2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:46.544217 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-bf928161-3b9f-4952-8a27-ca73ed4a40e2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:46.551103 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bf928161-3b9f-4952-8a27-ca73ed4a40e2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:46.551553 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bf928161-3b9f-4952-8a27-ca73ed4a40e2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:46.552309 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bf928161-3b9f-4952-8a27-ca73ed4a40e2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:46.552742 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bf928161-3b9f-4952-8a27-ca73ed4a40e2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:46.610605 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-bf928161-3b9f-4952-8a27-ca73ed4a40e2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:46.619479 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-bf928161-3b9f-4952-8a27-ca73ed4a40e2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:46.620910 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-bf928161-3b9f-4952-8a27-ca73ed4a40e2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:46.622061 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-bf928161-3b9f-4952-8a27-ca73ed4a40e2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.082379 Mar 08 15:25:46.622608 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1308/2431] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:46 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:25:46.626955 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-deecf14e-502b-4be8-ad0a-362594d92fd5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:46.627639 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-deecf14e-502b-4be8-ad0a-362594d92fd5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:46.633512 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-deecf14e-502b-4be8-ad0a-362594d92fd5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:46.634010 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-deecf14e-502b-4be8-ad0a-362594d92fd5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:46.634848 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-deecf14e-502b-4be8-ad0a-362594d92fd5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:46.635312 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-deecf14e-502b-4be8-ad0a-362594d92fd5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:46.693201 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-deecf14e-502b-4be8-ad0a-362594d92fd5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:46.700939 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-deecf14e-502b-4be8-ad0a-362594d92fd5 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.077408 Mar 08 15:25:46.701508 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1309/2432] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:46 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:25:47.639667 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b20085ee-4c57-4521-b16c-99446c829020 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:47.640330 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b20085ee-4c57-4521-b16c-99446c829020 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:47.646638 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b20085ee-4c57-4521-b16c-99446c829020 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:47.647087 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b20085ee-4c57-4521-b16c-99446c829020 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:47.647843 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b20085ee-4c57-4521-b16c-99446c829020 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:47.648275 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b20085ee-4c57-4521-b16c-99446c829020 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:47.706077 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b20085ee-4c57-4521-b16c-99446c829020 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:47.714357 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b20085ee-4c57-4521-b16c-99446c829020 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:47.715895 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b20085ee-4c57-4521-b16c-99446c829020 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:47.717027 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b20085ee-4c57-4521-b16c-99446c829020 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.081313 Mar 08 15:25:47.717605 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1310/2433] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:47 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:25:47.722154 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-817a4b83-451f-46ba-b979-4ff3a4ea2c3a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:47.722767 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-817a4b83-451f-46ba-b979-4ff3a4ea2c3a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:47.728511 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-817a4b83-451f-46ba-b979-4ff3a4ea2c3a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:47.728972 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-817a4b83-451f-46ba-b979-4ff3a4ea2c3a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:47.729739 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-817a4b83-451f-46ba-b979-4ff3a4ea2c3a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:47.730214 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-817a4b83-451f-46ba-b979-4ff3a4ea2c3a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:47.790998 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-817a4b83-451f-46ba-b979-4ff3a4ea2c3a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:47.798688 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-817a4b83-451f-46ba-b979-4ff3a4ea2c3a tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.080051 Mar 08 15:25:47.799941 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1311/2434] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:47 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:25:48.734821 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-4a982ca3-bcb7-4d6c-a667-88f716ce9449 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:48.735506 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-4a982ca3-bcb7-4d6c-a667-88f716ce9449 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:48.742329 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4a982ca3-bcb7-4d6c-a667-88f716ce9449 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:48.742785 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4a982ca3-bcb7-4d6c-a667-88f716ce9449 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:48.743552 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4a982ca3-bcb7-4d6c-a667-88f716ce9449 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:48.743988 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4a982ca3-bcb7-4d6c-a667-88f716ce9449 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:48.805151 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-4a982ca3-bcb7-4d6c-a667-88f716ce9449 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:48.813309 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-4a982ca3-bcb7-4d6c-a667-88f716ce9449 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:48.815349 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-4a982ca3-bcb7-4d6c-a667-88f716ce9449 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:48.816571 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-4a982ca3-bcb7-4d6c-a667-88f716ce9449 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.085629 Mar 08 15:25:48.817119 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1312/2435] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:48 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:25:48.821463 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-eb87be09-b073-4525-9d04-4d4875177f1b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:48.822090 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-eb87be09-b073-4525-9d04-4d4875177f1b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:48.828029 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-eb87be09-b073-4525-9d04-4d4875177f1b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:48.828603 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-eb87be09-b073-4525-9d04-4d4875177f1b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:48.829383 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-eb87be09-b073-4525-9d04-4d4875177f1b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:48.829827 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-eb87be09-b073-4525-9d04-4d4875177f1b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:48.888019 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-eb87be09-b073-4525-9d04-4d4875177f1b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:48.896301 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-eb87be09-b073-4525-9d04-4d4875177f1b tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.078261 Mar 08 15:25:48.896869 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1313/2436] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:48 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:25:49.834343 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d0be6112-7537-49d3-976d-3da684bb2701 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:49.834999 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d0be6112-7537-49d3-976d-3da684bb2701 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:49.841185 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d0be6112-7537-49d3-976d-3da684bb2701 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:49.841635 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d0be6112-7537-49d3-976d-3da684bb2701 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:49.842418 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d0be6112-7537-49d3-976d-3da684bb2701 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:49.842854 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d0be6112-7537-49d3-976d-3da684bb2701 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:49.903321 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d0be6112-7537-49d3-976d-3da684bb2701 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:49.912183 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d0be6112-7537-49d3-976d-3da684bb2701 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:49.913672 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d0be6112-7537-49d3-976d-3da684bb2701 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:49.914826 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d0be6112-7537-49d3-976d-3da684bb2701 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.084987 Mar 08 15:25:49.915378 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1314/2437] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:49 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:25:49.919628 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-264f68f8-a2ff-4fec-9230-a446c3ca5d57 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:49.920223 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-264f68f8-a2ff-4fec-9230-a446c3ca5d57 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:49.926650 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-264f68f8-a2ff-4fec-9230-a446c3ca5d57 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:49.927114 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-264f68f8-a2ff-4fec-9230-a446c3ca5d57 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:49.927922 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-264f68f8-a2ff-4fec-9230-a446c3ca5d57 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:49.928421 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-264f68f8-a2ff-4fec-9230-a446c3ca5d57 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:49.987434 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-264f68f8-a2ff-4fec-9230-a446c3ca5d57 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:49.995194 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-264f68f8-a2ff-4fec-9230-a446c3ca5d57 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.078887 Mar 08 15:25:49.995760 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1315/2438] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:49 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:25:50.933669 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b88a7165-5d9a-494d-9235-bb42df75c88d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:50.934367 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b88a7165-5d9a-494d-9235-bb42df75c88d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:50.941656 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b88a7165-5d9a-494d-9235-bb42df75c88d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:50.942153 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b88a7165-5d9a-494d-9235-bb42df75c88d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:50.942991 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b88a7165-5d9a-494d-9235-bb42df75c88d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:50.943478 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b88a7165-5d9a-494d-9235-bb42df75c88d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:51.002762 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b88a7165-5d9a-494d-9235-bb42df75c88d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:51.010740 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b88a7165-5d9a-494d-9235-bb42df75c88d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:51.012294 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b88a7165-5d9a-494d-9235-bb42df75c88d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:51.013438 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b88a7165-5d9a-494d-9235-bb42df75c88d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.083683 Mar 08 15:25:51.014019 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1316/2439] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:50 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:25:51.018894 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-e71e8dac-78b4-4665-a27f-00a8cee3c199 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:51.019502 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-e71e8dac-78b4-4665-a27f-00a8cee3c199 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:51.024977 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e71e8dac-78b4-4665-a27f-00a8cee3c199 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:51.025432 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e71e8dac-78b4-4665-a27f-00a8cee3c199 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:51.026233 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e71e8dac-78b4-4665-a27f-00a8cee3c199 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:51.026677 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e71e8dac-78b4-4665-a27f-00a8cee3c199 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:51.094532 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-e71e8dac-78b4-4665-a27f-00a8cee3c199 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:51.102464 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-e71e8dac-78b4-4665-a27f-00a8cee3c199 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.087514 Mar 08 15:25:51.103037 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1317/2440] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:51 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:25:52.032212 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-ae696e82-f86d-4d9a-8bc5-bc8e4fcf1fa8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:52.032847 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-ae696e82-f86d-4d9a-8bc5-bc8e4fcf1fa8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:52.039739 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ae696e82-f86d-4d9a-8bc5-bc8e4fcf1fa8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:52.040186 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ae696e82-f86d-4d9a-8bc5-bc8e4fcf1fa8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:52.040948 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ae696e82-f86d-4d9a-8bc5-bc8e4fcf1fa8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:52.041385 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-ae696e82-f86d-4d9a-8bc5-bc8e4fcf1fa8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:52.100216 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ae696e82-f86d-4d9a-8bc5-bc8e4fcf1fa8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:52.108274 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ae696e82-f86d-4d9a-8bc5-bc8e4fcf1fa8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:52.109774 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-ae696e82-f86d-4d9a-8bc5-bc8e4fcf1fa8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:52.110926 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-ae696e82-f86d-4d9a-8bc5-bc8e4fcf1fa8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.082895 Mar 08 15:25:52.112085 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1318/2441] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:52 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:25:52.118722 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-58e53d6c-697f-41ac-bb19-182ba1b989cf tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:52.119336 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-58e53d6c-697f-41ac-bb19-182ba1b989cf tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:52.124902 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-58e53d6c-697f-41ac-bb19-182ba1b989cf tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:52.125360 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-58e53d6c-697f-41ac-bb19-182ba1b989cf tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:52.126159 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-58e53d6c-697f-41ac-bb19-182ba1b989cf tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:52.126603 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-58e53d6c-697f-41ac-bb19-182ba1b989cf tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:52.184271 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-58e53d6c-697f-41ac-bb19-182ba1b989cf tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:52.192050 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-58e53d6c-697f-41ac-bb19-182ba1b989cf tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.076787 Mar 08 15:25:52.192553 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1319/2442] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:52 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:25:53.129345 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d2eb29a8-2c75-444f-9d08-79043ddc17dc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:53.130036 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d2eb29a8-2c75-444f-9d08-79043ddc17dc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:53.136263 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d2eb29a8-2c75-444f-9d08-79043ddc17dc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:53.136717 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d2eb29a8-2c75-444f-9d08-79043ddc17dc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:53.137485 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d2eb29a8-2c75-444f-9d08-79043ddc17dc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:53.137969 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d2eb29a8-2c75-444f-9d08-79043ddc17dc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:53.196650 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d2eb29a8-2c75-444f-9d08-79043ddc17dc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:53.205348 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d2eb29a8-2c75-444f-9d08-79043ddc17dc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:53.206943 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d2eb29a8-2c75-444f-9d08-79043ddc17dc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:53.208073 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d2eb29a8-2c75-444f-9d08-79043ddc17dc tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.082765 Mar 08 15:25:53.208630 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1320/2443] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:53 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:25:53.212927 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-0acc5d5f-5dfc-4e95-b238-75c4c7d7c14f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:53.213526 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-0acc5d5f-5dfc-4e95-b238-75c4c7d7c14f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:53.218987 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0acc5d5f-5dfc-4e95-b238-75c4c7d7c14f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:53.219441 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0acc5d5f-5dfc-4e95-b238-75c4c7d7c14f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:53.220207 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0acc5d5f-5dfc-4e95-b238-75c4c7d7c14f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:53.221457 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0acc5d5f-5dfc-4e95-b238-75c4c7d7c14f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:53.278756 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-0acc5d5f-5dfc-4e95-b238-75c4c7d7c14f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:53.286822 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-0acc5d5f-5dfc-4e95-b238-75c4c7d7c14f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.077269 Mar 08 15:25:53.287387 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1321/2444] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:53 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:25:54.226585 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-4a80f1c3-be29-4907-a8a8-032c73dff779 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:54.227264 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-4a80f1c3-be29-4907-a8a8-032c73dff779 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:54.233427 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4a80f1c3-be29-4907-a8a8-032c73dff779 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:54.233908 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4a80f1c3-be29-4907-a8a8-032c73dff779 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:54.234710 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4a80f1c3-be29-4907-a8a8-032c73dff779 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:54.235125 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4a80f1c3-be29-4907-a8a8-032c73dff779 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:54.296183 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-4a80f1c3-be29-4907-a8a8-032c73dff779 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:54.305020 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-4a80f1c3-be29-4907-a8a8-032c73dff779 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:54.306549 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-4a80f1c3-be29-4907-a8a8-032c73dff779 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:54.307669 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-4a80f1c3-be29-4907-a8a8-032c73dff779 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.085042 Mar 08 15:25:54.308221 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1322/2445] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:54 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:25:54.312457 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-1f6866e5-d2f9-4477-b25e-8b51d651df18 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:54.313055 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-1f6866e5-d2f9-4477-b25e-8b51d651df18 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:54.318447 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1f6866e5-d2f9-4477-b25e-8b51d651df18 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:54.318895 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1f6866e5-d2f9-4477-b25e-8b51d651df18 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:54.319650 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1f6866e5-d2f9-4477-b25e-8b51d651df18 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:54.320089 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1f6866e5-d2f9-4477-b25e-8b51d651df18 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:54.380845 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-1f6866e5-d2f9-4477-b25e-8b51d651df18 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:54.388620 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-1f6866e5-d2f9-4477-b25e-8b51d651df18 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.079480 Mar 08 15:25:54.389181 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1323/2446] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:54 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:25:55.326253 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-321ac76f-4276-4d0f-946c-94c27f17f9c6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:55.326918 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-321ac76f-4276-4d0f-946c-94c27f17f9c6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:55.333255 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-321ac76f-4276-4d0f-946c-94c27f17f9c6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:55.333719 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-321ac76f-4276-4d0f-946c-94c27f17f9c6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:55.334529 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-321ac76f-4276-4d0f-946c-94c27f17f9c6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:55.334971 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-321ac76f-4276-4d0f-946c-94c27f17f9c6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:55.395344 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-321ac76f-4276-4d0f-946c-94c27f17f9c6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:55.403743 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-321ac76f-4276-4d0f-946c-94c27f17f9c6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:55.405546 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-321ac76f-4276-4d0f-946c-94c27f17f9c6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:55.406742 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-321ac76f-4276-4d0f-946c-94c27f17f9c6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.084483 Mar 08 15:25:55.407294 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1324/2447] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:55 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:25:55.412308 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-a6563281-baed-4e5f-bf17-72bef453ae9e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:55.412916 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-a6563281-baed-4e5f-bf17-72bef453ae9e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:55.418482 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a6563281-baed-4e5f-bf17-72bef453ae9e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:55.418943 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a6563281-baed-4e5f-bf17-72bef453ae9e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:55.419719 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a6563281-baed-4e5f-bf17-72bef453ae9e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:55.420163 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a6563281-baed-4e5f-bf17-72bef453ae9e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:55.478094 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-a6563281-baed-4e5f-bf17-72bef453ae9e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:55.485776 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-a6563281-baed-4e5f-bf17-72bef453ae9e tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.077524 Mar 08 15:25:55.486475 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1325/2448] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:55 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:25:56.425057 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-bc5f071f-2fd6-44a8-9fa8-62df18235c63 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:56.425647 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-bc5f071f-2fd6-44a8-9fa8-62df18235c63 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:56.432011 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bc5f071f-2fd6-44a8-9fa8-62df18235c63 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:56.432461 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bc5f071f-2fd6-44a8-9fa8-62df18235c63 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:56.433229 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bc5f071f-2fd6-44a8-9fa8-62df18235c63 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:56.433662 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-bc5f071f-2fd6-44a8-9fa8-62df18235c63 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:56.492341 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-bc5f071f-2fd6-44a8-9fa8-62df18235c63 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:56.500346 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-bc5f071f-2fd6-44a8-9fa8-62df18235c63 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:56.501838 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-bc5f071f-2fd6-44a8-9fa8-62df18235c63 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:56.502995 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-bc5f071f-2fd6-44a8-9fa8-62df18235c63 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.082391 Mar 08 15:25:56.503543 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1326/2449] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:56 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:25:56.507851 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-1c0ca29b-29bb-43f7-9f27-57349ce5a1fa tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:56.508447 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-1c0ca29b-29bb-43f7-9f27-57349ce5a1fa tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:56.514226 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1c0ca29b-29bb-43f7-9f27-57349ce5a1fa tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:56.514685 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1c0ca29b-29bb-43f7-9f27-57349ce5a1fa tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:56.515477 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1c0ca29b-29bb-43f7-9f27-57349ce5a1fa tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:56.515912 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1c0ca29b-29bb-43f7-9f27-57349ce5a1fa tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:56.574495 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-1c0ca29b-29bb-43f7-9f27-57349ce5a1fa tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:56.582263 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-1c0ca29b-29bb-43f7-9f27-57349ce5a1fa tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.077770 Mar 08 15:25:56.582823 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1327/2450] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:56 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:25:57.520841 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-61344a6c-bb3d-4f6e-8524-f6c2b1b398d6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:57.521536 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-61344a6c-bb3d-4f6e-8524-f6c2b1b398d6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:57.527761 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-61344a6c-bb3d-4f6e-8524-f6c2b1b398d6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:57.528217 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-61344a6c-bb3d-4f6e-8524-f6c2b1b398d6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:57.528982 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-61344a6c-bb3d-4f6e-8524-f6c2b1b398d6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:57.529422 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-61344a6c-bb3d-4f6e-8524-f6c2b1b398d6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:57.590044 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-61344a6c-bb3d-4f6e-8524-f6c2b1b398d6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:57.598875 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-61344a6c-bb3d-4f6e-8524-f6c2b1b398d6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:57.600376 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-61344a6c-bb3d-4f6e-8524-f6c2b1b398d6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:57.601507 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-61344a6c-bb3d-4f6e-8524-f6c2b1b398d6 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.084859 Mar 08 15:25:57.602098 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1328/2451] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:57 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:25:57.606446 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-98a817c1-9b44-481f-a777-24bf62b81dc9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:57.607049 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-98a817c1-9b44-481f-a777-24bf62b81dc9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:57.613243 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-98a817c1-9b44-481f-a777-24bf62b81dc9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:57.613695 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-98a817c1-9b44-481f-a777-24bf62b81dc9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:57.614485 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-98a817c1-9b44-481f-a777-24bf62b81dc9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:57.614923 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-98a817c1-9b44-481f-a777-24bf62b81dc9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:57.676997 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-98a817c1-9b44-481f-a777-24bf62b81dc9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:57.684673 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-98a817c1-9b44-481f-a777-24bf62b81dc9 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.081650 Mar 08 15:25:57.685232 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1329/2452] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:57 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:25:58.620461 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-107be53b-f368-41f4-868e-911b1f2aed97 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:58.621104 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-107be53b-f368-41f4-868e-911b1f2aed97 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:58.627818 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-107be53b-f368-41f4-868e-911b1f2aed97 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:58.628265 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-107be53b-f368-41f4-868e-911b1f2aed97 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:58.629022 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-107be53b-f368-41f4-868e-911b1f2aed97 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:58.629454 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-107be53b-f368-41f4-868e-911b1f2aed97 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:58.690298 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-107be53b-f368-41f4-868e-911b1f2aed97 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:58.698517 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-107be53b-f368-41f4-868e-911b1f2aed97 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:58.700011 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-107be53b-f368-41f4-868e-911b1f2aed97 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:58.701132 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-107be53b-f368-41f4-868e-911b1f2aed97 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.084569 Mar 08 15:25:58.701682 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1330/2453] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:58 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:25:58.706681 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-a39f4858-8dd1-41c5-aafc-f0eebd98862f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:58.707277 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-a39f4858-8dd1-41c5-aafc-f0eebd98862f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:58.712699 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a39f4858-8dd1-41c5-aafc-f0eebd98862f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:58.713147 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a39f4858-8dd1-41c5-aafc-f0eebd98862f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:58.713927 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a39f4858-8dd1-41c5-aafc-f0eebd98862f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:58.714362 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a39f4858-8dd1-41c5-aafc-f0eebd98862f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:58.774174 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-a39f4858-8dd1-41c5-aafc-f0eebd98862f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:58.782178 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-a39f4858-8dd1-41c5-aafc-f0eebd98862f tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.079479 Mar 08 15:25:58.782803 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1331/2454] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:58 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:25:59.719578 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f7fa3abd-24a1-477a-b9e4-977263c13e1e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:59.720857 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f7fa3abd-24a1-477a-b9e4-977263c13e1e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:59.727245 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f7fa3abd-24a1-477a-b9e4-977263c13e1e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:59.727703 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f7fa3abd-24a1-477a-b9e4-977263c13e1e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:59.728478 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f7fa3abd-24a1-477a-b9e4-977263c13e1e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:59.728922 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f7fa3abd-24a1-477a-b9e4-977263c13e1e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:59.787521 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f7fa3abd-24a1-477a-b9e4-977263c13e1e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:59.795837 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f7fa3abd-24a1-477a-b9e4-977263c13e1e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:59.797348 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f7fa3abd-24a1-477a-b9e4-977263c13e1e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:59.798525 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f7fa3abd-24a1-477a-b9e4-977263c13e1e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.082880 Mar 08 15:25:59.799078 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1332/2455] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:25:59 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:25:59.803471 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-1e2088be-adb5-425b-bf6c-ff2a776c14e0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:25:59.804078 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-1e2088be-adb5-425b-bf6c-ff2a776c14e0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:25:59.809489 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1e2088be-adb5-425b-bf6c-ff2a776c14e0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:59.809981 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1e2088be-adb5-425b-bf6c-ff2a776c14e0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:59.810748 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1e2088be-adb5-425b-bf6c-ff2a776c14e0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:25:59.811190 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1e2088be-adb5-425b-bf6c-ff2a776c14e0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:25:59.868838 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-1e2088be-adb5-425b-bf6c-ff2a776c14e0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:25:59.876618 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-1e2088be-adb5-425b-bf6c-ff2a776c14e0 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.076547 Mar 08 15:25:59.877322 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1333/2456] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:25:59 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:26:00.816053 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c3fbb56d-3f96-4fc4-aeed-0b3589109629 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:00.816711 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-c3fbb56d-3f96-4fc4-aeed-0b3589109629 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:00.822992 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c3fbb56d-3f96-4fc4-aeed-0b3589109629 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:00.823451 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c3fbb56d-3f96-4fc4-aeed-0b3589109629 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:00.824249 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c3fbb56d-3f96-4fc4-aeed-0b3589109629 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:00.824692 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c3fbb56d-3f96-4fc4-aeed-0b3589109629 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:00.884072 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-c3fbb56d-3f96-4fc4-aeed-0b3589109629 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:00.892577 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-c3fbb56d-3f96-4fc4-aeed-0b3589109629 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:00.894131 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-c3fbb56d-3f96-4fc4-aeed-0b3589109629 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:00.895276 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-c3fbb56d-3f96-4fc4-aeed-0b3589109629 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.083149 Mar 08 15:26:00.895830 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1334/2457] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:26:00 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:26:00.900143 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-dd0e580f-6084-4845-92a1-22bda9164b88 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:00.900754 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-dd0e580f-6084-4845-92a1-22bda9164b88 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:00.906521 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dd0e580f-6084-4845-92a1-22bda9164b88 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:00.906979 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dd0e580f-6084-4845-92a1-22bda9164b88 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:00.908314 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dd0e580f-6084-4845-92a1-22bda9164b88 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:00.908914 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dd0e580f-6084-4845-92a1-22bda9164b88 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:00.969514 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-dd0e580f-6084-4845-92a1-22bda9164b88 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:00.978110 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-dd0e580f-6084-4845-92a1-22bda9164b88 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.081308 Mar 08 15:26:00.978676 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1335/2458] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:26:00 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:26:01.913351 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5a1b18d1-08ed-4221-8065-ac09c5fdc13f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:01.914115 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5a1b18d1-08ed-4221-8065-ac09c5fdc13f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:01.920365 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5a1b18d1-08ed-4221-8065-ac09c5fdc13f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:01.920824 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5a1b18d1-08ed-4221-8065-ac09c5fdc13f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:01.921592 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5a1b18d1-08ed-4221-8065-ac09c5fdc13f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:01.922066 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5a1b18d1-08ed-4221-8065-ac09c5fdc13f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:01.981367 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-5a1b18d1-08ed-4221-8065-ac09c5fdc13f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:01.990262 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-5a1b18d1-08ed-4221-8065-ac09c5fdc13f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:01.991772 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-5a1b18d1-08ed-4221-8065-ac09c5fdc13f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:01.992940 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5a1b18d1-08ed-4221-8065-ac09c5fdc13f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.083533 Mar 08 15:26:01.993485 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1336/2459] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:26:01 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:26:01.997824 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-4bb5740c-e725-48bf-b8ee-f9e34316f716 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:01.998451 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-4bb5740c-e725-48bf-b8ee-f9e34316f716 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:02.004793 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4bb5740c-e725-48bf-b8ee-f9e34316f716 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:02.005246 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4bb5740c-e725-48bf-b8ee-f9e34316f716 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:02.006056 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4bb5740c-e725-48bf-b8ee-f9e34316f716 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:02.006521 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4bb5740c-e725-48bf-b8ee-f9e34316f716 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:02.063796 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-4bb5740c-e725-48bf-b8ee-f9e34316f716 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:02.071945 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-4bb5740c-e725-48bf-b8ee-f9e34316f716 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.077431 Mar 08 15:26:02.072507 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1337/2460] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:26:01 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:26:03.011381 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-7491e6d3-0b07-410c-a97a-38b062a20497 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:03.012032 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-7491e6d3-0b07-410c-a97a-38b062a20497 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:03.019705 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7491e6d3-0b07-410c-a97a-38b062a20497 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:03.020157 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7491e6d3-0b07-410c-a97a-38b062a20497 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:03.020913 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7491e6d3-0b07-410c-a97a-38b062a20497 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:03.021348 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7491e6d3-0b07-410c-a97a-38b062a20497 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:03.082823 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-7491e6d3-0b07-410c-a97a-38b062a20497 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:03.091070 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-7491e6d3-0b07-410c-a97a-38b062a20497 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:03.092593 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-7491e6d3-0b07-410c-a97a-38b062a20497 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:03.093733 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-7491e6d3-0b07-410c-a97a-38b062a20497 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.086224 Mar 08 15:26:03.094332 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1338/2461] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:26:03 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:26:03.098711 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-0684d128-0d7c-462b-bcb0-8a1b2ccc7283 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:03.099319 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-0684d128-0d7c-462b-bcb0-8a1b2ccc7283 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:03.104721 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0684d128-0d7c-462b-bcb0-8a1b2ccc7283 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:03.105177 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0684d128-0d7c-462b-bcb0-8a1b2ccc7283 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:03.105979 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0684d128-0d7c-462b-bcb0-8a1b2ccc7283 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:03.106427 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0684d128-0d7c-462b-bcb0-8a1b2ccc7283 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:03.164789 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-0684d128-0d7c-462b-bcb0-8a1b2ccc7283 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:03.172822 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-0684d128-0d7c-462b-bcb0-8a1b2ccc7283 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.077553 Mar 08 15:26:03.173538 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1339/2462] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:26:03 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:26:04.111828 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-1484c759-2ef8-4685-8e91-d94c024eb7b3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:04.112447 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-1484c759-2ef8-4685-8e91-d94c024eb7b3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:04.118834 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1484c759-2ef8-4685-8e91-d94c024eb7b3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:04.119291 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1484c759-2ef8-4685-8e91-d94c024eb7b3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:04.120063 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1484c759-2ef8-4685-8e91-d94c024eb7b3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:04.120508 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-1484c759-2ef8-4685-8e91-d94c024eb7b3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:04.180594 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-1484c759-2ef8-4685-8e91-d94c024eb7b3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:04.190741 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-1484c759-2ef8-4685-8e91-d94c024eb7b3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:04.192305 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-1484c759-2ef8-4685-8e91-d94c024eb7b3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:04.193477 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-1484c759-2ef8-4685-8e91-d94c024eb7b3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 200 len: 1444 microversion: 2.20 time: 0.085537 Mar 08 15:26:04.194053 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1340/2463] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:26:04 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:26:04.199035 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-9b703b0e-d18e-4117-9213-0a53e754e828 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:04.199647 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-9b703b0e-d18e-4117-9213-0a53e754e828 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:04.206076 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9b703b0e-d18e-4117-9213-0a53e754e828 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:04.206533 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9b703b0e-d18e-4117-9213-0a53e754e828 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:04.207308 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9b703b0e-d18e-4117-9213-0a53e754e828 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:04.207749 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9b703b0e-d18e-4117-9213-0a53e754e828 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:04.269394 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-9b703b0e-d18e-4117-9213-0a53e754e828 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c5fac3bd10428d87723eaf90bcbfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ecfade47630412b85598218c7c04664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:04.277140 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-9b703b0e-d18e-4117-9213-0a53e754e828 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 200 len: 1390 microversion: 2.1 time: 0.082107 Mar 08 15:26:04.277691 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1341/2464] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:26:04 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:26:04.608128 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.wsgi [None req-5ae2be2e-89b1-492a-a253-7ecaade05e65 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8ab82397-8e99-4379-8541-9085094888e3) Mar 08 15:26:04.608625 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-5ae2be2e-89b1-492a-a253-7ecaade05e65 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8ab82397-8e99-4379-8541-9085094888e3) {{(pid=128351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:26:04.609222 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-5ae2be2e-89b1-492a-a253-7ecaade05e65 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52/os-volume_attachments/67fc183b-4d10-4f71-9e5d-14819fc5becd" status: 400 len: 269 microversion: 2.1 time: 158.839778 Mar 08 15:26:04.609885 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: Tue Mar 8 15:26:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52/os-volume_attachments/67fc183b-4d10-4f71-9e5d-14819fc5becd (ip 10.222.0.30) !!! Mar 08 15:26:04.609885 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: Tue Mar 8 15:26:04 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52/os-volume_attachments/67fc183b-4d10-4f71-9e5d-14819fc5becd (10.222.0.30) Mar 08 15:26:04.610791 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: CRITICAL nova [None req-5ae2be2e-89b1-492a-a253-7ecaade05e65 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Unhandled error: OSError: write error Mar 08 15:26:04.610791 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: ERROR nova OSError: write error Mar 08 15:26:04.610791 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: ERROR nova Mar 08 15:26:04.610791 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1124/2465] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Mar 8 15:23:25 2022] DELETE /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52/os-volume_attachments/67fc183b-4d10-4f71-9e5d-14819fc5becd => generated 0 bytes in 158842 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Mar 08 15:26:05.211439 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-23c62838-ba02-4364-b710-eb1f2d11e9b5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:05.211969 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-23c62838-ba02-4364-b710-eb1f2d11e9b5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:05.218188 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-23c62838-ba02-4364-b710-eb1f2d11e9b5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:05.218643 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-23c62838-ba02-4364-b710-eb1f2d11e9b5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:05.219398 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-23c62838-ba02-4364-b710-eb1f2d11e9b5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:05.219828 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-23c62838-ba02-4364-b710-eb1f2d11e9b5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:05.233228 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-23c62838-ba02-4364-b710-eb1f2d11e9b5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] HTTP exception thrown: Instance 1b7917ad-8941-400f-ae66-d22e26633416 could not be found. Mar 08 15:26:05.233810 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-23c62838-ba02-4364-b710-eb1f2d11e9b5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Returning 404 to user: Instance 1b7917ad-8941-400f-ae66-d22e26633416 could not be found. {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:26:05.234632 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-23c62838-ba02-4364-b710-eb1f2d11e9b5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 404 len: 111 microversion: 2.20 time: 0.027245 Mar 08 15:26:05.235152 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1342/2466] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:26:05 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 08 15:26:05.245194 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-f76bec6c-5787-402e-adf8-36416c412e35 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '.version_select at 0x7ff35d1215e0>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:05.266229 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-f76bec6c-5787-402e-adf8-36416c412e35 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-292580592" status: 204 len: 0 microversion: 2.20 time: 0.026014 Mar 08 15:26:05.266792 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1125/2467] 10.222.0.30 () {60 vars in 1258 bytes} [Tue Mar 8 15:26:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-292580592 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 08 15:26:05.294838 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-4b23e283-fc95-42ea-8ff1-199d47b2ad75 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:05.295465 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-4b23e283-fc95-42ea-8ff1-199d47b2ad75 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] [instance: 251780d0-025f-4a29-b292-9a73dce671e6] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:05.302285 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4b23e283-fc95-42ea-8ff1-199d47b2ad75 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:05.302751 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4b23e283-fc95-42ea-8ff1-199d47b2ad75 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:05.303532 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4b23e283-fc95-42ea-8ff1-199d47b2ad75 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:05.303976 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4b23e283-fc95-42ea-8ff1-199d47b2ad75 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:05.317113 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-4b23e283-fc95-42ea-8ff1-199d47b2ad75 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] HTTP exception thrown: Instance 251780d0-025f-4a29-b292-9a73dce671e6 could not be found. Mar 08 15:26:05.317715 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-4b23e283-fc95-42ea-8ff1-199d47b2ad75 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Returning 404 to user: Instance 251780d0-025f-4a29-b292-9a73dce671e6 could not be found. {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:26:05.318570 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-4b23e283-fc95-42ea-8ff1-199d47b2ad75 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6" status: 404 len: 111 microversion: 2.1 time: 0.027724 Mar 08 15:26:05.319121 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1343/2468] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:26:05 2022] GET /compute/v2.1/servers/251780d0-025f-4a29-b292-9a73dce671e6 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 15:26:05.327443 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-accbef7d-6d08-4a3f-ae30-243da0011298 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] Calling method '.version_select at 0x7ff35d140040>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:05.344947 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-accbef7d-6d08-4a3f-ae30-243da0011298 tempest-TestMinimumBasicScenario-362374849 tempest-TestMinimumBasicScenario-362374849-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1407395641" status: 202 len: 0 microversion: 2.1 time: 0.021268 Mar 08 15:26:05.346131 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1126/2469] 10.222.0.30 () {58 vars in 1271 bytes} [Tue Mar 8 15:26:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1407395641 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 15:26:05.616627 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-7141e7c4-3c41-4f0a-ac5d-66483d3fd80f tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:05.617432 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-7141e7c4-3c41-4f0a-ac5d-66483d3fd80f tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: ecac51d1-33c3-49df-9926-d953f7315f52] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:05.623249 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7141e7c4-3c41-4f0a-ac5d-66483d3fd80f tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:05.623716 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7141e7c4-3c41-4f0a-ac5d-66483d3fd80f tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:05.624488 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7141e7c4-3c41-4f0a-ac5d-66483d3fd80f tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:05.624933 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7141e7c4-3c41-4f0a-ac5d-66483d3fd80f tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:05.650369 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-7141e7c4-3c41-4f0a-ac5d-66483d3fd80f tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: ecac51d1-33c3-49df-9926-d953f7315f52] Going to try to terminate instance {{(pid=128352) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 15:26:05.714734 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7141e7c4-3c41-4f0a-ac5d-66483d3fd80f tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [28206ef8-ab07-41ff-b989-b08f66460895] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 08 15:26:05.747516 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-c287905a-1bd0-47ae-a035-42e9c4be69f2 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:05.748035 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-c287905a-1bd0-47ae-a035-42e9c4be69f2 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:05.755921 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c287905a-1bd0-47ae-a035-42e9c4be69f2 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:05.756361 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c287905a-1bd0-47ae-a035-42e9c4be69f2 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:05.757493 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c287905a-1bd0-47ae-a035-42e9c4be69f2 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:05.757914 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c287905a-1bd0-47ae-a035-42e9c4be69f2 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:05.775173 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.wsgi [None req-c287905a-1bd0-47ae-a035-42e9c4be69f2 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] HTTP exception thrown: Instance 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 could not be found. Mar 08 15:26:05.775800 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-c287905a-1bd0-47ae-a035-42e9c4be69f2 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Returning 404 to user: Instance 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 could not be found. {{(pid=128351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:26:05.776719 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-c287905a-1bd0-47ae-a035-42e9c4be69f2 tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42" status: 404 len: 111 microversion: 2.1 time: 0.033074 Mar 08 15:26:05.777354 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1127/2470] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 15:26:05 2022] DELETE /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 15:26:05.785901 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-fc1ab06d-e66b-4d46-8ab7-0af8a17a565c tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:05.786620 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-fc1ab06d-e66b-4d46-8ab7-0af8a17a565c tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:05.792572 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fc1ab06d-e66b-4d46-8ab7-0af8a17a565c tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:05.793018 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fc1ab06d-e66b-4d46-8ab7-0af8a17a565c tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:05.794297 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fc1ab06d-e66b-4d46-8ab7-0af8a17a565c tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:05.794746 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fc1ab06d-e66b-4d46-8ab7-0af8a17a565c tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:05.809498 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.wsgi [None req-fc1ab06d-e66b-4d46-8ab7-0af8a17a565c tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] HTTP exception thrown: Instance 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 could not be found. Mar 08 15:26:05.810130 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-fc1ab06d-e66b-4d46-8ab7-0af8a17a565c tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Returning 404 to user: Instance 1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 could not be found. {{(pid=128351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:26:05.810972 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-fc1ab06d-e66b-4d46-8ab7-0af8a17a565c tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42" status: 404 len: 111 microversion: 2.1 time: 0.029469 Mar 08 15:26:05.811635 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1128/2471] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:26:05 2022] GET /compute/v2.1/servers/1ff78e7d-eb9f-4c2b-a8e4-e6d6b989fb42 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 15:26:06.060862 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-9ee760fb-027b-4cec-b6c8-652866926834 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Action: 'create', calling method: .version_select at 0x7ff361c601f0>, body: {"keypair": {"name": "tempest-keypair-794236627"}} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:26:06.076527 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.quota [None req-9ee760fb-027b-4cec-b6c8-652866926834 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Getting quotas for project 0cdd8e70c5dc4d1a8f531591dbd9216f. Resources: {'key_pairs'} {{(pid=128351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 15:26:06.081731 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.quota [None req-9ee760fb-027b-4cec-b6c8-652866926834 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Getting quotas for user 1775260bd3f947ea85d14b3a1aa80b38 and project 0cdd8e70c5dc4d1a8f531591dbd9216f. Resources: {'key_pairs'} {{(pid=128351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 15:26:06.199480 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.quota [None req-9ee760fb-027b-4cec-b6c8-652866926834 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Getting quotas for project 0cdd8e70c5dc4d1a8f531591dbd9216f. Resources: {'key_pairs'} {{(pid=128351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 15:26:06.204903 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.quota [None req-9ee760fb-027b-4cec-b6c8-652866926834 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Getting quotas for user 1775260bd3f947ea85d14b3a1aa80b38 and project 0cdd8e70c5dc4d1a8f531591dbd9216f. Resources: {'key_pairs'} {{(pid=128351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 15:26:06.223767 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-9ee760fb-027b-4cec-b6c8-652866926834 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.166764 Mar 08 15:26:06.225169 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1129/2472] 10.222.0.30 () {62 vars in 1198 bytes} [Tue Mar 8 15:26:06 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 169 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Mar 08 15:26:06.726197 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO oslo.messaging._drivers.impl_rabbit [None req-7141e7c4-3c41-4f0a-ac5d-66483d3fd80f tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [28206ef8-ab07-41ff-b989-b08f66460895] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 45870. Mar 08 15:26:06.753399 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-7141e7c4-3c41-4f0a-ac5d-66483d3fd80f tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52" status: 204 len: 0 microversion: 2.1 time: 1.140246 Mar 08 15:26:06.755276 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1344/2473] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 15:26:05 2022] DELETE /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52 => generated 0 bytes in 1143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 15:26:06.765256 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-9e1ef218-5d30-45a2-a9d6-e6ad97310253 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:06.765981 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-9e1ef218-5d30-45a2-a9d6-e6ad97310253 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: ecac51d1-33c3-49df-9926-d953f7315f52] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:06.773587 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9e1ef218-5d30-45a2-a9d6-e6ad97310253 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:06.774466 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9e1ef218-5d30-45a2-a9d6-e6ad97310253 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:06.775463 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9e1ef218-5d30-45a2-a9d6-e6ad97310253 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:06.776351 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9e1ef218-5d30-45a2-a9d6-e6ad97310253 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:06.972945 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-468cf13e-3c1e-4702-bf78-ddf2f6cb3afd tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:06.973535 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-468cf13e-3c1e-4702-bf78-ddf2f6cb3afd tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:06.980812 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-468cf13e-3c1e-4702-bf78-ddf2f6cb3afd tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:06.981505 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-468cf13e-3c1e-4702-bf78-ddf2f6cb3afd tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:06.982494 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-468cf13e-3c1e-4702-bf78-ddf2f6cb3afd tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:06.982924 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-468cf13e-3c1e-4702-bf78-ddf2f6cb3afd tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:07.014078 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-9e1ef218-5d30-45a2-a9d6-e6ad97310253 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d080fb7bd6049dea53fe1912d46b11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53fd1057c44dffb358b098d5f190fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:07.016186 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-468cf13e-3c1e-4702-bf78-ddf2f6cb3afd tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] HTTP exception thrown: Instance 04409dca-0761-4f98-b039-a620e2bef81e could not be found. Mar 08 15:26:07.016788 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-468cf13e-3c1e-4702-bf78-ddf2f6cb3afd tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Returning 404 to user: Instance 04409dca-0761-4f98-b039-a620e2bef81e could not be found. {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:26:07.018318 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-468cf13e-3c1e-4702-bf78-ddf2f6cb3afd tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "DELETE /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 404 len: 111 microversion: 2.1 time: 0.051898 Mar 08 15:26:07.020481 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1345/2474] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 15:26:06 2022] DELETE /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 08 15:26:07.024303 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-9e1ef218-5d30-45a2-a9d6-e6ad97310253 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "GET /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52" status: 200 len: 1514 microversion: 2.1 time: 0.264513 Mar 08 15:26:07.025128 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1130/2475] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:26:06 2022] GET /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52 => generated 1514 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:26:07.030745 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-16563f00-96e9-434c-b49e-c0ded05b30ce tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:07.031583 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-16563f00-96e9-434c-b49e-c0ded05b30ce tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] [instance: 04409dca-0761-4f98-b039-a620e2bef81e] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:07.040146 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-16563f00-96e9-434c-b49e-c0ded05b30ce tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:07.040899 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-16563f00-96e9-434c-b49e-c0ded05b30ce tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:07.041671 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-16563f00-96e9-434c-b49e-c0ded05b30ce tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:07.042158 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-16563f00-96e9-434c-b49e-c0ded05b30ce tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:07.056178 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-16563f00-96e9-434c-b49e-c0ded05b30ce tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] HTTP exception thrown: Instance 04409dca-0761-4f98-b039-a620e2bef81e could not be found. Mar 08 15:26:07.056779 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-16563f00-96e9-434c-b49e-c0ded05b30ce tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] Returning 404 to user: Instance 04409dca-0761-4f98-b039-a620e2bef81e could not be found. {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:26:07.057774 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-16563f00-96e9-434c-b49e-c0ded05b30ce tempest-AttachVolumeTestJSON-1356472191 tempest-AttachVolumeTestJSON-1356472191-project] 10.222.0.30 "GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e" status: 404 len: 111 microversion: 2.1 time: 0.033315 Mar 08 15:26:07.058349 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1346/2476] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:26:07 2022] GET /compute/v2.1/servers/04409dca-0761-4f98-b039-a620e2bef81e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 15:26:08.044029 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-a524c1c7-2732-4bc9-910b-e807af5743de tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:08.045268 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-a524c1c7-2732-4bc9-910b-e807af5743de tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: ecac51d1-33c3-49df-9926-d953f7315f52] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:08.053051 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a524c1c7-2732-4bc9-910b-e807af5743de tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:08.053502 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a524c1c7-2732-4bc9-910b-e807af5743de tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:08.054308 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a524c1c7-2732-4bc9-910b-e807af5743de tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:08.054744 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a524c1c7-2732-4bc9-910b-e807af5743de tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:08.318263 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-a524c1c7-2732-4bc9-910b-e807af5743de tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d080fb7bd6049dea53fe1912d46b11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53fd1057c44dffb358b098d5f190fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:08.331268 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-a524c1c7-2732-4bc9-910b-e807af5743de tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "GET /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52" status: 200 len: 1514 microversion: 2.1 time: 0.289984 Mar 08 15:26:08.346055 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1131/2477] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:26:08 2022] GET /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52 => generated 1514 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:26:08.781295 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [req-a0962b2e-513f-4f74-8e6e-e0d06594e346 req-ee612f67-4dd5-4f59-b02a-5a44e5495bf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecac51d1-33c3-49df-9926-d953f7315f52", "name": "network-vif-deleted", "tag": "d38e5f9e-ffa2-4f42-a867-9e00bb20973a"}]} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:26:08.791943 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-a0962b2e-513f-4f74-8e6e-e0d06594e346 req-ee612f67-4dd5-4f59-b02a-5a44e5495bf2 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:08.792724 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-a0962b2e-513f-4f74-8e6e-e0d06594e346 req-ee612f67-4dd5-4f59-b02a-5a44e5495bf2 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:08.807121 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.compute.server_external_events [req-a0962b2e-513f-4f74-8e6e-e0d06594e346 req-ee612f67-4dd5-4f59-b02a-5a44e5495bf2 service nova] Creating event network-vif-deleted:d38e5f9e-ffa2-4f42-a867-9e00bb20973a for instance ecac51d1-33c3-49df-9926-d953f7315f52 on hv-cinder-83009 Mar 08 15:26:08.812578 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [req-a0962b2e-513f-4f74-8e6e-e0d06594e346 req-ee612f67-4dd5-4f59-b02a-5a44e5495bf2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138001 Mar 08 15:26:08.813683 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1347/2478] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 15:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:26:08.975786 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-f7ce5a3a-3ef5-4fbf-80be-c494d30de948 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1554033901", "imageRef": "7541d53b-003d-4f1a-8d76-fc5f4bd8dabf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "749a78f8-dda5-4328-9019-a09684ba93ee"}], "security_groups": [{"name": "tempest-securitygroup--1237430412"}], "key_name": "tempest-keypair-794236627", "user_data": "}} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:26:09.143912 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.network.neutron [None req-f7ce5a3a-3ef5-4fbf-80be-c494d30de948 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] validate_networks() for [('749a78f8-dda5-4328-9019-a09684ba93ee', None, None, None, None, None)] {{(pid=128351) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 15:26:09.358891 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b45fef59-868b-4204-83ae-9a7d28b38a28 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:09.366285 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b45fef59-868b-4204-83ae-9a7d28b38a28 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: ecac51d1-33c3-49df-9926-d953f7315f52] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:09.374767 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b45fef59-868b-4204-83ae-9a7d28b38a28 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:09.375522 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b45fef59-868b-4204-83ae-9a7d28b38a28 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:09.376395 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b45fef59-868b-4204-83ae-9a7d28b38a28 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:09.377833 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b45fef59-868b-4204-83ae-9a7d28b38a28 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:09.502104 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b45fef59-868b-4204-83ae-9a7d28b38a28 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d080fb7bd6049dea53fe1912d46b11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53fd1057c44dffb358b098d5f190fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:09.517737 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b45fef59-868b-4204-83ae-9a7d28b38a28 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "GET /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52" status: 200 len: 1304 microversion: 2.1 time: 0.169448 Mar 08 15:26:09.518764 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1348/2479] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:26:09 2022] GET /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52 => generated 1304 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:26:10.006281 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-f7ce5a3a-3ef5-4fbf-80be-c494d30de948 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Flavor limits 0:0:0 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 15:26:10.006722 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-f7ce5a3a-3ef5-4fbf-80be-c494d30de948 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Image limits 0:0:0 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 15:26:10.007178 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-f7ce5a3a-3ef5-4fbf-80be-c494d30de948 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Flavor pref 0:0:0 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 15:26:10.007585 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-f7ce5a3a-3ef5-4fbf-80be-c494d30de948 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Image pref 0:0:0 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 15:26:10.007998 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-f7ce5a3a-3ef5-4fbf-80be-c494d30de948 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 15:26:10.020426 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f7ce5a3a-3ef5-4fbf-80be-c494d30de948 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:10.021234 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f7ce5a3a-3ef5-4fbf-80be-c494d30de948 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:10.022350 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f7ce5a3a-3ef5-4fbf-80be-c494d30de948 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:10.023031 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f7ce5a3a-3ef5-4fbf-80be-c494d30de948 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:10.045778 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.quota [None req-f7ce5a3a-3ef5-4fbf-80be-c494d30de948 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Getting quotas for project 0cdd8e70c5dc4d1a8f531591dbd9216f. Resources: {'instances', 'ram', 'cores'} {{(pid=128351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 15:26:10.050928 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.quota [None req-f7ce5a3a-3ef5-4fbf-80be-c494d30de948 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Getting quotas for user 1775260bd3f947ea85d14b3a1aa80b38 and project 0cdd8e70c5dc4d1a8f531591dbd9216f. Resources: {'instances', 'ram', 'cores'} {{(pid=128351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 15:26:10.065100 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-f7ce5a3a-3ef5-4fbf-80be-c494d30de948 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Going to run 1 instances... {{(pid=128351) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 15:26:10.067935 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-f7ce5a3a-3ef5-4fbf-80be-c494d30de948 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7541d53b-003d-4f1a-8d76-fc5f4bd8dabf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 15:26:10.164567 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-f7ce5a3a-3ef5-4fbf-80be-c494d30de948 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.191350 Mar 08 15:26:10.170490 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1132/2480] 10.222.0.30 () {62 vars in 1187 bytes} [Tue Mar 8 15:26:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 1199 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 08 15:26:10.179622 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3ac8bbed-4593-4992-a28e-1ae46c3ea530 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:10.180466 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-3ac8bbed-4593-4992-a28e-1ae46c3ea530 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:10.544982 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-9379f582-4607-440e-9b6d-ae8ce4f6109f tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:10.546337 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-9379f582-4607-440e-9b6d-ae8ce4f6109f tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: ecac51d1-33c3-49df-9926-d953f7315f52] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:10.567624 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9379f582-4607-440e-9b6d-ae8ce4f6109f tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:10.568083 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9379f582-4607-440e-9b6d-ae8ce4f6109f tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:10.568881 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9379f582-4607-440e-9b6d-ae8ce4f6109f tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:10.569322 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9379f582-4607-440e-9b6d-ae8ce4f6109f tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:10.754204 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-9379f582-4607-440e-9b6d-ae8ce4f6109f tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d080fb7bd6049dea53fe1912d46b11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d53fd1057c44dffb358b098d5f190fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:10.764659 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-9379f582-4607-440e-9b6d-ae8ce4f6109f tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "GET /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52" status: 200 len: 1304 microversion: 2.1 time: 0.231369 Mar 08 15:26:10.766440 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1133/2481] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:26:10 2022] GET /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52 => generated 1304 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:26:10.788427 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-3ac8bbed-4593-4992-a28e-1ae46c3ea530 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:10.796150 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-3ac8bbed-4593-4992-a28e-1ae46c3ea530 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:10.797665 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-3ac8bbed-4593-4992-a28e-1ae46c3ea530 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:10.799411 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-3ac8bbed-4593-4992-a28e-1ae46c3ea530 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1281 microversion: 2.20 time: 0.623236 Mar 08 15:26:10.811053 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1349/2482] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:26:10 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1281 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:26:11.782836 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-f8a17641-f8b5-4243-9685-3084f606e442 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:11.784003 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-f8a17641-f8b5-4243-9685-3084f606e442 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] [instance: ecac51d1-33c3-49df-9926-d953f7315f52] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:11.793213 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f8a17641-f8b5-4243-9685-3084f606e442 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:11.803633 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f8a17641-f8b5-4243-9685-3084f606e442 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:11.804577 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f8a17641-f8b5-4243-9685-3084f606e442 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:11.805024 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f8a17641-f8b5-4243-9685-3084f606e442 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:11.816921 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-0290d75f-2366-451c-935c-da252bd7d45a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:11.817533 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-0290d75f-2366-451c-935c-da252bd7d45a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:11.830608 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0290d75f-2366-451c-935c-da252bd7d45a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:11.832064 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.wsgi [None req-f8a17641-f8b5-4243-9685-3084f606e442 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] HTTP exception thrown: Instance ecac51d1-33c3-49df-9926-d953f7315f52 could not be found. Mar 08 15:26:11.832864 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-f8a17641-f8b5-4243-9685-3084f606e442 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] Returning 404 to user: Instance ecac51d1-33c3-49df-9926-d953f7315f52 could not be found. {{(pid=128351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:26:11.833885 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-f8a17641-f8b5-4243-9685-3084f606e442 tempest-VolumesSnapshotTestJSON-1316349888 tempest-VolumesSnapshotTestJSON-1316349888-project] 10.222.0.30 "GET /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52" status: 404 len: 111 microversion: 2.1 time: 0.055257 Mar 08 15:26:11.836410 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0290d75f-2366-451c-935c-da252bd7d45a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:11.837238 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0290d75f-2366-451c-935c-da252bd7d45a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:11.837811 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-0290d75f-2366-451c-935c-da252bd7d45a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:11.840151 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1134/2483] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:26:11 2022] GET /compute/v2.1/servers/ecac51d1-33c3-49df-9926-d953f7315f52 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 15:26:12.069654 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-0290d75f-2366-451c-935c-da252bd7d45a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:12.084946 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-0290d75f-2366-451c-935c-da252bd7d45a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:12.087472 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-0290d75f-2366-451c-935c-da252bd7d45a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:12.089396 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-0290d75f-2366-451c-935c-da252bd7d45a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1351 microversion: 2.20 time: 0.276766 Mar 08 15:26:12.089995 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1350/2484] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:26:11 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1351 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:26:13.113189 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-406ebb02-2b1c-417b-953c-f54e32355267 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:13.113808 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-406ebb02-2b1c-417b-953c-f54e32355267 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:13.123580 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-406ebb02-2b1c-417b-953c-f54e32355267 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:13.124025 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-406ebb02-2b1c-417b-953c-f54e32355267 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:13.127844 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-406ebb02-2b1c-417b-953c-f54e32355267 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:13.129565 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-406ebb02-2b1c-417b-953c-f54e32355267 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:13.706696 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-406ebb02-2b1c-417b-953c-f54e32355267 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:13.727011 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-406ebb02-2b1c-417b-953c-f54e32355267 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:13.729034 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-406ebb02-2b1c-417b-953c-f54e32355267 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:13.731490 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-406ebb02-2b1c-417b-953c-f54e32355267 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1407 microversion: 2.20 time: 0.622540 Mar 08 15:26:13.741944 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1135/2485] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:26:13 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1407 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:26:14.005251 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [req-a6de3c57-a148-41cb-b040-397acff0c1d7 req-2d9358aa-db69-49c1-8ca1-f95028cd2120 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c051cc3d-ac34-4fe1-8b55-010166d2cb64", "tag": "7068a3ed-1414-4ab7-8c70-a96a7135062c"}]} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:26:14.017607 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-a6de3c57-a148-41cb-b040-397acff0c1d7 req-2d9358aa-db69-49c1-8ca1-f95028cd2120 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:14.019015 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-a6de3c57-a148-41cb-b040-397acff0c1d7 req-2d9358aa-db69-49c1-8ca1-f95028cd2120 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:14.070375 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.compute.server_external_events [req-a6de3c57-a148-41cb-b040-397acff0c1d7 req-2d9358aa-db69-49c1-8ca1-f95028cd2120 service nova] Creating event network-changed:7068a3ed-1414-4ab7-8c70-a96a7135062c for instance c051cc3d-ac34-4fe1-8b55-010166d2cb64 on hv-cinder-83009 Mar 08 15:26:14.078831 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [req-a6de3c57-a148-41cb-b040-397acff0c1d7 req-2d9358aa-db69-49c1-8ca1-f95028cd2120 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078058 Mar 08 15:26:14.085131 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1351/2486] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 15:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:26:14.750056 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-3b117964-61ad-4a8d-9c2b-c669a34c9956 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:14.750760 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-3b117964-61ad-4a8d-9c2b-c669a34c9956 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:14.757269 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3b117964-61ad-4a8d-9c2b-c669a34c9956 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:14.757808 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3b117964-61ad-4a8d-9c2b-c669a34c9956 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:14.758625 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3b117964-61ad-4a8d-9c2b-c669a34c9956 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:14.759066 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3b117964-61ad-4a8d-9c2b-c669a34c9956 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:15.239842 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-3b117964-61ad-4a8d-9c2b-c669a34c9956 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:15.248097 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-3b117964-61ad-4a8d-9c2b-c669a34c9956 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:15.249906 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-3b117964-61ad-4a8d-9c2b-c669a34c9956 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:15.251115 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-3b117964-61ad-4a8d-9c2b-c669a34c9956 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1407 microversion: 2.20 time: 0.505379 Mar 08 15:26:15.252299 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1136/2487] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:26:14 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1407 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:26:16.272393 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-74a666a0-e624-4783-9d33-c660705947ae tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:16.274282 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-74a666a0-e624-4783-9d33-c660705947ae tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:16.286676 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-74a666a0-e624-4783-9d33-c660705947ae tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:16.287776 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-74a666a0-e624-4783-9d33-c660705947ae tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:16.288683 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-74a666a0-e624-4783-9d33-c660705947ae tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:16.289343 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-74a666a0-e624-4783-9d33-c660705947ae tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:16.518357 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-74a666a0-e624-4783-9d33-c660705947ae tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:16.527457 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-74a666a0-e624-4783-9d33-c660705947ae tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:16.529406 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-74a666a0-e624-4783-9d33-c660705947ae tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:16.531669 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-74a666a0-e624-4783-9d33-c660705947ae tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1407 microversion: 2.20 time: 0.264938 Mar 08 15:26:16.542981 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1352/2488] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:26:16 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1407 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:26:17.550627 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-2c6eef5e-535f-4d31-b1d2-d04fe783bcc9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:17.551870 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-2c6eef5e-535f-4d31-b1d2-d04fe783bcc9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:17.568765 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2c6eef5e-535f-4d31-b1d2-d04fe783bcc9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:17.569491 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2c6eef5e-535f-4d31-b1d2-d04fe783bcc9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:17.570521 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2c6eef5e-535f-4d31-b1d2-d04fe783bcc9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:17.571157 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2c6eef5e-535f-4d31-b1d2-d04fe783bcc9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:17.845017 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-2c6eef5e-535f-4d31-b1d2-d04fe783bcc9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:17.852967 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-2c6eef5e-535f-4d31-b1d2-d04fe783bcc9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:17.854517 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-2c6eef5e-535f-4d31-b1d2-d04fe783bcc9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:17.855625 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-2c6eef5e-535f-4d31-b1d2-d04fe783bcc9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1407 microversion: 2.20 time: 0.309601 Mar 08 15:26:17.875697 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1137/2489] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:26:17 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1407 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:26:18.873570 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d4893baf-0014-42b0-9681-4d6fbe8e37ee tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:18.874323 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d4893baf-0014-42b0-9681-4d6fbe8e37ee tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:18.885316 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d4893baf-0014-42b0-9681-4d6fbe8e37ee tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:18.886159 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d4893baf-0014-42b0-9681-4d6fbe8e37ee tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:18.888733 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d4893baf-0014-42b0-9681-4d6fbe8e37ee tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:18.889383 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d4893baf-0014-42b0-9681-4d6fbe8e37ee tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:19.629642 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d4893baf-0014-42b0-9681-4d6fbe8e37ee tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:19.640756 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d4893baf-0014-42b0-9681-4d6fbe8e37ee tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:19.643249 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d4893baf-0014-42b0-9681-4d6fbe8e37ee tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:19.644736 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d4893baf-0014-42b0-9681-4d6fbe8e37ee tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1407 microversion: 2.20 time: 0.775213 Mar 08 15:26:19.656785 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1353/2490] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:26:18 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1407 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:26:20.665095 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-1372d4fd-a124-4fb8-9118-e1b47268a1ff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:20.668551 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-1372d4fd-a124-4fb8-9118-e1b47268a1ff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:20.683929 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1372d4fd-a124-4fb8-9118-e1b47268a1ff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:20.684836 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1372d4fd-a124-4fb8-9118-e1b47268a1ff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:20.686629 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1372d4fd-a124-4fb8-9118-e1b47268a1ff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:20.688047 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-1372d4fd-a124-4fb8-9118-e1b47268a1ff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:20.949107 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-1372d4fd-a124-4fb8-9118-e1b47268a1ff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:20.967617 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-1372d4fd-a124-4fb8-9118-e1b47268a1ff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:20.972025 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-1372d4fd-a124-4fb8-9118-e1b47268a1ff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:20.974132 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-1372d4fd-a124-4fb8-9118-e1b47268a1ff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1407 microversion: 2.20 time: 0.313137 Mar 08 15:26:20.975212 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1138/2491] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:26:20 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1407 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:26:20.987741 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 15:26:20.988524 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: Tue Mar 8 15:26:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 15:26:21.652911 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-67d0c7f2-63ff-4c11-80af-36ec74424763 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Action: 'create', calling method: .version_select at 0x7ff35d09aaf0>, body: {"keypair": {"name": "tempest-keypair-1015656366"}} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:26:21.659343 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [req-7bfd8ef0-1302-4e7c-96eb-2e8f67932f69 req-9603930e-ad74-41b8-933f-399a0e6a68c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c051cc3d-ac34-4fe1-8b55-010166d2cb64", "name": "network-vif-plugged", "status": "completed", "tag": "7068a3ed-1414-4ab7-8c70-a96a7135062c"}]} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:26:21.671472 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-7bfd8ef0-1302-4e7c-96eb-2e8f67932f69 req-9603930e-ad74-41b8-933f-399a0e6a68c8 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:21.672731 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-7bfd8ef0-1302-4e7c-96eb-2e8f67932f69 req-9603930e-ad74-41b8-933f-399a0e6a68c8 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:21.678327 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.quota [None req-67d0c7f2-63ff-4c11-80af-36ec74424763 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Getting quotas for project e4bf1dc206f041ca91a40149aab30dee. Resources: {'key_pairs'} {{(pid=128352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 15:26:21.682622 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.quota [None req-67d0c7f2-63ff-4c11-80af-36ec74424763 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Getting quotas for user 282b16dbcb1648c39afa0f7ed2d5dbda and project e4bf1dc206f041ca91a40149aab30dee. Resources: {'key_pairs'} {{(pid=128352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 15:26:21.684324 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.compute.server_external_events [req-7bfd8ef0-1302-4e7c-96eb-2e8f67932f69 req-9603930e-ad74-41b8-933f-399a0e6a68c8 service nova] Creating event network-vif-plugged:7068a3ed-1414-4ab7-8c70-a96a7135062c for instance c051cc3d-ac34-4fe1-8b55-010166d2cb64 on hv-cinder-83009 Mar 08 15:26:21.687628 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: ERROR oslo.messaging._drivers.impl_rabbit [req-7bfd8ef0-1302-4e7c-96eb-2e8f67932f69 req-9603930e-ad74-41b8-933f-399a0e6a68c8 service nova] [191e1baa-5623-4958-a32e-7027860d8783] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 08 15:26:21.894917 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.quota [None req-67d0c7f2-63ff-4c11-80af-36ec74424763 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Getting quotas for project e4bf1dc206f041ca91a40149aab30dee. Resources: {'key_pairs'} {{(pid=128352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 15:26:21.898440 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.quota [None req-67d0c7f2-63ff-4c11-80af-36ec74424763 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Getting quotas for user 282b16dbcb1648c39afa0f7ed2d5dbda and project e4bf1dc206f041ca91a40149aab30dee. Resources: {'key_pairs'} {{(pid=128352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 15:26:21.911444 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-67d0c7f2-63ff-4c11-80af-36ec74424763 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.517589 Mar 08 15:26:21.912026 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1354/2492] 10.222.0.30 () {60 vars in 1157 bytes} [Tue Mar 8 15:26:21 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:26:21.992309 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-89eec13e-43b8-4361-8699-587659c08c08 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:21.992930 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-89eec13e-43b8-4361-8699-587659c08c08 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:21.999142 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-89eec13e-43b8-4361-8699-587659c08c08 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:21.999591 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-89eec13e-43b8-4361-8699-587659c08c08 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:22.000863 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-89eec13e-43b8-4361-8699-587659c08c08 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:22.001830 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-89eec13e-43b8-4361-8699-587659c08c08 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:22.195339 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-89eec13e-43b8-4361-8699-587659c08c08 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:22.203990 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-89eec13e-43b8-4361-8699-587659c08c08 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:22.206253 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-89eec13e-43b8-4361-8699-587659c08c08 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:22.207571 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-89eec13e-43b8-4361-8699-587659c08c08 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1407 microversion: 2.20 time: 0.219176 Mar 08 15:26:22.218778 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1355/2493] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:26:21 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:26:22.696328 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO oslo.messaging._drivers.impl_rabbit [req-7bfd8ef0-1302-4e7c-96eb-2e8f67932f69 req-9603930e-ad74-41b8-933f-399a0e6a68c8 service nova] [191e1baa-5623-4958-a32e-7027860d8783] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 46238. Mar 08 15:26:22.701002 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [req-7bfd8ef0-1302-4e7c-96eb-2e8f67932f69 req-9603930e-ad74-41b8-933f-399a0e6a68c8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.221025 Mar 08 15:26:22.702020 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1139/2494] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 15:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:26:23.226831 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-cab24f4a-7982-4596-bfdb-6aa7c627fa5f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:23.228148 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-cab24f4a-7982-4596-bfdb-6aa7c627fa5f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:23.234808 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cab24f4a-7982-4596-bfdb-6aa7c627fa5f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:23.235591 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cab24f4a-7982-4596-bfdb-6aa7c627fa5f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:23.236686 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cab24f4a-7982-4596-bfdb-6aa7c627fa5f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:23.237375 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cab24f4a-7982-4596-bfdb-6aa7c627fa5f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:23.447197 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-cab24f4a-7982-4596-bfdb-6aa7c627fa5f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:23.460614 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-cab24f4a-7982-4596-bfdb-6aa7c627fa5f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:23.462184 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-cab24f4a-7982-4596-bfdb-6aa7c627fa5f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:23.463321 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-cab24f4a-7982-4596-bfdb-6aa7c627fa5f tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1407 microversion: 2.20 time: 0.240413 Mar 08 15:26:23.463875 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1356/2495] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:26:23 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1407 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:26:23.561386 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b1b2b3ca-8704-4ecb-a707-10c50ee5b913 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1559466606", "imageRef": "7541d53b-003d-4f1a-8d76-fc5f4bd8dabf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fd27055d-8ae6-4d4d-a095-42195ed67196"}], "security_groups": [{"name": "tempest-securitygroup--861431178"}], "key_name": "tempest-keypair-1015656366", "user_data": "}} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:26:23.681453 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.network.neutron [None req-b1b2b3ca-8704-4ecb-a707-10c50ee5b913 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] validate_networks() for [('fd27055d-8ae6-4d4d-a095-42195ed67196', None, None, None, None, None)] {{(pid=128351) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 15:26:24.076304 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-b1b2b3ca-8704-4ecb-a707-10c50ee5b913 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Flavor limits 0:0:0 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 15:26:24.076921 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-b1b2b3ca-8704-4ecb-a707-10c50ee5b913 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Image limits 0:0:0 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 15:26:24.077230 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-b1b2b3ca-8704-4ecb-a707-10c50ee5b913 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Flavor pref 0:0:0 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 15:26:24.077651 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-b1b2b3ca-8704-4ecb-a707-10c50ee5b913 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Image pref 0:0:0 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 15:26:24.078094 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-b1b2b3ca-8704-4ecb-a707-10c50ee5b913 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 15:26:24.088185 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b1b2b3ca-8704-4ecb-a707-10c50ee5b913 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:24.088613 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b1b2b3ca-8704-4ecb-a707-10c50ee5b913 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:24.089410 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b1b2b3ca-8704-4ecb-a707-10c50ee5b913 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:24.089846 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b1b2b3ca-8704-4ecb-a707-10c50ee5b913 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:24.107723 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.quota [None req-b1b2b3ca-8704-4ecb-a707-10c50ee5b913 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Getting quotas for project e4bf1dc206f041ca91a40149aab30dee. Resources: {'instances', 'ram', 'cores'} {{(pid=128351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 15:26:24.113197 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.quota [None req-b1b2b3ca-8704-4ecb-a707-10c50ee5b913 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Getting quotas for user 282b16dbcb1648c39afa0f7ed2d5dbda and project e4bf1dc206f041ca91a40149aab30dee. Resources: {'instances', 'ram', 'cores'} {{(pid=128351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 15:26:24.141992 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-b1b2b3ca-8704-4ecb-a707-10c50ee5b913 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Going to run 1 instances... {{(pid=128351) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 15:26:24.145115 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-b1b2b3ca-8704-4ecb-a707-10c50ee5b913 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 56ade7e6-35ae-4f5b-81ff-9221d246720c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7541d53b-003d-4f1a-8d76-fc5f4bd8dabf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 15:26:24.205518 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-b1b2b3ca-8704-4ecb-a707-10c50ee5b913 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.649451 Mar 08 15:26:24.206566 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1140/2496] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Mar 8 15:26:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 15:26:24.216365 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-18031781-b33c-4b42-a729-396ccb27cc0a tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:24.217491 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-18031781-b33c-4b42-a729-396ccb27cc0a tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 56ade7e6-35ae-4f5b-81ff-9221d246720c] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:24.279294 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-18031781-b33c-4b42-a729-396ccb27cc0a tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282b16dbcb1648c39afa0f7ed2d5dbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf1dc206f041ca91a40149aab30dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:24.287726 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-18031781-b33c-4b42-a729-396ccb27cc0a tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/56ade7e6-35ae-4f5b-81ff-9221d246720c" status: 200 len: 1242 microversion: 2.1 time: 0.075501 Mar 08 15:26:24.289305 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1357/2497] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:26:24 2022] GET /compute/v2.1/servers/56ade7e6-35ae-4f5b-81ff-9221d246720c => generated 1242 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:26:24.482509 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-5916ea08-240c-44aa-a27e-6fdff2a18ebd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:24.483601 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-5916ea08-240c-44aa-a27e-6fdff2a18ebd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:24.503530 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5916ea08-240c-44aa-a27e-6fdff2a18ebd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:24.504197 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5916ea08-240c-44aa-a27e-6fdff2a18ebd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:24.504827 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5916ea08-240c-44aa-a27e-6fdff2a18ebd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:24.505271 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-5916ea08-240c-44aa-a27e-6fdff2a18ebd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:24.727049 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-5916ea08-240c-44aa-a27e-6fdff2a18ebd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:24.734972 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-5916ea08-240c-44aa-a27e-6fdff2a18ebd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:24.737040 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-5916ea08-240c-44aa-a27e-6fdff2a18ebd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:24.738546 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-5916ea08-240c-44aa-a27e-6fdff2a18ebd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1407 microversion: 2.20 time: 0.260539 Mar 08 15:26:24.739112 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1141/2498] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:26:24 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1407 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:26:25.304613 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-7e746274-ded4-4b4d-86fb-b5e7f529218c tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:25.305226 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-7e746274-ded4-4b4d-86fb-b5e7f529218c tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 56ade7e6-35ae-4f5b-81ff-9221d246720c] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:25.312414 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7e746274-ded4-4b4d-86fb-b5e7f529218c tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:25.312869 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7e746274-ded4-4b4d-86fb-b5e7f529218c tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:25.313635 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7e746274-ded4-4b4d-86fb-b5e7f529218c tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:25.314182 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-7e746274-ded4-4b4d-86fb-b5e7f529218c tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:25.372631 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-7e746274-ded4-4b4d-86fb-b5e7f529218c tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282b16dbcb1648c39afa0f7ed2d5dbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf1dc206f041ca91a40149aab30dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:25.380258 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-7e746274-ded4-4b4d-86fb-b5e7f529218c tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/56ade7e6-35ae-4f5b-81ff-9221d246720c" status: 200 len: 1246 microversion: 2.1 time: 0.079521 Mar 08 15:26:25.380821 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1358/2499] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:26:25 2022] GET /compute/v2.1/servers/56ade7e6-35ae-4f5b-81ff-9221d246720c => generated 1246 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:26:25.757437 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-102b04c4-ab03-41cf-b326-6072e6bf1150 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:25.758642 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-102b04c4-ab03-41cf-b326-6072e6bf1150 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:25.765169 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-102b04c4-ab03-41cf-b326-6072e6bf1150 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:25.765493 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-102b04c4-ab03-41cf-b326-6072e6bf1150 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:25.775906 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-102b04c4-ab03-41cf-b326-6072e6bf1150 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:25.775906 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-102b04c4-ab03-41cf-b326-6072e6bf1150 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:25.912798 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-102b04c4-ab03-41cf-b326-6072e6bf1150 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:25.920474 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-102b04c4-ab03-41cf-b326-6072e6bf1150 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:25.922078 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-102b04c4-ab03-41cf-b326-6072e6bf1150 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:25.923649 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-102b04c4-ab03-41cf-b326-6072e6bf1150 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1407 microversion: 2.20 time: 0.170187 Mar 08 15:26:25.924194 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1142/2500] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:26:25 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:26:26.397578 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3f78c4bf-f64f-403d-9533-a51009323791 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:26.398813 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-3f78c4bf-f64f-403d-9533-a51009323791 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 56ade7e6-35ae-4f5b-81ff-9221d246720c] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:26.406057 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3f78c4bf-f64f-403d-9533-a51009323791 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:26.406659 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3f78c4bf-f64f-403d-9533-a51009323791 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:26.407346 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3f78c4bf-f64f-403d-9533-a51009323791 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:26.407732 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3f78c4bf-f64f-403d-9533-a51009323791 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:26.481839 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-3f78c4bf-f64f-403d-9533-a51009323791 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282b16dbcb1648c39afa0f7ed2d5dbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf1dc206f041ca91a40149aab30dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:26.490635 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-3f78c4bf-f64f-403d-9533-a51009323791 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/56ade7e6-35ae-4f5b-81ff-9221d246720c" status: 200 len: 1300 microversion: 2.1 time: 0.096936 Mar 08 15:26:26.494773 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1359/2501] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:26:26 2022] GET /compute/v2.1/servers/56ade7e6-35ae-4f5b-81ff-9221d246720c => generated 1300 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:26:26.957669 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-af355591-f24e-4b5f-8d01-8623a96b058b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:26.960771 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-af355591-f24e-4b5f-8d01-8623a96b058b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:26.971277 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-af355591-f24e-4b5f-8d01-8623a96b058b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:26.972089 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-af355591-f24e-4b5f-8d01-8623a96b058b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:26.973389 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-af355591-f24e-4b5f-8d01-8623a96b058b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:26.974077 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-af355591-f24e-4b5f-8d01-8623a96b058b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:27.183053 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-af355591-f24e-4b5f-8d01-8623a96b058b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:27.202011 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-af355591-f24e-4b5f-8d01-8623a96b058b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:27.203633 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-af355591-f24e-4b5f-8d01-8623a96b058b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:27.205215 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-af355591-f24e-4b5f-8d01-8623a96b058b tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1599 microversion: 2.20 time: 0.262256 Mar 08 15:26:27.206183 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1143/2502] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:26:26 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1599 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:26:27.225740 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-48029cba-776d-4a29-9d03-7051990b2c0a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:27.226361 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-48029cba-776d-4a29-9d03-7051990b2c0a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:27.232351 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-48029cba-776d-4a29-9d03-7051990b2c0a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:27.232883 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-48029cba-776d-4a29-9d03-7051990b2c0a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:27.233906 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-48029cba-776d-4a29-9d03-7051990b2c0a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:27.234360 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-48029cba-776d-4a29-9d03-7051990b2c0a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:27.413074 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-48029cba-776d-4a29-9d03-7051990b2c0a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.193178 Mar 08 15:26:27.428745 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1360/2503] 10.222.0.30 () {60 vars in 1315 bytes} [Tue Mar 8 15:26:27 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64/os-interface => generated 284 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:26:27.509953 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-d1384691-7b86-42fc-9bd0-ba3d72fc734a tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:27.510939 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-d1384691-7b86-42fc-9bd0-ba3d72fc734a tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 56ade7e6-35ae-4f5b-81ff-9221d246720c] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:27.517077 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d1384691-7b86-42fc-9bd0-ba3d72fc734a tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:27.517744 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d1384691-7b86-42fc-9bd0-ba3d72fc734a tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:27.518922 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d1384691-7b86-42fc-9bd0-ba3d72fc734a tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:27.519369 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d1384691-7b86-42fc-9bd0-ba3d72fc734a tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:27.784459 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-d1384691-7b86-42fc-9bd0-ba3d72fc734a tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282b16dbcb1648c39afa0f7ed2d5dbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf1dc206f041ca91a40149aab30dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:27.794185 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-d1384691-7b86-42fc-9bd0-ba3d72fc734a tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/56ade7e6-35ae-4f5b-81ff-9221d246720c" status: 200 len: 1367 microversion: 2.1 time: 0.288621 Mar 08 15:26:27.806069 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1144/2504] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:26:27 2022] GET /compute/v2.1/servers/56ade7e6-35ae-4f5b-81ff-9221d246720c => generated 1367 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:26:27.865487 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [req-a7027a52-1d51-496e-935b-34dd088beae2 req-d628e87e-50a0-40b7-b42f-be8020e0bae4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56ade7e6-35ae-4f5b-81ff-9221d246720c", "tag": "30e29d09-ca25-468f-80d0-324480c29ab1"}]} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:26:27.898024 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-a7027a52-1d51-496e-935b-34dd088beae2 req-d628e87e-50a0-40b7-b42f-be8020e0bae4 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:27.898457 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-a7027a52-1d51-496e-935b-34dd088beae2 req-d628e87e-50a0-40b7-b42f-be8020e0bae4 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:27.918389 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.compute.server_external_events [req-a7027a52-1d51-496e-935b-34dd088beae2 req-d628e87e-50a0-40b7-b42f-be8020e0bae4 service nova] Creating event network-changed:30e29d09-ca25-468f-80d0-324480c29ab1 for instance 56ade7e6-35ae-4f5b-81ff-9221d246720c on hv-cinder-83009 Mar 08 15:26:27.925350 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [req-a7027a52-1d51-496e-935b-34dd088beae2 req-d628e87e-50a0-40b7-b42f-be8020e0bae4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064271 Mar 08 15:26:27.926468 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1361/2505] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 15:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:26:28.812832 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-0d300ba4-4aa1-4cae-8b08-61e530c2f4eb tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:28.814133 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-0d300ba4-4aa1-4cae-8b08-61e530c2f4eb tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 56ade7e6-35ae-4f5b-81ff-9221d246720c] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:28.821560 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0d300ba4-4aa1-4cae-8b08-61e530c2f4eb tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:28.822062 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0d300ba4-4aa1-4cae-8b08-61e530c2f4eb tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:28.823028 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0d300ba4-4aa1-4cae-8b08-61e530c2f4eb tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:28.823693 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0d300ba4-4aa1-4cae-8b08-61e530c2f4eb tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:29.021037 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-0d300ba4-4aa1-4cae-8b08-61e530c2f4eb tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282b16dbcb1648c39afa0f7ed2d5dbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf1dc206f041ca91a40149aab30dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:29.029355 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-0d300ba4-4aa1-4cae-8b08-61e530c2f4eb tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/56ade7e6-35ae-4f5b-81ff-9221d246720c" status: 200 len: 1367 microversion: 2.1 time: 0.220509 Mar 08 15:26:29.030317 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1145/2506] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:26:28 2022] GET /compute/v2.1/servers/56ade7e6-35ae-4f5b-81ff-9221d246720c => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:26:29.093701 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [req-1fb7eab9-ac1d-426b-b3f7-d9ca0b3dbc62 req-f11eb691-0f02-4eae-a4f5-9d5ed62620bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c051cc3d-ac34-4fe1-8b55-010166d2cb64", "tag": "7068a3ed-1414-4ab7-8c70-a96a7135062c"}]} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:26:29.102380 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-1fb7eab9-ac1d-426b-b3f7-d9ca0b3dbc62 req-f11eb691-0f02-4eae-a4f5-9d5ed62620bf service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:29.103035 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-1fb7eab9-ac1d-426b-b3f7-d9ca0b3dbc62 req-f11eb691-0f02-4eae-a4f5-9d5ed62620bf service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:29.113595 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.compute.server_external_events [req-1fb7eab9-ac1d-426b-b3f7-d9ca0b3dbc62 req-f11eb691-0f02-4eae-a4f5-9d5ed62620bf service nova] Creating event network-changed:7068a3ed-1414-4ab7-8c70-a96a7135062c for instance c051cc3d-ac34-4fe1-8b55-010166d2cb64 on hv-cinder-83009 Mar 08 15:26:29.118440 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [req-1fb7eab9-ac1d-426b-b3f7-d9ca0b3dbc62 req-f11eb691-0f02-4eae-a4f5-9d5ed62620bf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155840 Mar 08 15:26:29.119023 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1362/2507] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 15:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:26:30.047325 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-4dd7ef25-09bf-4f78-94dc-e3ea1ab447dd tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:30.049250 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-4dd7ef25-09bf-4f78-94dc-e3ea1ab447dd tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 56ade7e6-35ae-4f5b-81ff-9221d246720c] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:30.055861 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4dd7ef25-09bf-4f78-94dc-e3ea1ab447dd tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:30.056545 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4dd7ef25-09bf-4f78-94dc-e3ea1ab447dd tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:30.057333 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4dd7ef25-09bf-4f78-94dc-e3ea1ab447dd tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:30.057778 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4dd7ef25-09bf-4f78-94dc-e3ea1ab447dd tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:30.277509 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-4dd7ef25-09bf-4f78-94dc-e3ea1ab447dd tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282b16dbcb1648c39afa0f7ed2d5dbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf1dc206f041ca91a40149aab30dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:30.285716 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-4dd7ef25-09bf-4f78-94dc-e3ea1ab447dd tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/56ade7e6-35ae-4f5b-81ff-9221d246720c" status: 200 len: 1367 microversion: 2.1 time: 0.242170 Mar 08 15:26:30.286320 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1146/2508] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:26:30 2022] GET /compute/v2.1/servers/56ade7e6-35ae-4f5b-81ff-9221d246720c => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:26:31.304367 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-07950ad8-cd44-4d79-9e56-c5f726c80db1 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:31.305160 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-07950ad8-cd44-4d79-9e56-c5f726c80db1 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 56ade7e6-35ae-4f5b-81ff-9221d246720c] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:31.311211 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-07950ad8-cd44-4d79-9e56-c5f726c80db1 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:31.311740 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-07950ad8-cd44-4d79-9e56-c5f726c80db1 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:31.312544 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-07950ad8-cd44-4d79-9e56-c5f726c80db1 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:31.312981 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-07950ad8-cd44-4d79-9e56-c5f726c80db1 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:31.461415 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-07950ad8-cd44-4d79-9e56-c5f726c80db1 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282b16dbcb1648c39afa0f7ed2d5dbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf1dc206f041ca91a40149aab30dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:31.471525 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-07950ad8-cd44-4d79-9e56-c5f726c80db1 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/56ade7e6-35ae-4f5b-81ff-9221d246720c" status: 200 len: 1367 microversion: 2.1 time: 0.171931 Mar 08 15:26:31.472312 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1363/2509] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:26:31 2022] GET /compute/v2.1/servers/56ade7e6-35ae-4f5b-81ff-9221d246720c => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:26:32.487897 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-33f0255a-9ed8-4f5c-be87-4fcf20365fa1 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:32.488523 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-33f0255a-9ed8-4f5c-be87-4fcf20365fa1 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 56ade7e6-35ae-4f5b-81ff-9221d246720c] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:32.495040 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-33f0255a-9ed8-4f5c-be87-4fcf20365fa1 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:32.495505 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-33f0255a-9ed8-4f5c-be87-4fcf20365fa1 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:32.496290 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-33f0255a-9ed8-4f5c-be87-4fcf20365fa1 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:32.496740 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-33f0255a-9ed8-4f5c-be87-4fcf20365fa1 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:32.631075 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-33f0255a-9ed8-4f5c-be87-4fcf20365fa1 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282b16dbcb1648c39afa0f7ed2d5dbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf1dc206f041ca91a40149aab30dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:32.638221 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-33f0255a-9ed8-4f5c-be87-4fcf20365fa1 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/56ade7e6-35ae-4f5b-81ff-9221d246720c" status: 200 len: 1367 microversion: 2.1 time: 0.154533 Mar 08 15:26:32.639002 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1147/2510] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:26:32 2022] GET /compute/v2.1/servers/56ade7e6-35ae-4f5b-81ff-9221d246720c => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:26:33.160640 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [req-e59dcbf5-f113-49f5-92dd-c3b442074df8 req-897ad429-c1e3-43f3-95cb-3b4075a55061 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56ade7e6-35ae-4f5b-81ff-9221d246720c", "name": "network-vif-plugged", "status": "completed", "tag": "30e29d09-ca25-468f-80d0-324480c29ab1"}]} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:26:33.169417 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-e59dcbf5-f113-49f5-92dd-c3b442074df8 req-897ad429-c1e3-43f3-95cb-3b4075a55061 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:33.170051 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-e59dcbf5-f113-49f5-92dd-c3b442074df8 req-897ad429-c1e3-43f3-95cb-3b4075a55061 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:33.183235 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.compute.server_external_events [req-e59dcbf5-f113-49f5-92dd-c3b442074df8 req-897ad429-c1e3-43f3-95cb-3b4075a55061 service nova] Creating event network-vif-plugged:30e29d09-ca25-468f-80d0-324480c29ab1 for instance 56ade7e6-35ae-4f5b-81ff-9221d246720c on hv-cinder-83009 Mar 08 15:26:33.188568 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [req-e59dcbf5-f113-49f5-92dd-c3b442074df8 req-897ad429-c1e3-43f3-95cb-3b4075a55061 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032252 Mar 08 15:26:33.189487 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1364/2511] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 15:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:26:33.655363 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-adfe8557-cb0a-4ca5-b07d-401b1cfc29bf tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:33.655979 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-adfe8557-cb0a-4ca5-b07d-401b1cfc29bf tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 56ade7e6-35ae-4f5b-81ff-9221d246720c] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:33.662672 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-adfe8557-cb0a-4ca5-b07d-401b1cfc29bf tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:33.663078 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-adfe8557-cb0a-4ca5-b07d-401b1cfc29bf tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:33.663855 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-adfe8557-cb0a-4ca5-b07d-401b1cfc29bf tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:33.664298 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-adfe8557-cb0a-4ca5-b07d-401b1cfc29bf tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:33.798187 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-adfe8557-cb0a-4ca5-b07d-401b1cfc29bf tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282b16dbcb1648c39afa0f7ed2d5dbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf1dc206f041ca91a40149aab30dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:33.805285 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-adfe8557-cb0a-4ca5-b07d-401b1cfc29bf tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/56ade7e6-35ae-4f5b-81ff-9221d246720c" status: 200 len: 1367 microversion: 2.1 time: 0.154073 Mar 08 15:26:33.805847 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1148/2512] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:26:33 2022] GET /compute/v2.1/servers/56ade7e6-35ae-4f5b-81ff-9221d246720c => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:26:34.823143 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-114f4dfb-3e98-40e1-9d17-dc6076a74d33 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:34.823874 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-114f4dfb-3e98-40e1-9d17-dc6076a74d33 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 56ade7e6-35ae-4f5b-81ff-9221d246720c] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:34.830532 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-114f4dfb-3e98-40e1-9d17-dc6076a74d33 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:34.830989 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-114f4dfb-3e98-40e1-9d17-dc6076a74d33 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:34.831757 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-114f4dfb-3e98-40e1-9d17-dc6076a74d33 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:34.832200 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-114f4dfb-3e98-40e1-9d17-dc6076a74d33 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:35.223654 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-114f4dfb-3e98-40e1-9d17-dc6076a74d33 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282b16dbcb1648c39afa0f7ed2d5dbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf1dc206f041ca91a40149aab30dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:35.231633 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-114f4dfb-3e98-40e1-9d17-dc6076a74d33 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/56ade7e6-35ae-4f5b-81ff-9221d246720c" status: 200 len: 1557 microversion: 2.1 time: 0.413099 Mar 08 15:26:35.232536 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1365/2513] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:26:34 2022] GET /compute/v2.1/servers/56ade7e6-35ae-4f5b-81ff-9221d246720c => generated 1557 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:26:35.249620 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-6e2c1fff-67e0-469f-9516-f4d13a374e5b tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:35.250969 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-6e2c1fff-67e0-469f-9516-f4d13a374e5b tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 56ade7e6-35ae-4f5b-81ff-9221d246720c] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:35.258680 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6e2c1fff-67e0-469f-9516-f4d13a374e5b tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:35.259201 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6e2c1fff-67e0-469f-9516-f4d13a374e5b tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:35.260024 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6e2c1fff-67e0-469f-9516-f4d13a374e5b tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:35.260814 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6e2c1fff-67e0-469f-9516-f4d13a374e5b tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:35.348764 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-6e2c1fff-67e0-469f-9516-f4d13a374e5b tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/56ade7e6-35ae-4f5b-81ff-9221d246720c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103724 Mar 08 15:26:35.349404 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1149/2514] 10.222.0.30 () {58 vars in 1274 bytes} [Tue Mar 8 15:26:35 2022] GET /compute/v2.1/servers/56ade7e6-35ae-4f5b-81ff-9221d246720c/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:26:36.379437 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [req-1ad7665b-433f-4024-80ad-29b97dd80b91 req-66b0e0c6-45ed-45f7-b6ac-9d556efaf7d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56ade7e6-35ae-4f5b-81ff-9221d246720c", "tag": "30e29d09-ca25-468f-80d0-324480c29ab1"}]} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:26:36.388357 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-1ad7665b-433f-4024-80ad-29b97dd80b91 req-66b0e0c6-45ed-45f7-b6ac-9d556efaf7d6 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:36.389059 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-1ad7665b-433f-4024-80ad-29b97dd80b91 req-66b0e0c6-45ed-45f7-b6ac-9d556efaf7d6 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:36.403348 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.compute.server_external_events [req-1ad7665b-433f-4024-80ad-29b97dd80b91 req-66b0e0c6-45ed-45f7-b6ac-9d556efaf7d6 service nova] Creating event network-changed:30e29d09-ca25-468f-80d0-324480c29ab1 for instance 56ade7e6-35ae-4f5b-81ff-9221d246720c on hv-cinder-83009 Mar 08 15:26:36.409606 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [req-1ad7665b-433f-4024-80ad-29b97dd80b91 req-66b0e0c6-45ed-45f7-b6ac-9d556efaf7d6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033992 Mar 08 15:26:36.410792 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1366/2515] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 15:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:26:40.036791 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-97ddec2e-c597-4c82-8122-ab49a4cece5a tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-476873796", "imageRef": "7541d53b-003d-4f1a-8d76-fc5f4bd8dabf", "flavorRef": "452"}} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:26:40.085517 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.network.neutron [None req-97ddec2e-c597-4c82-8122-ab49a4cece5a tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] validate_networks() for None {{(pid=128351) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 15:26:40.358778 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-97ddec2e-c597-4c82-8122-ab49a4cece5a tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Flavor limits 0:0:0 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 15:26:40.359209 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-97ddec2e-c597-4c82-8122-ab49a4cece5a tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Image limits 0:0:0 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 15:26:40.359712 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-97ddec2e-c597-4c82-8122-ab49a4cece5a tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Flavor pref 0:0:0 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 15:26:40.360621 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-97ddec2e-c597-4c82-8122-ab49a4cece5a tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Image pref 0:0:0 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 15:26:40.361039 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-97ddec2e-c597-4c82-8122-ab49a4cece5a tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 15:26:40.369425 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-97ddec2e-c597-4c82-8122-ab49a4cece5a tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:40.369903 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-97ddec2e-c597-4c82-8122-ab49a4cece5a tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:40.370713 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-97ddec2e-c597-4c82-8122-ab49a4cece5a tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:40.371155 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-97ddec2e-c597-4c82-8122-ab49a4cece5a tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:40.387897 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.quota [None req-97ddec2e-c597-4c82-8122-ab49a4cece5a tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Getting quotas for project adbc569885f64749b5bbe7f3a2838969. Resources: {'instances', 'ram', 'cores'} {{(pid=128351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 15:26:40.392107 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.quota [None req-97ddec2e-c597-4c82-8122-ab49a4cece5a tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Getting quotas for user 8f4b49e3b23d46368233d60215504105 and project adbc569885f64749b5bbe7f3a2838969. Resources: {'instances', 'ram', 'cores'} {{(pid=128351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 15:26:40.404759 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-97ddec2e-c597-4c82-8122-ab49a4cece5a tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Going to run 1 instances... {{(pid=128351) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 15:26:40.406896 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-97ddec2e-c597-4c82-8122-ab49a4cece5a tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] [instance: b2784a35-903c-4b07-a099-532070f18a8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7541d53b-003d-4f1a-8d76-fc5f4bd8dabf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 15:26:40.449329 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-97ddec2e-c597-4c82-8122-ab49a4cece5a tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.417600 Mar 08 15:26:40.450093 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1150/2516] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Mar 8 15:26:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 419 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 15:26:40.461532 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5a0c2e43-852f-4d3d-bb07-a82285f6fd73 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:40.462283 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5a0c2e43-852f-4d3d-bb07-a82285f6fd73 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] [instance: b2784a35-903c-4b07-a099-532070f18a8d] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:40.518440 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-5a0c2e43-852f-4d3d-bb07-a82285f6fd73 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4b49e3b23d46368233d60215504105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbc569885f64749b5bbe7f3a2838969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:40.525010 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5a0c2e43-852f-4d3d-bb07-a82285f6fd73 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] 10.222.0.30 "GET /compute/v2.1/servers/b2784a35-903c-4b07-a099-532070f18a8d" status: 200 len: 1214 microversion: 2.1 time: 0.068516 Mar 08 15:26:40.525577 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1367/2517] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:26:40 2022] GET /compute/v2.1/servers/b2784a35-903c-4b07-a099-532070f18a8d => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:26:41.543305 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-2208f664-5186-41df-8db7-f8176a03fb88 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:41.543907 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-2208f664-5186-41df-8db7-f8176a03fb88 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] [instance: b2784a35-903c-4b07-a099-532070f18a8d] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:41.550984 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2208f664-5186-41df-8db7-f8176a03fb88 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:41.551442 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2208f664-5186-41df-8db7-f8176a03fb88 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:41.552218 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2208f664-5186-41df-8db7-f8176a03fb88 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:41.552674 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2208f664-5186-41df-8db7-f8176a03fb88 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:41.613836 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-2208f664-5186-41df-8db7-f8176a03fb88 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4b49e3b23d46368233d60215504105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbc569885f64749b5bbe7f3a2838969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:41.621412 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-2208f664-5186-41df-8db7-f8176a03fb88 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] 10.222.0.30 "GET /compute/v2.1/servers/b2784a35-903c-4b07-a099-532070f18a8d" status: 200 len: 1272 microversion: 2.1 time: 0.082456 Mar 08 15:26:41.621922 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1151/2518] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:26:41 2022] GET /compute/v2.1/servers/b2784a35-903c-4b07-a099-532070f18a8d => generated 1272 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:26:42.638241 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5ab519df-9630-4d17-b229-3cfc604d2f12 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:42.639383 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5ab519df-9630-4d17-b229-3cfc604d2f12 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] [instance: b2784a35-903c-4b07-a099-532070f18a8d] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:42.652502 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5ab519df-9630-4d17-b229-3cfc604d2f12 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:42.653264 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5ab519df-9630-4d17-b229-3cfc604d2f12 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:42.654075 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5ab519df-9630-4d17-b229-3cfc604d2f12 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:42.654765 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5ab519df-9630-4d17-b229-3cfc604d2f12 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:42.860617 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-5ab519df-9630-4d17-b229-3cfc604d2f12 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4b49e3b23d46368233d60215504105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbc569885f64749b5bbe7f3a2838969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:42.869076 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5ab519df-9630-4d17-b229-3cfc604d2f12 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] 10.222.0.30 "GET /compute/v2.1/servers/b2784a35-903c-4b07-a099-532070f18a8d" status: 200 len: 1314 microversion: 2.1 time: 0.234542 Mar 08 15:26:42.869647 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1368/2519] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:26:42 2022] GET /compute/v2.1/servers/b2784a35-903c-4b07-a099-532070f18a8d => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:26:42.911839 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [req-8bd388c0-58bc-4d71-a839-f03a295aae5e req-4260a382-052c-4767-be42-0d10c09c8589 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2784a35-903c-4b07-a099-532070f18a8d", "tag": "bfaf690d-3c1b-4471-b10c-700c4fa45c3e"}]} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:26:42.919993 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-8bd388c0-58bc-4d71-a839-f03a295aae5e req-4260a382-052c-4767-be42-0d10c09c8589 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:42.920384 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-8bd388c0-58bc-4d71-a839-f03a295aae5e req-4260a382-052c-4767-be42-0d10c09c8589 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:42.936216 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.compute.server_external_events [req-8bd388c0-58bc-4d71-a839-f03a295aae5e req-4260a382-052c-4767-be42-0d10c09c8589 service nova] Creating event network-changed:bfaf690d-3c1b-4471-b10c-700c4fa45c3e for instance b2784a35-903c-4b07-a099-532070f18a8d on hv-cinder-83009 Mar 08 15:26:42.941982 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [req-8bd388c0-58bc-4d71-a839-f03a295aae5e req-4260a382-052c-4767-be42-0d10c09c8589 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034092 Mar 08 15:26:42.942534 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1152/2520] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 15:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:26:43.885825 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-76d7a62e-988f-447b-aa84-edb47486ef90 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:43.886485 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-76d7a62e-988f-447b-aa84-edb47486ef90 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] [instance: b2784a35-903c-4b07-a099-532070f18a8d] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:43.892894 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-76d7a62e-988f-447b-aa84-edb47486ef90 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:43.893358 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-76d7a62e-988f-447b-aa84-edb47486ef90 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:43.894152 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-76d7a62e-988f-447b-aa84-edb47486ef90 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:43.894622 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-76d7a62e-988f-447b-aa84-edb47486ef90 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:44.027355 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-76d7a62e-988f-447b-aa84-edb47486ef90 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4b49e3b23d46368233d60215504105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbc569885f64749b5bbe7f3a2838969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:44.034778 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-76d7a62e-988f-447b-aa84-edb47486ef90 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] 10.222.0.30 "GET /compute/v2.1/servers/b2784a35-903c-4b07-a099-532070f18a8d" status: 200 len: 1314 microversion: 2.1 time: 0.152787 Mar 08 15:26:44.035342 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1369/2521] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:26:43 2022] GET /compute/v2.1/servers/b2784a35-903c-4b07-a099-532070f18a8d => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:26:45.052688 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-7e8a01ce-226c-492e-8f80-5064dcb83a16 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:45.053384 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-7e8a01ce-226c-492e-8f80-5064dcb83a16 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] [instance: b2784a35-903c-4b07-a099-532070f18a8d] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:45.059410 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7e8a01ce-226c-492e-8f80-5064dcb83a16 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:45.059860 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7e8a01ce-226c-492e-8f80-5064dcb83a16 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:45.060640 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7e8a01ce-226c-492e-8f80-5064dcb83a16 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:45.061076 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-7e8a01ce-226c-492e-8f80-5064dcb83a16 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:45.199689 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-7e8a01ce-226c-492e-8f80-5064dcb83a16 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4b49e3b23d46368233d60215504105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbc569885f64749b5bbe7f3a2838969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:45.208082 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-7e8a01ce-226c-492e-8f80-5064dcb83a16 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] 10.222.0.30 "GET /compute/v2.1/servers/b2784a35-903c-4b07-a099-532070f18a8d" status: 200 len: 1314 microversion: 2.1 time: 0.160084 Mar 08 15:26:45.208654 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1153/2522] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:26:45 2022] GET /compute/v2.1/servers/b2784a35-903c-4b07-a099-532070f18a8d => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:26:46.224816 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-8e66cd1e-6113-4b6a-bd4c-3e928e548af3 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:46.225342 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-8e66cd1e-6113-4b6a-bd4c-3e928e548af3 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] [instance: b2784a35-903c-4b07-a099-532070f18a8d] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:46.231570 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8e66cd1e-6113-4b6a-bd4c-3e928e548af3 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:46.232017 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8e66cd1e-6113-4b6a-bd4c-3e928e548af3 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:46.232791 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8e66cd1e-6113-4b6a-bd4c-3e928e548af3 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:46.233222 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8e66cd1e-6113-4b6a-bd4c-3e928e548af3 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:46.361030 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-8e66cd1e-6113-4b6a-bd4c-3e928e548af3 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4b49e3b23d46368233d60215504105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbc569885f64749b5bbe7f3a2838969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:46.368851 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-8e66cd1e-6113-4b6a-bd4c-3e928e548af3 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] 10.222.0.30 "GET /compute/v2.1/servers/b2784a35-903c-4b07-a099-532070f18a8d" status: 200 len: 1314 microversion: 2.1 time: 0.148072 Mar 08 15:26:46.369412 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1370/2523] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:26:46 2022] GET /compute/v2.1/servers/b2784a35-903c-4b07-a099-532070f18a8d => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:26:47.238417 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [req-9fc01c09-35c5-4c8c-8e08-2c566eff94b2 req-54656468-7440-4709-bbbe-bcbe9d5a3299 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2784a35-903c-4b07-a099-532070f18a8d", "name": "network-vif-plugged", "status": "completed", "tag": "bfaf690d-3c1b-4471-b10c-700c4fa45c3e"}]} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:26:47.248821 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-9fc01c09-35c5-4c8c-8e08-2c566eff94b2 req-54656468-7440-4709-bbbe-bcbe9d5a3299 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:47.249344 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-9fc01c09-35c5-4c8c-8e08-2c566eff94b2 req-54656468-7440-4709-bbbe-bcbe9d5a3299 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:47.261511 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.compute.server_external_events [req-9fc01c09-35c5-4c8c-8e08-2c566eff94b2 req-54656468-7440-4709-bbbe-bcbe9d5a3299 service nova] Creating event network-vif-plugged:bfaf690d-3c1b-4471-b10c-700c4fa45c3e for instance b2784a35-903c-4b07-a099-532070f18a8d on hv-cinder-83009 Mar 08 15:26:47.266404 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [req-9fc01c09-35c5-4c8c-8e08-2c566eff94b2 req-54656468-7440-4709-bbbe-bcbe9d5a3299 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031887 Mar 08 15:26:47.267496 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1154/2524] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 15:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:26:47.386328 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-6aded32f-2a29-4b54-97b2-3e01b603a4ad tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:47.386888 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-6aded32f-2a29-4b54-97b2-3e01b603a4ad tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] [instance: b2784a35-903c-4b07-a099-532070f18a8d] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:47.394122 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6aded32f-2a29-4b54-97b2-3e01b603a4ad tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:47.394582 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6aded32f-2a29-4b54-97b2-3e01b603a4ad tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:47.395361 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6aded32f-2a29-4b54-97b2-3e01b603a4ad tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:47.395804 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6aded32f-2a29-4b54-97b2-3e01b603a4ad tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:47.561926 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-6aded32f-2a29-4b54-97b2-3e01b603a4ad tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4b49e3b23d46368233d60215504105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbc569885f64749b5bbe7f3a2838969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:47.569632 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-6aded32f-2a29-4b54-97b2-3e01b603a4ad tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] 10.222.0.30 "GET /compute/v2.1/servers/b2784a35-903c-4b07-a099-532070f18a8d" status: 200 len: 1314 microversion: 2.1 time: 0.187263 Mar 08 15:26:47.570219 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1371/2525] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:26:47 2022] GET /compute/v2.1/servers/b2784a35-903c-4b07-a099-532070f18a8d => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:26:48.588731 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-191bac23-ea1a-4346-88ad-77ef359a387f tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:48.589454 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-191bac23-ea1a-4346-88ad-77ef359a387f tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] [instance: b2784a35-903c-4b07-a099-532070f18a8d] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:48.597500 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-191bac23-ea1a-4346-88ad-77ef359a387f tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:48.597972 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-191bac23-ea1a-4346-88ad-77ef359a387f tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:48.598738 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-191bac23-ea1a-4346-88ad-77ef359a387f tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:48.599315 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-191bac23-ea1a-4346-88ad-77ef359a387f tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:48.734468 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-191bac23-ea1a-4346-88ad-77ef359a387f tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4b49e3b23d46368233d60215504105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbc569885f64749b5bbe7f3a2838969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:48.742102 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-191bac23-ea1a-4346-88ad-77ef359a387f tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] 10.222.0.30 "GET /compute/v2.1/servers/b2784a35-903c-4b07-a099-532070f18a8d" status: 200 len: 1463 microversion: 2.1 time: 0.158225 Mar 08 15:26:48.742673 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1155/2526] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:26:48 2022] GET /compute/v2.1/servers/b2784a35-903c-4b07-a099-532070f18a8d => generated 1463 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:26:48.781538 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f90bd270-e5d8-42ea-b7ee-08375ee6bad9 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:48.782196 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f90bd270-e5d8-42ea-b7ee-08375ee6bad9 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] [instance: b2784a35-903c-4b07-a099-532070f18a8d] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:48.788367 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f90bd270-e5d8-42ea-b7ee-08375ee6bad9 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:48.788819 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f90bd270-e5d8-42ea-b7ee-08375ee6bad9 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:48.789571 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f90bd270-e5d8-42ea-b7ee-08375ee6bad9 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:48.790031 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f90bd270-e5d8-42ea-b7ee-08375ee6bad9 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:48.812667 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f90bd270-e5d8-42ea-b7ee-08375ee6bad9 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] [instance: b2784a35-903c-4b07-a099-532070f18a8d] Going to try to terminate instance {{(pid=128352) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 15:26:48.886656 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f90bd270-e5d8-42ea-b7ee-08375ee6bad9 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b2784a35-903c-4b07-a099-532070f18a8d" status: 204 len: 0 microversion: 2.1 time: 0.108885 Mar 08 15:26:48.887594 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1372/2527] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 15:26:48 2022] DELETE /compute/v2.1/servers/b2784a35-903c-4b07-a099-532070f18a8d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 15:26:48.896036 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-248ff8ef-7108-4598-9150-a39a2b675a33 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:48.896640 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-248ff8ef-7108-4598-9150-a39a2b675a33 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] [instance: b2784a35-903c-4b07-a099-532070f18a8d] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:48.902411 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-248ff8ef-7108-4598-9150-a39a2b675a33 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:48.902862 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-248ff8ef-7108-4598-9150-a39a2b675a33 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:48.903637 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-248ff8ef-7108-4598-9150-a39a2b675a33 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:48.904056 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-248ff8ef-7108-4598-9150-a39a2b675a33 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:49.038107 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-248ff8ef-7108-4598-9150-a39a2b675a33 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4b49e3b23d46368233d60215504105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbc569885f64749b5bbe7f3a2838969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:49.045180 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-248ff8ef-7108-4598-9150-a39a2b675a33 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] 10.222.0.30 "GET /compute/v2.1/servers/b2784a35-903c-4b07-a099-532070f18a8d" status: 200 len: 1469 microversion: 2.1 time: 0.153230 Mar 08 15:26:49.045732 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1156/2528] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:26:48 2022] GET /compute/v2.1/servers/b2784a35-903c-4b07-a099-532070f18a8d => generated 1469 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:26:50.063577 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3be6e4bc-8d45-4d00-ab5b-0466c894b520 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:50.064332 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-3be6e4bc-8d45-4d00-ab5b-0466c894b520 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] [instance: b2784a35-903c-4b07-a099-532070f18a8d] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:50.070927 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3be6e4bc-8d45-4d00-ab5b-0466c894b520 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:50.071373 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3be6e4bc-8d45-4d00-ab5b-0466c894b520 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:50.072133 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3be6e4bc-8d45-4d00-ab5b-0466c894b520 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:50.072562 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3be6e4bc-8d45-4d00-ab5b-0466c894b520 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:50.204317 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-3be6e4bc-8d45-4d00-ab5b-0466c894b520 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4b49e3b23d46368233d60215504105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbc569885f64749b5bbe7f3a2838969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:50.212034 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-3be6e4bc-8d45-4d00-ab5b-0466c894b520 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] 10.222.0.30 "GET /compute/v2.1/servers/b2784a35-903c-4b07-a099-532070f18a8d" status: 200 len: 1469 microversion: 2.1 time: 0.152650 Mar 08 15:26:50.212592 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1373/2529] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:26:50 2022] GET /compute/v2.1/servers/b2784a35-903c-4b07-a099-532070f18a8d => generated 1469 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:26:51.008558 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [req-5dde5b2d-70a3-447f-9ca8-21764224fe98 req-674ff457-03bd-41e8-baab-64e159a97e23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2784a35-903c-4b07-a099-532070f18a8d", "name": "network-vif-deleted", "tag": "bfaf690d-3c1b-4471-b10c-700c4fa45c3e"}]} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:26:51.019724 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-5dde5b2d-70a3-447f-9ca8-21764224fe98 req-674ff457-03bd-41e8-baab-64e159a97e23 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:51.020510 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-5dde5b2d-70a3-447f-9ca8-21764224fe98 req-674ff457-03bd-41e8-baab-64e159a97e23 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:51.034052 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.compute.server_external_events [req-5dde5b2d-70a3-447f-9ca8-21764224fe98 req-674ff457-03bd-41e8-baab-64e159a97e23 service nova] Creating event network-vif-deleted:bfaf690d-3c1b-4471-b10c-700c4fa45c3e for instance b2784a35-903c-4b07-a099-532070f18a8d on hv-cinder-83009 Mar 08 15:26:51.040381 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [req-5dde5b2d-70a3-447f-9ca8-21764224fe98 req-674ff457-03bd-41e8-baab-64e159a97e23 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035488 Mar 08 15:26:51.041185 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1157/2530] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 15:26:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:26:51.229761 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-881b25c1-ae4e-4be7-a08b-a8419bdd1555 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:51.230414 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-881b25c1-ae4e-4be7-a08b-a8419bdd1555 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] [instance: b2784a35-903c-4b07-a099-532070f18a8d] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:51.237494 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-881b25c1-ae4e-4be7-a08b-a8419bdd1555 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:51.237976 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-881b25c1-ae4e-4be7-a08b-a8419bdd1555 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:51.238751 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-881b25c1-ae4e-4be7-a08b-a8419bdd1555 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:51.239192 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-881b25c1-ae4e-4be7-a08b-a8419bdd1555 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:51.267615 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-881b25c1-ae4e-4be7-a08b-a8419bdd1555 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:51.268070 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-881b25c1-ae4e-4be7-a08b-a8419bdd1555 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:51.268523 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.objects.instance [None req-881b25c1-ae4e-4be7-a08b-a8419bdd1555 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lazy-loading 'fault' on Instance uuid b2784a35-903c-4b07-a099-532070f18a8d {{(pid=128352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 15:26:51.311237 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-881b25c1-ae4e-4be7-a08b-a8419bdd1555 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4b49e3b23d46368233d60215504105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbc569885f64749b5bbe7f3a2838969', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:26:51.318478 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-881b25c1-ae4e-4be7-a08b-a8419bdd1555 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] 10.222.0.30 "GET /compute/v2.1/servers/b2784a35-903c-4b07-a099-532070f18a8d" status: 200 len: 1304 microversion: 2.1 time: 0.092586 Mar 08 15:26:51.319043 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1374/2531] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:26:51 2022] GET /compute/v2.1/servers/b2784a35-903c-4b07-a099-532070f18a8d => generated 1304 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:26:52.337531 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-31f5f967-5b6d-4725-b5f1-ce1d36618067 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:26:52.338393 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-31f5f967-5b6d-4725-b5f1-ce1d36618067 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] [instance: b2784a35-903c-4b07-a099-532070f18a8d] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:26:52.345031 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-31f5f967-5b6d-4725-b5f1-ce1d36618067 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:52.346163 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-31f5f967-5b6d-4725-b5f1-ce1d36618067 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:52.347079 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-31f5f967-5b6d-4725-b5f1-ce1d36618067 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:26:52.347517 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-31f5f967-5b6d-4725-b5f1-ce1d36618067 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:26:52.361118 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.wsgi [None req-31f5f967-5b6d-4725-b5f1-ce1d36618067 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] HTTP exception thrown: Instance b2784a35-903c-4b07-a099-532070f18a8d could not be found. Mar 08 15:26:52.361698 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-31f5f967-5b6d-4725-b5f1-ce1d36618067 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] Returning 404 to user: Instance b2784a35-903c-4b07-a099-532070f18a8d could not be found. {{(pid=128351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:26:52.362546 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-31f5f967-5b6d-4725-b5f1-ce1d36618067 tempest-VolumesNegativeTest-627246888 tempest-VolumesNegativeTest-627246888-project] 10.222.0.30 "GET /compute/v2.1/servers/b2784a35-903c-4b07-a099-532070f18a8d" status: 404 len: 111 microversion: 2.1 time: 0.030086 Mar 08 15:26:52.363083 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1158/2532] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:26:52 2022] GET /compute/v2.1/servers/b2784a35-903c-4b07-a099-532070f18a8d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 15:27:05.234268 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d1b6849d-63ea-434d-b1dc-a9086ade46dd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:05.234889 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d1b6849d-63ea-434d-b1dc-a9086ade46dd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:05.242390 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d1b6849d-63ea-434d-b1dc-a9086ade46dd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:05.242940 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d1b6849d-63ea-434d-b1dc-a9086ade46dd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:05.243874 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d1b6849d-63ea-434d-b1dc-a9086ade46dd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:05.244545 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d1b6849d-63ea-434d-b1dc-a9086ade46dd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:05.271768 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d1b6849d-63ea-434d-b1dc-a9086ade46dd tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64/ips" status: 200 len: 152 microversion: 2.20 time: 0.042252 Mar 08 15:27:05.272422 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1375/2533] 10.222.0.30 () {60 vars in 1288 bytes} [Tue Mar 8 15:27:05 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64/ips => generated 152 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:27:07.312681 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-51fe7d78-efe6-4db2-8ba9-842b4e16eeeb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:27:07.313303 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-51fe7d78-efe6-4db2-8ba9-842b4e16eeeb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:07.320204 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-51fe7d78-efe6-4db2-8ba9-842b4e16eeeb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:07.320660 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-51fe7d78-efe6-4db2-8ba9-842b4e16eeeb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:07.321429 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-51fe7d78-efe6-4db2-8ba9-842b4e16eeeb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:07.321894 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-51fe7d78-efe6-4db2-8ba9-842b4e16eeeb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:07.343608 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.objects.instance [None req-51fe7d78-efe6-4db2-8ba9-842b4e16eeeb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lazy-loading 'flavor' on Instance uuid c051cc3d-ac34-4fe1-8b55-010166d2cb64 {{(pid=128351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 15:27:07.595793 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-51fe7d78-efe6-4db2-8ba9-842b4e16eeeb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "POST /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64/action" status: 202 len: 0 microversion: 2.20 time: 0.287445 Mar 08 15:27:07.596506 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1159/2534] 10.222.0.30 () {62 vars in 1318 bytes} [Tue Mar 8 15:27:07 2022] POST /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 08 15:27:07.604700 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-23c50267-ff89-4a9d-a296-272965a9934e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:07.605392 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-23c50267-ff89-4a9d-a296-272965a9934e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:07.611283 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-23c50267-ff89-4a9d-a296-272965a9934e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:07.611903 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-23c50267-ff89-4a9d-a296-272965a9934e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:07.612878 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-23c50267-ff89-4a9d-a296-272965a9934e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:07.613307 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-23c50267-ff89-4a9d-a296-272965a9934e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:07.746186 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-23c50267-ff89-4a9d-a296-272965a9934e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:07.754314 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-23c50267-ff89-4a9d-a296-272965a9934e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:07.755798 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-23c50267-ff89-4a9d-a296-272965a9934e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:07.757032 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-23c50267-ff89-4a9d-a296-272965a9934e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1724 microversion: 2.20 time: 0.156391 Mar 08 15:27:07.757585 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1376/2535] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:27:07 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:27:08.777000 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-25ae3065-79a2-4a03-8d23-26a2252bf41a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:08.777716 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-25ae3065-79a2-4a03-8d23-26a2252bf41a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:08.784553 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-25ae3065-79a2-4a03-8d23-26a2252bf41a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:08.785010 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-25ae3065-79a2-4a03-8d23-26a2252bf41a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:08.785782 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-25ae3065-79a2-4a03-8d23-26a2252bf41a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:08.786250 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-25ae3065-79a2-4a03-8d23-26a2252bf41a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:08.922531 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-25ae3065-79a2-4a03-8d23-26a2252bf41a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:08.931465 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-25ae3065-79a2-4a03-8d23-26a2252bf41a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:08.933169 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-25ae3065-79a2-4a03-8d23-26a2252bf41a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:08.934363 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-25ae3065-79a2-4a03-8d23-26a2252bf41a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1724 microversion: 2.20 time: 0.162746 Mar 08 15:27:08.934923 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1160/2536] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:27:08 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:27:09.952490 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-2fe6d1ca-953d-43c1-a771-849e5f15177c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:09.953106 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-2fe6d1ca-953d-43c1-a771-849e5f15177c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:09.960454 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2fe6d1ca-953d-43c1-a771-849e5f15177c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:09.960911 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2fe6d1ca-953d-43c1-a771-849e5f15177c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:09.961678 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2fe6d1ca-953d-43c1-a771-849e5f15177c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:09.962147 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2fe6d1ca-953d-43c1-a771-849e5f15177c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:10.090474 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-2fe6d1ca-953d-43c1-a771-849e5f15177c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:10.098301 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-2fe6d1ca-953d-43c1-a771-849e5f15177c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:10.099873 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-2fe6d1ca-953d-43c1-a771-849e5f15177c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:10.101028 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-2fe6d1ca-953d-43c1-a771-849e5f15177c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1724 microversion: 2.20 time: 0.152479 Mar 08 15:27:10.101582 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1377/2537] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:27:09 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:27:11.119654 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-df7993b4-857e-47f7-b7f6-ce6b6f4b9a46 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:11.120268 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-df7993b4-857e-47f7-b7f6-ce6b6f4b9a46 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:11.127259 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-df7993b4-857e-47f7-b7f6-ce6b6f4b9a46 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:11.127679 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-df7993b4-857e-47f7-b7f6-ce6b6f4b9a46 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:11.128445 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-df7993b4-857e-47f7-b7f6-ce6b6f4b9a46 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:11.128885 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-df7993b4-857e-47f7-b7f6-ce6b6f4b9a46 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:11.268637 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-df7993b4-857e-47f7-b7f6-ce6b6f4b9a46 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:11.276254 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-df7993b4-857e-47f7-b7f6-ce6b6f4b9a46 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:11.277737 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-df7993b4-857e-47f7-b7f6-ce6b6f4b9a46 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:11.279154 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-df7993b4-857e-47f7-b7f6-ce6b6f4b9a46 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1724 microversion: 2.20 time: 0.163159 Mar 08 15:27:11.279706 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1161/2538] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:27:11 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:27:12.297932 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-31df82ce-60b6-4451-acbb-ed8656df078e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:12.298617 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-31df82ce-60b6-4451-acbb-ed8656df078e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:12.304903 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-31df82ce-60b6-4451-acbb-ed8656df078e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:12.305360 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-31df82ce-60b6-4451-acbb-ed8656df078e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:12.306165 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-31df82ce-60b6-4451-acbb-ed8656df078e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:12.306612 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-31df82ce-60b6-4451-acbb-ed8656df078e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:12.436568 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-31df82ce-60b6-4451-acbb-ed8656df078e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:12.444640 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-31df82ce-60b6-4451-acbb-ed8656df078e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:12.446172 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-31df82ce-60b6-4451-acbb-ed8656df078e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:12.447329 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-31df82ce-60b6-4451-acbb-ed8656df078e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1724 microversion: 2.20 time: 0.153402 Mar 08 15:27:12.447885 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1378/2539] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:27:12 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:27:12.700521 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-05967078-ea74-4af5-a1e7-02d686a7e022 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:12.701071 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-05967078-ea74-4af5-a1e7-02d686a7e022 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 56ade7e6-35ae-4f5b-81ff-9221d246720c] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:12.708007 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-05967078-ea74-4af5-a1e7-02d686a7e022 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:12.708443 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-05967078-ea74-4af5-a1e7-02d686a7e022 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:12.709194 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-05967078-ea74-4af5-a1e7-02d686a7e022 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:12.709626 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-05967078-ea74-4af5-a1e7-02d686a7e022 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:12.731212 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-05967078-ea74-4af5-a1e7-02d686a7e022 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/56ade7e6-35ae-4f5b-81ff-9221d246720c/ips" status: 200 len: 149 microversion: 2.1 time: 0.034588 Mar 08 15:27:12.731748 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1162/2540] 10.222.0.30 () {58 vars in 1247 bytes} [Tue Mar 8 15:27:12 2022] GET /compute/v2.1/servers/56ade7e6-35ae-4f5b-81ff-9221d246720c/ips => generated 149 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:27:13.465397 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-8836676a-077c-4151-af6a-5ce4edbc1476 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:13.466056 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-8836676a-077c-4151-af6a-5ce4edbc1476 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:13.473404 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8836676a-077c-4151-af6a-5ce4edbc1476 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:13.473875 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8836676a-077c-4151-af6a-5ce4edbc1476 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:13.474650 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8836676a-077c-4151-af6a-5ce4edbc1476 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:13.475087 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8836676a-077c-4151-af6a-5ce4edbc1476 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:13.609831 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-8836676a-077c-4151-af6a-5ce4edbc1476 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:13.618675 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-8836676a-077c-4151-af6a-5ce4edbc1476 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:13.620185 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-8836676a-077c-4151-af6a-5ce4edbc1476 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:13.621341 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-8836676a-077c-4151-af6a-5ce4edbc1476 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1724 microversion: 2.20 time: 0.159828 Mar 08 15:27:13.621923 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1379/2541] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:27:13 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:27:14.061299 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-a93131bf-48c8-412b-bf64-efe4ab222668 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7007cf64-dd25-43f2-9821-8f8f60954502"}} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:27:14.062440 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-a93131bf-48c8-412b-bf64-efe4ab222668 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 56ade7e6-35ae-4f5b-81ff-9221d246720c] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:14.069019 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a93131bf-48c8-412b-bf64-efe4ab222668 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:14.069470 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a93131bf-48c8-412b-bf64-efe4ab222668 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:14.070258 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a93131bf-48c8-412b-bf64-efe4ab222668 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:14.070694 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a93131bf-48c8-412b-bf64-efe4ab222668 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:14.297483 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-a93131bf-48c8-412b-bf64-efe4ab222668 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "POST /compute/v2.1/servers/56ade7e6-35ae-4f5b-81ff-9221d246720c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.240205 Mar 08 15:27:14.298138 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1163/2542] 10.222.0.30 () {60 vars in 1322 bytes} [Tue Mar 8 15:27:14 2022] POST /compute/v2.1/servers/56ade7e6-35ae-4f5b-81ff-9221d246720c/os-volume_attachments => generated 194 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:27:14.639510 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-67e45ec7-3b49-47b4-9586-7d90b02bda7d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:14.640190 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-67e45ec7-3b49-47b4-9586-7d90b02bda7d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:14.647352 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-67e45ec7-3b49-47b4-9586-7d90b02bda7d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:14.647802 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-67e45ec7-3b49-47b4-9586-7d90b02bda7d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:14.648632 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-67e45ec7-3b49-47b4-9586-7d90b02bda7d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:14.649066 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-67e45ec7-3b49-47b4-9586-7d90b02bda7d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:14.781022 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-67e45ec7-3b49-47b4-9586-7d90b02bda7d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:14.789444 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-67e45ec7-3b49-47b4-9586-7d90b02bda7d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:14.790977 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-67e45ec7-3b49-47b4-9586-7d90b02bda7d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:14.792128 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-67e45ec7-3b49-47b4-9586-7d90b02bda7d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1724 microversion: 2.20 time: 0.156766 Mar 08 15:27:14.792684 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1380/2543] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:27:14 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:27:15.811817 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-ebaf6f23-d3ed-41e7-944b-b5b1583f03d8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:15.812519 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-ebaf6f23-d3ed-41e7-944b-b5b1583f03d8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:15.819689 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ebaf6f23-d3ed-41e7-944b-b5b1583f03d8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:15.820156 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ebaf6f23-d3ed-41e7-944b-b5b1583f03d8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:15.820929 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ebaf6f23-d3ed-41e7-944b-b5b1583f03d8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:15.821383 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ebaf6f23-d3ed-41e7-944b-b5b1583f03d8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:15.958136 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-ebaf6f23-d3ed-41e7-944b-b5b1583f03d8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:15.965816 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-ebaf6f23-d3ed-41e7-944b-b5b1583f03d8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:15.967340 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-ebaf6f23-d3ed-41e7-944b-b5b1583f03d8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:15.968476 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-ebaf6f23-d3ed-41e7-944b-b5b1583f03d8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1724 microversion: 2.20 time: 0.161425 Mar 08 15:27:15.969022 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1164/2544] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:27:15 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:27:16.986538 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-54433f9e-723e-40dd-a934-77384c5b7023 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:16.987162 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-54433f9e-723e-40dd-a934-77384c5b7023 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:16.993432 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-54433f9e-723e-40dd-a934-77384c5b7023 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:16.993930 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-54433f9e-723e-40dd-a934-77384c5b7023 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:16.994706 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-54433f9e-723e-40dd-a934-77384c5b7023 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:16.995152 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-54433f9e-723e-40dd-a934-77384c5b7023 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:17.128223 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-54433f9e-723e-40dd-a934-77384c5b7023 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:17.136204 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-54433f9e-723e-40dd-a934-77384c5b7023 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:17.137757 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-54433f9e-723e-40dd-a934-77384c5b7023 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:17.138945 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-54433f9e-723e-40dd-a934-77384c5b7023 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1724 microversion: 2.20 time: 0.156399 Mar 08 15:27:17.139509 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1381/2545] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:27:16 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:27:18.157941 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b72083d9-d579-47bf-9913-35fd8323c284 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:18.158552 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-b72083d9-d579-47bf-9913-35fd8323c284 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:18.164779 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b72083d9-d579-47bf-9913-35fd8323c284 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:18.165226 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b72083d9-d579-47bf-9913-35fd8323c284 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:18.166020 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b72083d9-d579-47bf-9913-35fd8323c284 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:18.166453 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b72083d9-d579-47bf-9913-35fd8323c284 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:18.298802 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-b72083d9-d579-47bf-9913-35fd8323c284 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:18.306364 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-b72083d9-d579-47bf-9913-35fd8323c284 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:18.307861 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-b72083d9-d579-47bf-9913-35fd8323c284 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:18.308995 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-b72083d9-d579-47bf-9913-35fd8323c284 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1724 microversion: 2.20 time: 0.155263 Mar 08 15:27:18.309541 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1165/2546] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:27:18 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:27:19.327520 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5f424793-2bd5-44fb-889d-74a9791bb0db tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:19.328136 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5f424793-2bd5-44fb-889d-74a9791bb0db tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:19.335230 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5f424793-2bd5-44fb-889d-74a9791bb0db tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:19.335685 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5f424793-2bd5-44fb-889d-74a9791bb0db tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:19.336455 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5f424793-2bd5-44fb-889d-74a9791bb0db tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:19.336894 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5f424793-2bd5-44fb-889d-74a9791bb0db tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:19.468986 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-5f424793-2bd5-44fb-889d-74a9791bb0db tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:19.476762 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-5f424793-2bd5-44fb-889d-74a9791bb0db tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:19.478296 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-5f424793-2bd5-44fb-889d-74a9791bb0db tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:19.479449 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5f424793-2bd5-44fb-889d-74a9791bb0db tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1724 microversion: 2.20 time: 0.155854 Mar 08 15:27:19.480001 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1382/2547] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:27:19 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:27:20.497088 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-d53d2108-1884-4468-b9a4-c6592f5eade8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:20.497705 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-d53d2108-1884-4468-b9a4-c6592f5eade8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:20.504524 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d53d2108-1884-4468-b9a4-c6592f5eade8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:20.504982 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d53d2108-1884-4468-b9a4-c6592f5eade8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:20.505748 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d53d2108-1884-4468-b9a4-c6592f5eade8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:20.506226 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d53d2108-1884-4468-b9a4-c6592f5eade8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:20.641323 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-d53d2108-1884-4468-b9a4-c6592f5eade8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:20.650089 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-d53d2108-1884-4468-b9a4-c6592f5eade8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:20.651638 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-d53d2108-1884-4468-b9a4-c6592f5eade8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:20.652823 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-d53d2108-1884-4468-b9a4-c6592f5eade8 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1724 microversion: 2.20 time: 0.159636 Mar 08 15:27:20.653369 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1166/2548] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:27:20 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:27:21.671568 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b45b7f08-bff9-4198-8696-81b4ecbe6cae tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:21.672257 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b45b7f08-bff9-4198-8696-81b4ecbe6cae tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:21.678295 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b45b7f08-bff9-4198-8696-81b4ecbe6cae tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:21.678752 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b45b7f08-bff9-4198-8696-81b4ecbe6cae tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:21.679522 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b45b7f08-bff9-4198-8696-81b4ecbe6cae tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:21.679964 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b45b7f08-bff9-4198-8696-81b4ecbe6cae tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:21.770148 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-cf29201a-65ec-4179-b0d2-cc6e71a6cb0f tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Action: 'create', calling method: .version_select at 0x7ff35d16d550>, body: {"keypair": {"name": "tempest-keypair-2123463880"}} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:27:21.785140 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.quota [None req-cf29201a-65ec-4179-b0d2-cc6e71a6cb0f tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Getting quotas for project e4bf1dc206f041ca91a40149aab30dee. Resources: {'key_pairs'} {{(pid=128351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 15:27:21.788899 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.quota [None req-cf29201a-65ec-4179-b0d2-cc6e71a6cb0f tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Getting quotas for user 282b16dbcb1648c39afa0f7ed2d5dbda and project e4bf1dc206f041ca91a40149aab30dee. Resources: {'key_pairs'} {{(pid=128351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 15:27:21.812493 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b45b7f08-bff9-4198-8696-81b4ecbe6cae tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:21.820755 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b45b7f08-bff9-4198-8696-81b4ecbe6cae tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:21.822273 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b45b7f08-bff9-4198-8696-81b4ecbe6cae tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:21.823420 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b45b7f08-bff9-4198-8696-81b4ecbe6cae tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1724 microversion: 2.20 time: 0.155760 Mar 08 15:27:21.823978 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1383/2549] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:27:21 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:27:21.885012 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.quota [None req-cf29201a-65ec-4179-b0d2-cc6e71a6cb0f tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Getting quotas for project e4bf1dc206f041ca91a40149aab30dee. Resources: {'key_pairs'} {{(pid=128351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 15:27:21.888661 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.quota [None req-cf29201a-65ec-4179-b0d2-cc6e71a6cb0f tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Getting quotas for user 282b16dbcb1648c39afa0f7ed2d5dbda and project e4bf1dc206f041ca91a40149aab30dee. Resources: {'key_pairs'} {{(pid=128351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 15:27:21.901358 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-cf29201a-65ec-4179-b0d2-cc6e71a6cb0f tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.135686 Mar 08 15:27:21.901977 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1167/2550] 10.222.0.30 () {60 vars in 1157 bytes} [Tue Mar 8 15:27:21 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:27:22.842084 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-4cc1359c-d9f8-4ef6-baec-247b0ce21cff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:22.842718 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-4cc1359c-d9f8-4ef6-baec-247b0ce21cff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:22.849473 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4cc1359c-d9f8-4ef6-baec-247b0ce21cff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:22.849958 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4cc1359c-d9f8-4ef6-baec-247b0ce21cff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:22.850742 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4cc1359c-d9f8-4ef6-baec-247b0ce21cff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:22.851177 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-4cc1359c-d9f8-4ef6-baec-247b0ce21cff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:22.988736 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-4cc1359c-d9f8-4ef6-baec-247b0ce21cff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:22.997808 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-4cc1359c-d9f8-4ef6-baec-247b0ce21cff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:22.999329 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-4cc1359c-d9f8-4ef6-baec-247b0ce21cff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:23.000481 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-4cc1359c-d9f8-4ef6-baec-247b0ce21cff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1724 microversion: 2.20 time: 0.162388 Mar 08 15:27:23.001040 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1384/2551] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:27:22 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:27:23.149833 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-9f7ac467-71a3-41e9-91e4-b89a1e9e2a3c tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-365986235", "imageRef": "7541d53b-003d-4f1a-8d76-fc5f4bd8dabf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fd27055d-8ae6-4d4d-a095-42195ed67196"}], "security_groups": [{"name": "tempest-securitygroup--1352572403"}], "key_name": "tempest-keypair-2123463880", "user_data": "}} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:27:23.254319 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.network.neutron [None req-9f7ac467-71a3-41e9-91e4-b89a1e9e2a3c tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] validate_networks() for [('fd27055d-8ae6-4d4d-a095-42195ed67196', None, None, None, None, None)] {{(pid=128351) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 15:27:23.631696 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-9f7ac467-71a3-41e9-91e4-b89a1e9e2a3c tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Flavor limits 0:0:0 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 15:27:23.632152 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-9f7ac467-71a3-41e9-91e4-b89a1e9e2a3c tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Image limits 0:0:0 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 15:27:23.632624 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-9f7ac467-71a3-41e9-91e4-b89a1e9e2a3c tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Flavor pref 0:0:0 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 15:27:23.633033 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-9f7ac467-71a3-41e9-91e4-b89a1e9e2a3c tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Image pref 0:0:0 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 15:27:23.633448 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-9f7ac467-71a3-41e9-91e4-b89a1e9e2a3c tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 15:27:23.643004 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9f7ac467-71a3-41e9-91e4-b89a1e9e2a3c tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:23.643468 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9f7ac467-71a3-41e9-91e4-b89a1e9e2a3c tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:23.644265 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9f7ac467-71a3-41e9-91e4-b89a1e9e2a3c tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:23.644701 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9f7ac467-71a3-41e9-91e4-b89a1e9e2a3c tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:23.660767 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.quota [None req-9f7ac467-71a3-41e9-91e4-b89a1e9e2a3c tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Getting quotas for project e4bf1dc206f041ca91a40149aab30dee. Resources: {'instances', 'ram', 'cores'} {{(pid=128351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 15:27:23.664596 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.quota [None req-9f7ac467-71a3-41e9-91e4-b89a1e9e2a3c tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Getting quotas for user 282b16dbcb1648c39afa0f7ed2d5dbda and project e4bf1dc206f041ca91a40149aab30dee. Resources: {'instances', 'ram', 'cores'} {{(pid=128351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 15:27:23.675691 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-9f7ac467-71a3-41e9-91e4-b89a1e9e2a3c tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Going to run 1 instances... {{(pid=128351) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 15:27:23.677930 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-9f7ac467-71a3-41e9-91e4-b89a1e9e2a3c tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: f813bc72-7a86-47dd-b619-d20ef86a30ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7541d53b-003d-4f1a-8d76-fc5f4bd8dabf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 15:27:23.725261 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-9f7ac467-71a3-41e9-91e4-b89a1e9e2a3c tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.580244 Mar 08 15:27:23.726059 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1168/2552] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Mar 8 15:27:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 15:27:23.736344 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c3c25c7d-d337-4344-9ecd-b2dc14f17135 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:23.736954 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-c3c25c7d-d337-4344-9ecd-b2dc14f17135 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: f813bc72-7a86-47dd-b619-d20ef86a30ea] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:23.787318 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-c3c25c7d-d337-4344-9ecd-b2dc14f17135 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282b16dbcb1648c39afa0f7ed2d5dbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf1dc206f041ca91a40149aab30dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:23.793771 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-c3c25c7d-d337-4344-9ecd-b2dc14f17135 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/f813bc72-7a86-47dd-b619-d20ef86a30ea" status: 200 len: 1241 microversion: 2.1 time: 0.061764 Mar 08 15:27:23.794366 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1385/2553] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:27:23 2022] GET /compute/v2.1/servers/f813bc72-7a86-47dd-b619-d20ef86a30ea => generated 1241 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:27:24.019518 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-0284b511-02ba-408a-8ddd-57e3a91392bf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:24.020217 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-0284b511-02ba-408a-8ddd-57e3a91392bf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:24.027009 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0284b511-02ba-408a-8ddd-57e3a91392bf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:24.027471 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0284b511-02ba-408a-8ddd-57e3a91392bf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:24.028246 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0284b511-02ba-408a-8ddd-57e3a91392bf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:24.028946 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0284b511-02ba-408a-8ddd-57e3a91392bf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:24.180651 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-0284b511-02ba-408a-8ddd-57e3a91392bf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:24.188382 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-0284b511-02ba-408a-8ddd-57e3a91392bf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:24.189989 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-0284b511-02ba-408a-8ddd-57e3a91392bf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:24.191137 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-0284b511-02ba-408a-8ddd-57e3a91392bf tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1745 microversion: 2.20 time: 0.176253 Mar 08 15:27:24.191686 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1169/2554] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:27:24 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1745 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:27:24.812779 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-25bceff0-10d7-4a95-9174-25d728495576 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:24.813571 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-25bceff0-10d7-4a95-9174-25d728495576 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: f813bc72-7a86-47dd-b619-d20ef86a30ea] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:24.821528 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-25bceff0-10d7-4a95-9174-25d728495576 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:24.822103 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-25bceff0-10d7-4a95-9174-25d728495576 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:24.822973 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-25bceff0-10d7-4a95-9174-25d728495576 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:24.823480 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-25bceff0-10d7-4a95-9174-25d728495576 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:25.034207 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-25bceff0-10d7-4a95-9174-25d728495576 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282b16dbcb1648c39afa0f7ed2d5dbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf1dc206f041ca91a40149aab30dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:25.041778 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-25bceff0-10d7-4a95-9174-25d728495576 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/f813bc72-7a86-47dd-b619-d20ef86a30ea" status: 200 len: 1299 microversion: 2.1 time: 0.234614 Mar 08 15:27:25.042368 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1386/2555] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:27:24 2022] GET /compute/v2.1/servers/f813bc72-7a86-47dd-b619-d20ef86a30ea => generated 1299 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:27:25.208755 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-a7e9c9da-fad0-49be-94ba-72cbb8bf0432 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:25.210031 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-a7e9c9da-fad0-49be-94ba-72cbb8bf0432 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:25.216286 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a7e9c9da-fad0-49be-94ba-72cbb8bf0432 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:25.216735 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a7e9c9da-fad0-49be-94ba-72cbb8bf0432 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:25.217522 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a7e9c9da-fad0-49be-94ba-72cbb8bf0432 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:25.218031 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a7e9c9da-fad0-49be-94ba-72cbb8bf0432 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:25.364008 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-a7e9c9da-fad0-49be-94ba-72cbb8bf0432 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:25.376214 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-a7e9c9da-fad0-49be-94ba-72cbb8bf0432 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:25.378551 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-a7e9c9da-fad0-49be-94ba-72cbb8bf0432 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:25.379794 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-a7e9c9da-fad0-49be-94ba-72cbb8bf0432 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1745 microversion: 2.20 time: 0.175264 Mar 08 15:27:25.380714 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1170/2556] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:27:25 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1745 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:27:26.059588 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b8f1954d-99c2-41e1-a8fc-148db93654f0 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:26.060292 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b8f1954d-99c2-41e1-a8fc-148db93654f0 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: f813bc72-7a86-47dd-b619-d20ef86a30ea] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:26.067385 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b8f1954d-99c2-41e1-a8fc-148db93654f0 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:26.067912 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b8f1954d-99c2-41e1-a8fc-148db93654f0 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:26.068926 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b8f1954d-99c2-41e1-a8fc-148db93654f0 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:26.069453 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b8f1954d-99c2-41e1-a8fc-148db93654f0 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:26.302264 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b8f1954d-99c2-41e1-a8fc-148db93654f0 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282b16dbcb1648c39afa0f7ed2d5dbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf1dc206f041ca91a40149aab30dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:26.321610 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b8f1954d-99c2-41e1-a8fc-148db93654f0 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/f813bc72-7a86-47dd-b619-d20ef86a30ea" status: 200 len: 1367 microversion: 2.1 time: 0.266048 Mar 08 15:27:26.332015 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1387/2557] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:27:26 2022] GET /compute/v2.1/servers/f813bc72-7a86-47dd-b619-d20ef86a30ea => generated 1367 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:27:26.399729 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-503bd7c7-162a-4bb6-9023-6a2845cc4335 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:26.401529 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-503bd7c7-162a-4bb6-9023-6a2845cc4335 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:26.416606 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-503bd7c7-162a-4bb6-9023-6a2845cc4335 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:26.419072 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-503bd7c7-162a-4bb6-9023-6a2845cc4335 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:26.423847 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-503bd7c7-162a-4bb6-9023-6a2845cc4335 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:26.425312 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-503bd7c7-162a-4bb6-9023-6a2845cc4335 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:26.592193 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [req-cd9c9c9b-11c9-4054-926d-b80d1ac1fa1e req-91dc8138-a254-41fc-8c97-e7d6d19dd18b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f813bc72-7a86-47dd-b619-d20ef86a30ea", "tag": "dd224896-3e3e-4304-8c16-ebdc412f2f7f"}]} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:27:26.617110 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-cd9c9c9b-11c9-4054-926d-b80d1ac1fa1e req-91dc8138-a254-41fc-8c97-e7d6d19dd18b service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:26.618319 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-cd9c9c9b-11c9-4054-926d-b80d1ac1fa1e req-91dc8138-a254-41fc-8c97-e7d6d19dd18b service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:26.631779 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.compute.server_external_events [req-cd9c9c9b-11c9-4054-926d-b80d1ac1fa1e req-91dc8138-a254-41fc-8c97-e7d6d19dd18b service nova] Creating event network-changed:dd224896-3e3e-4304-8c16-ebdc412f2f7f for instance f813bc72-7a86-47dd-b619-d20ef86a30ea on hv-cinder-83009 Mar 08 15:27:26.642112 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-503bd7c7-162a-4bb6-9023-6a2845cc4335 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:26.645562 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [req-cd9c9c9b-11c9-4054-926d-b80d1ac1fa1e req-91dc8138-a254-41fc-8c97-e7d6d19dd18b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060972 Mar 08 15:27:26.646223 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1388/2558] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 15:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:27:26.667798 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-503bd7c7-162a-4bb6-9023-6a2845cc4335 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:26.669448 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-503bd7c7-162a-4bb6-9023-6a2845cc4335 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:26.676132 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-503bd7c7-162a-4bb6-9023-6a2845cc4335 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1740 microversion: 2.20 time: 0.280616 Mar 08 15:27:26.678151 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1171/2559] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:27:26 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1740 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:27:27.339956 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-57e21374-1457-4c89-9d6b-62c0ff33448d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:27.341049 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-57e21374-1457-4c89-9d6b-62c0ff33448d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: f813bc72-7a86-47dd-b619-d20ef86a30ea] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:27.351583 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-57e21374-1457-4c89-9d6b-62c0ff33448d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:27.357338 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-57e21374-1457-4c89-9d6b-62c0ff33448d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:27.358624 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-57e21374-1457-4c89-9d6b-62c0ff33448d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:27.359302 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-57e21374-1457-4c89-9d6b-62c0ff33448d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:27.449312 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [req-deeb9095-0cf5-472d-8e2e-edee4ca5232b req-79c4a9ab-2711-40a2-859b-f60c29d82cbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c051cc3d-ac34-4fe1-8b55-010166d2cb64", "name": "network-vif-plugged", "status": "completed", "tag": "7068a3ed-1414-4ab7-8c70-a96a7135062c"}]} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:27:27.464210 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-deeb9095-0cf5-472d-8e2e-edee4ca5232b req-79c4a9ab-2711-40a2-859b-f60c29d82cbc service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:27.464585 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-deeb9095-0cf5-472d-8e2e-edee4ca5232b req-79c4a9ab-2711-40a2-859b-f60c29d82cbc service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:27.491111 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.compute.server_external_events [req-deeb9095-0cf5-472d-8e2e-edee4ca5232b req-79c4a9ab-2711-40a2-859b-f60c29d82cbc service nova] Creating event network-vif-plugged:7068a3ed-1414-4ab7-8c70-a96a7135062c for instance c051cc3d-ac34-4fe1-8b55-010166d2cb64 on hv-cinder-83009 Mar 08 15:27:27.499538 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [req-deeb9095-0cf5-472d-8e2e-edee4ca5232b req-79c4a9ab-2711-40a2-859b-f60c29d82cbc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056566 Mar 08 15:27:27.500723 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1172/2560] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 15:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:27:27.623101 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-57e21374-1457-4c89-9d6b-62c0ff33448d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282b16dbcb1648c39afa0f7ed2d5dbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf1dc206f041ca91a40149aab30dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:27.631268 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-57e21374-1457-4c89-9d6b-62c0ff33448d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/f813bc72-7a86-47dd-b619-d20ef86a30ea" status: 200 len: 1367 microversion: 2.1 time: 0.295896 Mar 08 15:27:27.632225 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1389/2561] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:27:27 2022] GET /compute/v2.1/servers/f813bc72-7a86-47dd-b619-d20ef86a30ea => generated 1367 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:27:27.696341 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-c97d4b5a-34a2-48f9-9e69-9c4850f677ce tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:27.697296 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-c97d4b5a-34a2-48f9-9e69-9c4850f677ce tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:27.705784 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c97d4b5a-34a2-48f9-9e69-9c4850f677ce tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:27.706262 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c97d4b5a-34a2-48f9-9e69-9c4850f677ce tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:27.710170 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c97d4b5a-34a2-48f9-9e69-9c4850f677ce tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:27.711614 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c97d4b5a-34a2-48f9-9e69-9c4850f677ce tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:27.877617 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-c97d4b5a-34a2-48f9-9e69-9c4850f677ce tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:27.886558 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-c97d4b5a-34a2-48f9-9e69-9c4850f677ce tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:27.888091 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-c97d4b5a-34a2-48f9-9e69-9c4850f677ce tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:27.889378 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-c97d4b5a-34a2-48f9-9e69-9c4850f677ce tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1740 microversion: 2.20 time: 0.197221 Mar 08 15:27:27.890162 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1173/2562] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:27:27 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1740 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:27:28.649364 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-2c9eb32b-563f-4ec7-8857-c948c71d5a07 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:28.652713 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-2c9eb32b-563f-4ec7-8857-c948c71d5a07 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: f813bc72-7a86-47dd-b619-d20ef86a30ea] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:28.664831 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2c9eb32b-563f-4ec7-8857-c948c71d5a07 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:28.665703 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2c9eb32b-563f-4ec7-8857-c948c71d5a07 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:28.666695 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2c9eb32b-563f-4ec7-8857-c948c71d5a07 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:28.667299 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2c9eb32b-563f-4ec7-8857-c948c71d5a07 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:28.842589 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-2c9eb32b-563f-4ec7-8857-c948c71d5a07 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282b16dbcb1648c39afa0f7ed2d5dbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf1dc206f041ca91a40149aab30dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:28.850660 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-2c9eb32b-563f-4ec7-8857-c948c71d5a07 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/f813bc72-7a86-47dd-b619-d20ef86a30ea" status: 200 len: 1367 microversion: 2.1 time: 0.205054 Mar 08 15:27:28.851407 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1390/2563] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:27:28 2022] GET /compute/v2.1/servers/f813bc72-7a86-47dd-b619-d20ef86a30ea => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:27:28.912591 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-eae3f360-8463-486c-b314-a568aeffbb94 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:28.913224 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-eae3f360-8463-486c-b314-a568aeffbb94 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:28.919788 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-eae3f360-8463-486c-b314-a568aeffbb94 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:28.920278 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-eae3f360-8463-486c-b314-a568aeffbb94 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:28.921060 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-eae3f360-8463-486c-b314-a568aeffbb94 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:28.921510 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-eae3f360-8463-486c-b314-a568aeffbb94 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:29.064977 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-eae3f360-8463-486c-b314-a568aeffbb94 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:29.073831 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-eae3f360-8463-486c-b314-a568aeffbb94 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:29.075645 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-eae3f360-8463-486c-b314-a568aeffbb94 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:29.076961 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-eae3f360-8463-486c-b314-a568aeffbb94 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1740 microversion: 2.20 time: 0.168587 Mar 08 15:27:29.077513 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1174/2564] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:27:28 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:27:29.867865 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-347039a5-bdb6-4dd9-9880-bc42d80fb04c tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:29.868522 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-347039a5-bdb6-4dd9-9880-bc42d80fb04c tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: f813bc72-7a86-47dd-b619-d20ef86a30ea] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:29.874925 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-347039a5-bdb6-4dd9-9880-bc42d80fb04c tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:29.875387 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-347039a5-bdb6-4dd9-9880-bc42d80fb04c tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:29.876716 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-347039a5-bdb6-4dd9-9880-bc42d80fb04c tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:29.877162 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-347039a5-bdb6-4dd9-9880-bc42d80fb04c tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:30.025333 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-347039a5-bdb6-4dd9-9880-bc42d80fb04c tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282b16dbcb1648c39afa0f7ed2d5dbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf1dc206f041ca91a40149aab30dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:30.033774 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-347039a5-bdb6-4dd9-9880-bc42d80fb04c tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/f813bc72-7a86-47dd-b619-d20ef86a30ea" status: 200 len: 1367 microversion: 2.1 time: 0.169775 Mar 08 15:27:30.034489 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1391/2565] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:27:29 2022] GET /compute/v2.1/servers/f813bc72-7a86-47dd-b619-d20ef86a30ea => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:27:30.096102 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-ef7dab51-78f1-4c14-b222-fc5affd519f5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:30.096718 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-ef7dab51-78f1-4c14-b222-fc5affd519f5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:30.103541 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ef7dab51-78f1-4c14-b222-fc5affd519f5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:30.103999 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ef7dab51-78f1-4c14-b222-fc5affd519f5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:30.104768 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ef7dab51-78f1-4c14-b222-fc5affd519f5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:30.105387 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ef7dab51-78f1-4c14-b222-fc5affd519f5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:30.254588 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-ef7dab51-78f1-4c14-b222-fc5affd519f5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:30.263786 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-ef7dab51-78f1-4c14-b222-fc5affd519f5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:30.266050 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-ef7dab51-78f1-4c14-b222-fc5affd519f5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:30.268254 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-ef7dab51-78f1-4c14-b222-fc5affd519f5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1740 microversion: 2.20 time: 0.176855 Mar 08 15:27:30.269104 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1175/2566] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:27:30 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1740 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:27:31.050772 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-8105c3ae-9d80-4b13-9251-c2739f76428d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:31.052117 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-8105c3ae-9d80-4b13-9251-c2739f76428d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: f813bc72-7a86-47dd-b619-d20ef86a30ea] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:31.059747 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8105c3ae-9d80-4b13-9251-c2739f76428d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:31.060284 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8105c3ae-9d80-4b13-9251-c2739f76428d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:31.061289 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8105c3ae-9d80-4b13-9251-c2739f76428d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:31.061795 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8105c3ae-9d80-4b13-9251-c2739f76428d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:31.208286 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-8105c3ae-9d80-4b13-9251-c2739f76428d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282b16dbcb1648c39afa0f7ed2d5dbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf1dc206f041ca91a40149aab30dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:31.216583 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-8105c3ae-9d80-4b13-9251-c2739f76428d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/f813bc72-7a86-47dd-b619-d20ef86a30ea" status: 200 len: 1367 microversion: 2.1 time: 0.169827 Mar 08 15:27:31.217155 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1392/2567] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:27:31 2022] GET /compute/v2.1/servers/f813bc72-7a86-47dd-b619-d20ef86a30ea => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:27:31.288242 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-6adbdfa8-c77c-46d6-8c56-9355185cb526 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:31.289741 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-6adbdfa8-c77c-46d6-8c56-9355185cb526 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:31.297338 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6adbdfa8-c77c-46d6-8c56-9355185cb526 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:31.298178 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6adbdfa8-c77c-46d6-8c56-9355185cb526 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:31.299349 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6adbdfa8-c77c-46d6-8c56-9355185cb526 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:31.300027 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6adbdfa8-c77c-46d6-8c56-9355185cb526 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:31.422681 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [req-e0e3388d-06d5-49da-8d2f-6bc8a11861b5 req-8aa8606b-7c80-4861-9300-6ec5998d1e02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f813bc72-7a86-47dd-b619-d20ef86a30ea", "name": "network-vif-plugged", "status": "completed", "tag": "dd224896-3e3e-4304-8c16-ebdc412f2f7f"}]} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:27:31.435649 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-e0e3388d-06d5-49da-8d2f-6bc8a11861b5 req-8aa8606b-7c80-4861-9300-6ec5998d1e02 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:31.436122 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-e0e3388d-06d5-49da-8d2f-6bc8a11861b5 req-8aa8606b-7c80-4861-9300-6ec5998d1e02 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:31.451493 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.compute.server_external_events [req-e0e3388d-06d5-49da-8d2f-6bc8a11861b5 req-8aa8606b-7c80-4861-9300-6ec5998d1e02 service nova] Creating event network-vif-plugged:dd224896-3e3e-4304-8c16-ebdc412f2f7f for instance f813bc72-7a86-47dd-b619-d20ef86a30ea on hv-cinder-83009 Mar 08 15:27:31.462307 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [req-e0e3388d-06d5-49da-8d2f-6bc8a11861b5 req-8aa8606b-7c80-4861-9300-6ec5998d1e02 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043059 Mar 08 15:27:31.462943 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1393/2568] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 15:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 15:27:31.465269 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-6adbdfa8-c77c-46d6-8c56-9355185cb526 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:31.484361 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-6adbdfa8-c77c-46d6-8c56-9355185cb526 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:31.486598 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-6adbdfa8-c77c-46d6-8c56-9355185cb526 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:31.489372 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-6adbdfa8-c77c-46d6-8c56-9355185cb526 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1740 microversion: 2.20 time: 0.204614 Mar 08 15:27:31.500842 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1176/2569] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:27:31 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1740 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:27:32.235704 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c99eb285-8efa-4f07-aaec-34fe4637e083 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:32.236792 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-c99eb285-8efa-4f07-aaec-34fe4637e083 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: f813bc72-7a86-47dd-b619-d20ef86a30ea] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:32.243879 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c99eb285-8efa-4f07-aaec-34fe4637e083 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:32.244326 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c99eb285-8efa-4f07-aaec-34fe4637e083 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:32.245366 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c99eb285-8efa-4f07-aaec-34fe4637e083 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:32.246201 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c99eb285-8efa-4f07-aaec-34fe4637e083 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:32.433069 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-c99eb285-8efa-4f07-aaec-34fe4637e083 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282b16dbcb1648c39afa0f7ed2d5dbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf1dc206f041ca91a40149aab30dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:32.444312 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-c99eb285-8efa-4f07-aaec-34fe4637e083 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/f813bc72-7a86-47dd-b619-d20ef86a30ea" status: 200 len: 1367 microversion: 2.1 time: 0.212322 Mar 08 15:27:32.444650 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1394/2570] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:27:32 2022] GET /compute/v2.1/servers/f813bc72-7a86-47dd-b619-d20ef86a30ea => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:27:32.510297 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-216e9b3c-3f16-425c-994c-f9b3e459c125 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:32.511593 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-216e9b3c-3f16-425c-994c-f9b3e459c125 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:32.519192 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-216e9b3c-3f16-425c-994c-f9b3e459c125 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:32.519644 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-216e9b3c-3f16-425c-994c-f9b3e459c125 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:32.520434 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-216e9b3c-3f16-425c-994c-f9b3e459c125 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:32.520867 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-216e9b3c-3f16-425c-994c-f9b3e459c125 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:32.695191 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-216e9b3c-3f16-425c-994c-f9b3e459c125 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:32.702126 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-216e9b3c-3f16-425c-994c-f9b3e459c125 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:32.703625 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-216e9b3c-3f16-425c-994c-f9b3e459c125 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:32.705837 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-216e9b3c-3f16-425c-994c-f9b3e459c125 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1740 microversion: 2.20 time: 0.200955 Mar 08 15:27:32.706800 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1177/2571] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:27:32 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1740 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:27:33.461271 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-218feef6-1d60-49a4-97b8-4913e1c359e0 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:33.461969 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-218feef6-1d60-49a4-97b8-4913e1c359e0 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: f813bc72-7a86-47dd-b619-d20ef86a30ea] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:33.468409 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-218feef6-1d60-49a4-97b8-4913e1c359e0 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:33.468936 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-218feef6-1d60-49a4-97b8-4913e1c359e0 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:33.470351 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-218feef6-1d60-49a4-97b8-4913e1c359e0 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:33.470866 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-218feef6-1d60-49a4-97b8-4913e1c359e0 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:33.623907 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-218feef6-1d60-49a4-97b8-4913e1c359e0 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282b16dbcb1648c39afa0f7ed2d5dbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf1dc206f041ca91a40149aab30dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:33.635587 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-218feef6-1d60-49a4-97b8-4913e1c359e0 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/f813bc72-7a86-47dd-b619-d20ef86a30ea" status: 200 len: 1558 microversion: 2.1 time: 0.178030 Mar 08 15:27:33.647181 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1395/2572] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:27:33 2022] GET /compute/v2.1/servers/f813bc72-7a86-47dd-b619-d20ef86a30ea => generated 1558 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:27:33.652813 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-3944347f-b127-49d6-906d-dd64c8555029 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:33.653589 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-3944347f-b127-49d6-906d-dd64c8555029 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: f813bc72-7a86-47dd-b619-d20ef86a30ea] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:33.661008 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3944347f-b127-49d6-906d-dd64c8555029 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:33.661544 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3944347f-b127-49d6-906d-dd64c8555029 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:33.662357 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3944347f-b127-49d6-906d-dd64c8555029 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:33.662908 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3944347f-b127-49d6-906d-dd64c8555029 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:33.725537 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-41937adb-e3a1-4538-81a5-08bf80bd0475 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:33.726606 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-41937adb-e3a1-4538-81a5-08bf80bd0475 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:33.735474 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-41937adb-e3a1-4538-81a5-08bf80bd0475 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:33.736337 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-41937adb-e3a1-4538-81a5-08bf80bd0475 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:33.737928 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-41937adb-e3a1-4538-81a5-08bf80bd0475 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:33.738654 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-41937adb-e3a1-4538-81a5-08bf80bd0475 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:33.760795 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-3944347f-b127-49d6-906d-dd64c8555029 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/f813bc72-7a86-47dd-b619-d20ef86a30ea/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.111744 Mar 08 15:27:33.766893 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1178/2573] 10.222.0.30 () {58 vars in 1274 bytes} [Tue Mar 8 15:27:33 2022] GET /compute/v2.1/servers/f813bc72-7a86-47dd-b619-d20ef86a30ea/os-interface => generated 285 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:27:34.092867 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-41937adb-e3a1-4538-81a5-08bf80bd0475 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:34.108934 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-41937adb-e3a1-4538-81a5-08bf80bd0475 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:34.112494 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-41937adb-e3a1-4538-81a5-08bf80bd0475 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:34.114291 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-41937adb-e3a1-4538-81a5-08bf80bd0475 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1740 microversion: 2.20 time: 0.392940 Mar 08 15:27:34.115109 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1396/2574] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:27:33 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1740 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:27:35.132591 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-78f6a1e5-8fb0-4e98-9731-0fb2131fd949 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:35.133209 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-78f6a1e5-8fb0-4e98-9731-0fb2131fd949 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:35.140070 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-78f6a1e5-8fb0-4e98-9731-0fb2131fd949 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:35.140534 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-78f6a1e5-8fb0-4e98-9731-0fb2131fd949 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:35.142088 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-78f6a1e5-8fb0-4e98-9731-0fb2131fd949 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:35.142713 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-78f6a1e5-8fb0-4e98-9731-0fb2131fd949 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:35.300492 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [req-61c70cd3-d27e-4402-80f6-71c38cf9aac5 req-cc972362-96bf-4926-9f68-649d7b154476 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f813bc72-7a86-47dd-b619-d20ef86a30ea", "tag": "dd224896-3e3e-4304-8c16-ebdc412f2f7f"}]} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:27:35.305274 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-78f6a1e5-8fb0-4e98-9731-0fb2131fd949 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:35.310131 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-61c70cd3-d27e-4402-80f6-71c38cf9aac5 req-cc972362-96bf-4926-9f68-649d7b154476 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:35.310857 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-61c70cd3-d27e-4402-80f6-71c38cf9aac5 req-cc972362-96bf-4926-9f68-649d7b154476 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:35.313900 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-78f6a1e5-8fb0-4e98-9731-0fb2131fd949 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:35.315687 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-78f6a1e5-8fb0-4e98-9731-0fb2131fd949 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:35.316849 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-78f6a1e5-8fb0-4e98-9731-0fb2131fd949 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1740 microversion: 2.20 time: 0.188104 Mar 08 15:27:35.317591 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1179/2575] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:27:35 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:27:35.324927 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.compute.server_external_events [req-61c70cd3-d27e-4402-80f6-71c38cf9aac5 req-cc972362-96bf-4926-9f68-649d7b154476 service nova] Creating event network-changed:dd224896-3e3e-4304-8c16-ebdc412f2f7f for instance f813bc72-7a86-47dd-b619-d20ef86a30ea on hv-cinder-83009 Mar 08 15:27:35.330638 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [req-61c70cd3-d27e-4402-80f6-71c38cf9aac5 req-cc972362-96bf-4926-9f68-649d7b154476 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033702 Mar 08 15:27:35.331496 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1397/2576] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 15:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:27:36.336344 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-773e8ab5-005c-4a0a-ae56-54675f03823d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:36.336953 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-773e8ab5-005c-4a0a-ae56-54675f03823d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:36.343109 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-773e8ab5-005c-4a0a-ae56-54675f03823d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:36.343557 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-773e8ab5-005c-4a0a-ae56-54675f03823d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:36.344311 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-773e8ab5-005c-4a0a-ae56-54675f03823d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:36.345348 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-773e8ab5-005c-4a0a-ae56-54675f03823d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:36.479610 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-773e8ab5-005c-4a0a-ae56-54675f03823d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:36.487420 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-773e8ab5-005c-4a0a-ae56-54675f03823d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:36.488920 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-773e8ab5-005c-4a0a-ae56-54675f03823d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:36.490089 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-773e8ab5-005c-4a0a-ae56-54675f03823d tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1722 microversion: 2.20 time: 0.157642 Mar 08 15:27:36.490641 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1180/2577] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:27:36 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:27:37.509320 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-a456e13f-517e-429e-bc24-2986040454e5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:37.510083 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-a456e13f-517e-429e-bc24-2986040454e5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:37.516275 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a456e13f-517e-429e-bc24-2986040454e5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:37.516868 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a456e13f-517e-429e-bc24-2986040454e5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:37.517824 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a456e13f-517e-429e-bc24-2986040454e5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:37.518296 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a456e13f-517e-429e-bc24-2986040454e5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:37.650114 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-a456e13f-517e-429e-bc24-2986040454e5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:37.658747 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-a456e13f-517e-429e-bc24-2986040454e5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:37.660243 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-a456e13f-517e-429e-bc24-2986040454e5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:37.661384 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-a456e13f-517e-429e-bc24-2986040454e5 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1722 microversion: 2.20 time: 0.156875 Mar 08 15:27:37.661956 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1398/2578] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:27:37 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:27:38.679384 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-fd7cd916-7553-45a2-866c-17f2840c36ce tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:38.679984 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-fd7cd916-7553-45a2-866c-17f2840c36ce tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:38.686190 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fd7cd916-7553-45a2-866c-17f2840c36ce tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:38.686643 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fd7cd916-7553-45a2-866c-17f2840c36ce tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:38.687400 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fd7cd916-7553-45a2-866c-17f2840c36ce tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:38.687835 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fd7cd916-7553-45a2-866c-17f2840c36ce tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:38.823006 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-fd7cd916-7553-45a2-866c-17f2840c36ce tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:38.831068 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-fd7cd916-7553-45a2-866c-17f2840c36ce tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:38.832588 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-fd7cd916-7553-45a2-866c-17f2840c36ce tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:38.833755 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-fd7cd916-7553-45a2-866c-17f2840c36ce tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1665 microversion: 2.20 time: 0.158264 Mar 08 15:27:38.834340 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1181/2579] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:27:38 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1665 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:27:38.851424 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-fe996f29-cbe8-40a6-8766-31e892db4954 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c4f67f4-5a38-416a-a884-405b5978dd79"}} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:27:38.852489 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-fe996f29-cbe8-40a6-8766-31e892db4954 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:38.858856 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fe996f29-cbe8-40a6-8766-31e892db4954 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:38.859311 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fe996f29-cbe8-40a6-8766-31e892db4954 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:38.860080 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fe996f29-cbe8-40a6-8766-31e892db4954 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:38.860520 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fe996f29-cbe8-40a6-8766-31e892db4954 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:39.110729 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-fe996f29-cbe8-40a6-8766-31e892db4954 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "POST /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.263267 Mar 08 15:27:39.111347 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1399/2580] 10.222.0.30 () {62 vars in 1363 bytes} [Tue Mar 8 15:27:38 2022] POST /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64/os-volume_attachments => generated 188 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 15:27:39.219713 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-fd927df9-f60f-4c73-9831-f92d7674af06 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:39.220233 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-fd927df9-f60f-4c73-9831-f92d7674af06 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:39.226821 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fd927df9-f60f-4c73-9831-f92d7674af06 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:39.227265 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fd927df9-f60f-4c73-9831-f92d7674af06 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:39.228022 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fd927df9-f60f-4c73-9831-f92d7674af06 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:39.228454 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-fd927df9-f60f-4c73-9831-f92d7674af06 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:39.348485 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [req-33a8c236-6b4e-4bdc-a570-c638f5e6f4e3 req-a9e0dc2c-64d2-431f-b542-77d5908199df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c051cc3d-ac34-4fe1-8b55-010166d2cb64", "name": "network-vif-unplugged", "status": "completed", "tag": "7068a3ed-1414-4ab7-8c70-a96a7135062c"}]} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:27:39.357529 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-33a8c236-6b4e-4bdc-a570-c638f5e6f4e3 req-a9e0dc2c-64d2-431f-b542-77d5908199df service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:39.358013 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-33a8c236-6b4e-4bdc-a570-c638f5e6f4e3 req-a9e0dc2c-64d2-431f-b542-77d5908199df service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:39.371594 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.compute.server_external_events [req-33a8c236-6b4e-4bdc-a570-c638f5e6f4e3 req-a9e0dc2c-64d2-431f-b542-77d5908199df service nova] Unable to find a host for instance c051cc3d-ac34-4fe1-8b55-010166d2cb64. Dropping event network-vif-unplugged {{(pid=128352) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Mar 08 15:27:39.372486 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [req-33a8c236-6b4e-4bdc-a570-c638f5e6f4e3 req-a9e0dc2c-64d2-431f-b542-77d5908199df service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028803 Mar 08 15:27:39.373444 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1400/2581] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 15:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Mar 08 15:27:39.463752 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-fd927df9-f60f-4c73-9831-f92d7674af06 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64/os-volume_attachments/4c4f67f4-5a38-416a-a884-405b5978dd79" status: 202 len: 0 microversion: 2.20 time: 0.247936 Mar 08 15:27:39.464328 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1182/2582] 10.222.0.30 () {60 vars in 1456 bytes} [Tue Mar 8 15:27:39 2022] DELETE /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64/os-volume_attachments/4c4f67f4-5a38-416a-a884-405b5978dd79 => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 08 15:27:39.516885 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b05ec4da-0997-4ff1-8b10-519dc5edf169 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:27:39.517451 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b05ec4da-0997-4ff1-8b10-519dc5edf169 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:39.523849 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b05ec4da-0997-4ff1-8b10-519dc5edf169 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:39.524297 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b05ec4da-0997-4ff1-8b10-519dc5edf169 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:39.525051 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b05ec4da-0997-4ff1-8b10-519dc5edf169 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:39.525489 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b05ec4da-0997-4ff1-8b10-519dc5edf169 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:39.651986 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b05ec4da-0997-4ff1-8b10-519dc5edf169 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [b08f76d4-79f5-4a7a-9c74-6c0b8ff0cb34] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 08 15:27:40.659967 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO oslo.messaging._drivers.impl_rabbit [None req-b05ec4da-0997-4ff1-8b10-519dc5edf169 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [b08f76d4-79f5-4a7a-9c74-6c0b8ff0cb34] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 47200. Mar 08 15:27:40.663229 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b05ec4da-0997-4ff1-8b10-519dc5edf169 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "POST /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64/action" status: 202 len: 0 microversion: 2.20 time: 1.150297 Mar 08 15:27:40.663837 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1401/2583] 10.222.0.30 () {62 vars in 1318 bytes} [Tue Mar 8 15:27:39 2022] POST /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64/action => generated 0 bytes in 1151 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 08 15:27:40.671702 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-a18372df-cd4e-410e-8232-b85db7fe7ec9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:40.672315 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-a18372df-cd4e-410e-8232-b85db7fe7ec9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:40.682476 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a18372df-cd4e-410e-8232-b85db7fe7ec9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:40.682941 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a18372df-cd4e-410e-8232-b85db7fe7ec9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:40.683788 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a18372df-cd4e-410e-8232-b85db7fe7ec9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:40.684158 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a18372df-cd4e-410e-8232-b85db7fe7ec9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:40.817934 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-a18372df-cd4e-410e-8232-b85db7fe7ec9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:40.825628 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-a18372df-cd4e-410e-8232-b85db7fe7ec9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:40.827160 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-a18372df-cd4e-410e-8232-b85db7fe7ec9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:40.828297 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-a18372df-cd4e-410e-8232-b85db7fe7ec9 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1673 microversion: 2.20 time: 0.160444 Mar 08 15:27:40.828842 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1183/2584] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:27:40 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:27:41.848814 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-992ea018-2d00-47e9-87ea-75948faf0845 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:41.849419 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-992ea018-2d00-47e9-87ea-75948faf0845 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:41.856134 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-992ea018-2d00-47e9-87ea-75948faf0845 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:41.856579 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-992ea018-2d00-47e9-87ea-75948faf0845 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:41.857343 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-992ea018-2d00-47e9-87ea-75948faf0845 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:41.857777 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-992ea018-2d00-47e9-87ea-75948faf0845 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:41.993586 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-992ea018-2d00-47e9-87ea-75948faf0845 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:42.001379 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-992ea018-2d00-47e9-87ea-75948faf0845 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:42.003071 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-992ea018-2d00-47e9-87ea-75948faf0845 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:42.004235 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-992ea018-2d00-47e9-87ea-75948faf0845 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1731 microversion: 2.20 time: 0.160892 Mar 08 15:27:42.004794 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1402/2585] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:27:41 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:27:43.023152 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-f3af936a-914b-4643-9153-def21e457b67 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:43.023769 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-f3af936a-914b-4643-9153-def21e457b67 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:43.030216 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f3af936a-914b-4643-9153-def21e457b67 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:43.030681 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f3af936a-914b-4643-9153-def21e457b67 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:43.031460 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f3af936a-914b-4643-9153-def21e457b67 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:43.031907 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f3af936a-914b-4643-9153-def21e457b67 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:43.175602 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-f3af936a-914b-4643-9153-def21e457b67 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:43.183688 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-f3af936a-914b-4643-9153-def21e457b67 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:43.185581 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-f3af936a-914b-4643-9153-def21e457b67 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:43.187014 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-f3af936a-914b-4643-9153-def21e457b67 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1731 microversion: 2.20 time: 0.167772 Mar 08 15:27:43.198890 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1184/2586] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:27:43 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:27:44.207747 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-2507d6be-c055-4cd1-ac2f-5c2229bae42e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:44.208306 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-2507d6be-c055-4cd1-ac2f-5c2229bae42e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:44.217530 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2507d6be-c055-4cd1-ac2f-5c2229bae42e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:44.218023 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2507d6be-c055-4cd1-ac2f-5c2229bae42e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:44.218805 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2507d6be-c055-4cd1-ac2f-5c2229bae42e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:44.219242 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2507d6be-c055-4cd1-ac2f-5c2229bae42e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:44.365461 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-2507d6be-c055-4cd1-ac2f-5c2229bae42e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:44.373537 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-2507d6be-c055-4cd1-ac2f-5c2229bae42e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:44.375069 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-2507d6be-c055-4cd1-ac2f-5c2229bae42e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:44.376210 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-2507d6be-c055-4cd1-ac2f-5c2229bae42e tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1731 microversion: 2.20 time: 0.174029 Mar 08 15:27:44.376829 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1403/2587] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:27:44 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:27:45.396611 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-2e443b48-ee66-4898-9481-c9c56ffa561a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:45.397239 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-2e443b48-ee66-4898-9481-c9c56ffa561a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:45.403919 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2e443b48-ee66-4898-9481-c9c56ffa561a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:45.404537 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2e443b48-ee66-4898-9481-c9c56ffa561a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:45.405318 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2e443b48-ee66-4898-9481-c9c56ffa561a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:45.405757 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2e443b48-ee66-4898-9481-c9c56ffa561a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:45.547461 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-2e443b48-ee66-4898-9481-c9c56ffa561a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:45.556258 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-2e443b48-ee66-4898-9481-c9c56ffa561a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:45.557839 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-2e443b48-ee66-4898-9481-c9c56ffa561a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:45.559051 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-2e443b48-ee66-4898-9481-c9c56ffa561a tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1731 microversion: 2.20 time: 0.167341 Mar 08 15:27:45.559610 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1185/2588] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:27:45 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:27:46.576906 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-e283b407-7c3c-4454-9585-a137d0623f21 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:46.577551 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-e283b407-7c3c-4454-9585-a137d0623f21 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:46.585295 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e283b407-7c3c-4454-9585-a137d0623f21 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:46.585745 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e283b407-7c3c-4454-9585-a137d0623f21 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:46.586538 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e283b407-7c3c-4454-9585-a137d0623f21 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:46.586971 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e283b407-7c3c-4454-9585-a137d0623f21 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:46.728821 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-e283b407-7c3c-4454-9585-a137d0623f21 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:46.737317 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-e283b407-7c3c-4454-9585-a137d0623f21 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:46.739053 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-e283b407-7c3c-4454-9585-a137d0623f21 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:46.740205 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-e283b407-7c3c-4454-9585-a137d0623f21 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1731 microversion: 2.20 time: 0.167269 Mar 08 15:27:46.741088 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1404/2589] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:27:46 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:27:47.759259 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-ec5c37a9-e711-4af8-ab32-f6caf393d013 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:47.760021 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-ec5c37a9-e711-4af8-ab32-f6caf393d013 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:47.766448 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ec5c37a9-e711-4af8-ab32-f6caf393d013 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:47.766902 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ec5c37a9-e711-4af8-ab32-f6caf393d013 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:47.768431 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ec5c37a9-e711-4af8-ab32-f6caf393d013 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:47.768995 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ec5c37a9-e711-4af8-ab32-f6caf393d013 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:47.909405 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-ec5c37a9-e711-4af8-ab32-f6caf393d013 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:47.917825 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-ec5c37a9-e711-4af8-ab32-f6caf393d013 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:47.919372 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-ec5c37a9-e711-4af8-ab32-f6caf393d013 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:47.920547 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-ec5c37a9-e711-4af8-ab32-f6caf393d013 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1731 microversion: 2.20 time: 0.165226 Mar 08 15:27:47.921443 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1186/2590] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:27:47 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:27:48.940223 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3cdfc5d7-acf3-49b5-a7ad-1c485b21e0a2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:48.940908 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-3cdfc5d7-acf3-49b5-a7ad-1c485b21e0a2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:48.948370 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3cdfc5d7-acf3-49b5-a7ad-1c485b21e0a2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:48.948370 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3cdfc5d7-acf3-49b5-a7ad-1c485b21e0a2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:48.948667 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3cdfc5d7-acf3-49b5-a7ad-1c485b21e0a2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:48.948940 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3cdfc5d7-acf3-49b5-a7ad-1c485b21e0a2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:49.100656 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-3cdfc5d7-acf3-49b5-a7ad-1c485b21e0a2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:49.108736 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-3cdfc5d7-acf3-49b5-a7ad-1c485b21e0a2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:49.110297 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-3cdfc5d7-acf3-49b5-a7ad-1c485b21e0a2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:49.112076 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-3cdfc5d7-acf3-49b5-a7ad-1c485b21e0a2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1731 microversion: 2.20 time: 0.175375 Mar 08 15:27:49.123117 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1405/2591] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:27:48 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1731 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:27:50.130800 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-cbaf663a-c1be-4822-b1fe-88999b6d7e99 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:50.131453 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-cbaf663a-c1be-4822-b1fe-88999b6d7e99 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:50.137688 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cbaf663a-c1be-4822-b1fe-88999b6d7e99 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:50.138198 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cbaf663a-c1be-4822-b1fe-88999b6d7e99 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:50.138975 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cbaf663a-c1be-4822-b1fe-88999b6d7e99 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:50.139409 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-cbaf663a-c1be-4822-b1fe-88999b6d7e99 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:50.343808 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-cbaf663a-c1be-4822-b1fe-88999b6d7e99 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:50.361883 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-cbaf663a-c1be-4822-b1fe-88999b6d7e99 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:50.361883 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-cbaf663a-c1be-4822-b1fe-88999b6d7e99 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:50.361883 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-cbaf663a-c1be-4822-b1fe-88999b6d7e99 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1731 microversion: 2.20 time: 0.230168 Mar 08 15:27:50.370025 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1187/2592] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:27:50 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1731 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:27:51.376475 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-53e72419-6b08-45d3-b00a-9f46726b81de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:51.377726 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-53e72419-6b08-45d3-b00a-9f46726b81de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:51.383939 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-53e72419-6b08-45d3-b00a-9f46726b81de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:51.384386 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-53e72419-6b08-45d3-b00a-9f46726b81de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:51.385142 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-53e72419-6b08-45d3-b00a-9f46726b81de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:51.385578 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-53e72419-6b08-45d3-b00a-9f46726b81de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:51.525500 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-53e72419-6b08-45d3-b00a-9f46726b81de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:51.533410 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-53e72419-6b08-45d3-b00a-9f46726b81de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:51.535043 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-53e72419-6b08-45d3-b00a-9f46726b81de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:51.536188 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-53e72419-6b08-45d3-b00a-9f46726b81de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1731 microversion: 2.20 time: 0.163579 Mar 08 15:27:51.536742 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1406/2593] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:27:51 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:27:52.554049 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-a2d14247-144c-4236-8244-0c60cac59f40 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:52.554665 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-a2d14247-144c-4236-8244-0c60cac59f40 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:52.560942 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a2d14247-144c-4236-8244-0c60cac59f40 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:52.561399 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a2d14247-144c-4236-8244-0c60cac59f40 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:52.562202 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a2d14247-144c-4236-8244-0c60cac59f40 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:52.562648 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a2d14247-144c-4236-8244-0c60cac59f40 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:52.691673 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-a2d14247-144c-4236-8244-0c60cac59f40 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:52.699333 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-a2d14247-144c-4236-8244-0c60cac59f40 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:52.700843 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-a2d14247-144c-4236-8244-0c60cac59f40 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:52.702038 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-a2d14247-144c-4236-8244-0c60cac59f40 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1731 microversion: 2.20 time: 0.151917 Mar 08 15:27:52.702598 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1188/2594] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:27:52 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 15:27:53.721743 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f3d6c35c-2198-4c20-8de7-5751c4c490ff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:53.722388 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f3d6c35c-2198-4c20-8de7-5751c4c490ff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:53.728771 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f3d6c35c-2198-4c20-8de7-5751c4c490ff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:53.729250 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f3d6c35c-2198-4c20-8de7-5751c4c490ff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:53.730059 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f3d6c35c-2198-4c20-8de7-5751c4c490ff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:53.730496 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f3d6c35c-2198-4c20-8de7-5751c4c490ff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:53.864109 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f3d6c35c-2198-4c20-8de7-5751c4c490ff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:53.871932 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f3d6c35c-2198-4c20-8de7-5751c4c490ff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:53.873444 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-f3d6c35c-2198-4c20-8de7-5751c4c490ff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:53.874630 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f3d6c35c-2198-4c20-8de7-5751c4c490ff tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1731 microversion: 2.20 time: 0.158063 Mar 08 15:27:53.875185 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1407/2595] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:27:53 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:27:54.893207 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-9556e1ff-dab4-4b2b-92a0-451fb6d23fb2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:54.893808 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-9556e1ff-dab4-4b2b-92a0-451fb6d23fb2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:54.900312 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9556e1ff-dab4-4b2b-92a0-451fb6d23fb2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:54.900810 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9556e1ff-dab4-4b2b-92a0-451fb6d23fb2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:54.901580 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9556e1ff-dab4-4b2b-92a0-451fb6d23fb2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:54.902057 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9556e1ff-dab4-4b2b-92a0-451fb6d23fb2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:55.035288 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-9556e1ff-dab4-4b2b-92a0-451fb6d23fb2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:55.043300 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-9556e1ff-dab4-4b2b-92a0-451fb6d23fb2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:55.044806 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-9556e1ff-dab4-4b2b-92a0-451fb6d23fb2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:55.046011 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-9556e1ff-dab4-4b2b-92a0-451fb6d23fb2 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1731 microversion: 2.20 time: 0.156738 Mar 08 15:27:55.046565 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1189/2596] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:27:54 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:27:55.617415 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [req-5e18c5da-a613-4470-9728-5e6af053a058 req-6f827724-f0f2-44d1-853d-e20c536bd04d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c051cc3d-ac34-4fe1-8b55-010166d2cb64", "name": "network-vif-plugged", "status": "completed", "tag": "7068a3ed-1414-4ab7-8c70-a96a7135062c"}]} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:27:55.625954 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-5e18c5da-a613-4470-9728-5e6af053a058 req-6f827724-f0f2-44d1-853d-e20c536bd04d service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:55.626456 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-5e18c5da-a613-4470-9728-5e6af053a058 req-6f827724-f0f2-44d1-853d-e20c536bd04d service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:55.637607 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.compute.server_external_events [req-5e18c5da-a613-4470-9728-5e6af053a058 req-6f827724-f0f2-44d1-853d-e20c536bd04d service nova] Creating event network-vif-plugged:7068a3ed-1414-4ab7-8c70-a96a7135062c for instance c051cc3d-ac34-4fe1-8b55-010166d2cb64 on hv-cinder-83009 Mar 08 15:27:55.644354 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [req-5e18c5da-a613-4470-9728-5e6af053a058 req-6f827724-f0f2-44d1-853d-e20c536bd04d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030579 Mar 08 15:27:55.644957 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1408/2597] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 15:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:27:56.064051 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b00bb942-fc56-45c4-9e62-61697117d0cb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:56.065015 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-b00bb942-fc56-45c4-9e62-61697117d0cb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:56.071102 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b00bb942-fc56-45c4-9e62-61697117d0cb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:56.071556 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b00bb942-fc56-45c4-9e62-61697117d0cb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:56.072323 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b00bb942-fc56-45c4-9e62-61697117d0cb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:56.072763 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b00bb942-fc56-45c4-9e62-61697117d0cb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:56.204237 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-b00bb942-fc56-45c4-9e62-61697117d0cb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:56.212719 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-b00bb942-fc56-45c4-9e62-61697117d0cb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:56.214297 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-b00bb942-fc56-45c4-9e62-61697117d0cb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:56.215451 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-b00bb942-fc56-45c4-9e62-61697117d0cb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1731 microversion: 2.20 time: 0.155396 Mar 08 15:27:56.216041 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1190/2598] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:27:56 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:27:57.235163 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-9f0dd742-0ae1-4f84-891b-c69fa70fb62c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:57.236645 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-9f0dd742-0ae1-4f84-891b-c69fa70fb62c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:57.243042 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9f0dd742-0ae1-4f84-891b-c69fa70fb62c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:57.243615 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9f0dd742-0ae1-4f84-891b-c69fa70fb62c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:57.244389 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9f0dd742-0ae1-4f84-891b-c69fa70fb62c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:57.244823 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9f0dd742-0ae1-4f84-891b-c69fa70fb62c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:57.390820 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-9f0dd742-0ae1-4f84-891b-c69fa70fb62c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:57.399793 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-9f0dd742-0ae1-4f84-891b-c69fa70fb62c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:57.401590 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-9f0dd742-0ae1-4f84-891b-c69fa70fb62c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:57.402789 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-9f0dd742-0ae1-4f84-891b-c69fa70fb62c tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1731 microversion: 2.20 time: 0.172639 Mar 08 15:27:57.403600 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1409/2599] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:27:57 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:27:58.421792 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-0a172eb8-c411-424c-bb43-a133747a5889 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:27:58.422431 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-0a172eb8-c411-424c-bb43-a133747a5889 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:27:58.429754 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0a172eb8-c411-424c-bb43-a133747a5889 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:58.430236 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0a172eb8-c411-424c-bb43-a133747a5889 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:58.430996 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0a172eb8-c411-424c-bb43-a133747a5889 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:27:58.431435 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0a172eb8-c411-424c-bb43-a133747a5889 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:27:58.566252 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-0a172eb8-c411-424c-bb43-a133747a5889 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:58.573905 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-0a172eb8-c411-424c-bb43-a133747a5889 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:58.575421 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-0a172eb8-c411-424c-bb43-a133747a5889 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:27:58.576563 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-0a172eb8-c411-424c-bb43-a133747a5889 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1718 microversion: 2.20 time: 0.158718 Mar 08 15:27:58.577118 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1191/2600] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:27:58 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1718 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:28:11.185604 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d2c7fe7d-86af-441f-9320-4aef0a7ef411 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:11.186193 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d2c7fe7d-86af-441f-9320-4aef0a7ef411 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: f813bc72-7a86-47dd-b619-d20ef86a30ea] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:28:11.192908 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d2c7fe7d-86af-441f-9320-4aef0a7ef411 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:11.193307 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d2c7fe7d-86af-441f-9320-4aef0a7ef411 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:11.194100 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d2c7fe7d-86af-441f-9320-4aef0a7ef411 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:11.194545 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d2c7fe7d-86af-441f-9320-4aef0a7ef411 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:11.218077 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d2c7fe7d-86af-441f-9320-4aef0a7ef411 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/f813bc72-7a86-47dd-b619-d20ef86a30ea/ips" status: 200 len: 150 microversion: 2.1 time: 0.036449 Mar 08 15:28:11.218632 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1410/2601] 10.222.0.30 () {58 vars in 1247 bytes} [Tue Mar 8 15:28:11 2022] GET /compute/v2.1/servers/f813bc72-7a86-47dd-b619-d20ef86a30ea/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:28:11.229740 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-72119e87-78ee-45ef-a941-69bad9bcdf7e tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7007cf64-dd25-43f2-9821-8f8f60954502"}} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:28:11.230871 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-72119e87-78ee-45ef-a941-69bad9bcdf7e tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: f813bc72-7a86-47dd-b619-d20ef86a30ea] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:28:11.237101 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-72119e87-78ee-45ef-a941-69bad9bcdf7e tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:11.237553 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-72119e87-78ee-45ef-a941-69bad9bcdf7e tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:11.238351 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-72119e87-78ee-45ef-a941-69bad9bcdf7e tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:11.238786 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-72119e87-78ee-45ef-a941-69bad9bcdf7e tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:11.312655 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.wsgi [None req-72119e87-78ee-45ef-a941-69bad9bcdf7e tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] HTTP exception thrown: Invalid volume: volume 7007cf64-dd25-43f2-9821-8f8f60954502 is already attached to instances: 56ade7e6-35ae-4f5b-81ff-9221d246720c Mar 08 15:28:11.313282 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-72119e87-78ee-45ef-a941-69bad9bcdf7e tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Returning 400 to user: Invalid volume: volume 7007cf64-dd25-43f2-9821-8f8f60954502 is already attached to instances: 56ade7e6-35ae-4f5b-81ff-9221d246720c {{(pid=128351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:28:11.315142 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-72119e87-78ee-45ef-a941-69bad9bcdf7e tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "POST /compute/v2.1/servers/f813bc72-7a86-47dd-b619-d20ef86a30ea/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.089499 Mar 08 15:28:11.315680 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1192/2602] 10.222.0.30 () {60 vars in 1322 bytes} [Tue Mar 8 15:28:11 2022] POST /compute/v2.1/servers/f813bc72-7a86-47dd-b619-d20ef86a30ea/os-volume_attachments => generated 174 bytes in 91 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 08 15:28:11.323751 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c606c95b-c004-4c31-91f8-3e1b92b82612 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:11.324250 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-c606c95b-c004-4c31-91f8-3e1b92b82612 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: f813bc72-7a86-47dd-b619-d20ef86a30ea] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:28:11.331298 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c606c95b-c004-4c31-91f8-3e1b92b82612 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:11.331755 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c606c95b-c004-4c31-91f8-3e1b92b82612 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:11.332523 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c606c95b-c004-4c31-91f8-3e1b92b82612 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:11.332963 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c606c95b-c004-4c31-91f8-3e1b92b82612 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:11.356262 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-c606c95b-c004-4c31-91f8-3e1b92b82612 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: f813bc72-7a86-47dd-b619-d20ef86a30ea] Going to try to terminate instance {{(pid=128352) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 15:28:11.430676 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-c606c95b-c004-4c31-91f8-3e1b92b82612 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f813bc72-7a86-47dd-b619-d20ef86a30ea" status: 204 len: 0 microversion: 2.1 time: 0.110362 Mar 08 15:28:11.431314 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1411/2603] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 15:28:11 2022] DELETE /compute/v2.1/servers/f813bc72-7a86-47dd-b619-d20ef86a30ea => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 15:28:11.440020 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-bd3e1cdb-78ff-40a8-8a53-32a6c0cf4e00 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:11.440628 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-bd3e1cdb-78ff-40a8-8a53-32a6c0cf4e00 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: f813bc72-7a86-47dd-b619-d20ef86a30ea] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:28:11.446563 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bd3e1cdb-78ff-40a8-8a53-32a6c0cf4e00 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:11.446936 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bd3e1cdb-78ff-40a8-8a53-32a6c0cf4e00 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:11.447687 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bd3e1cdb-78ff-40a8-8a53-32a6c0cf4e00 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:11.448120 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-bd3e1cdb-78ff-40a8-8a53-32a6c0cf4e00 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:11.583720 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-bd3e1cdb-78ff-40a8-8a53-32a6c0cf4e00 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282b16dbcb1648c39afa0f7ed2d5dbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf1dc206f041ca91a40149aab30dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:28:11.590965 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-bd3e1cdb-78ff-40a8-8a53-32a6c0cf4e00 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/f813bc72-7a86-47dd-b619-d20ef86a30ea" status: 200 len: 1682 microversion: 2.1 time: 0.155307 Mar 08 15:28:11.591527 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1193/2604] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:28:11 2022] GET /compute/v2.1/servers/f813bc72-7a86-47dd-b619-d20ef86a30ea => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:28:12.609219 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-8b80dc92-950d-48a1-9029-83123dca9bbf tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:12.609949 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-8b80dc92-950d-48a1-9029-83123dca9bbf tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: f813bc72-7a86-47dd-b619-d20ef86a30ea] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:28:12.616257 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8b80dc92-950d-48a1-9029-83123dca9bbf tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:12.616715 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8b80dc92-950d-48a1-9029-83123dca9bbf tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:12.617481 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8b80dc92-950d-48a1-9029-83123dca9bbf tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:12.617949 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-8b80dc92-950d-48a1-9029-83123dca9bbf tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:12.749414 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-8b80dc92-950d-48a1-9029-83123dca9bbf tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282b16dbcb1648c39afa0f7ed2d5dbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf1dc206f041ca91a40149aab30dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:28:12.756810 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-8b80dc92-950d-48a1-9029-83123dca9bbf tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/f813bc72-7a86-47dd-b619-d20ef86a30ea" status: 200 len: 1682 microversion: 2.1 time: 0.151853 Mar 08 15:28:12.757372 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1412/2605] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:28:12 2022] GET /compute/v2.1/servers/f813bc72-7a86-47dd-b619-d20ef86a30ea => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:28:13.773682 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b393dd66-3e41-47fa-9e78-bcdcccfe4e6e tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:13.774516 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-b393dd66-3e41-47fa-9e78-bcdcccfe4e6e tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: f813bc72-7a86-47dd-b619-d20ef86a30ea] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:28:13.780855 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b393dd66-3e41-47fa-9e78-bcdcccfe4e6e tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:13.781372 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b393dd66-3e41-47fa-9e78-bcdcccfe4e6e tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:13.782312 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b393dd66-3e41-47fa-9e78-bcdcccfe4e6e tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:13.782821 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b393dd66-3e41-47fa-9e78-bcdcccfe4e6e tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:13.874457 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-b393dd66-3e41-47fa-9e78-bcdcccfe4e6e tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282b16dbcb1648c39afa0f7ed2d5dbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf1dc206f041ca91a40149aab30dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:28:13.882775 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-b393dd66-3e41-47fa-9e78-bcdcccfe4e6e tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/f813bc72-7a86-47dd-b619-d20ef86a30ea" status: 200 len: 1614 microversion: 2.1 time: 0.112936 Mar 08 15:28:13.883349 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1194/2606] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:28:13 2022] GET /compute/v2.1/servers/f813bc72-7a86-47dd-b619-d20ef86a30ea => generated 1614 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:28:14.113056 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [req-e85e3a16-23cd-4ee3-9ebd-4e64d1812073 req-b5ab5b99-b4e1-42bb-b901-7c8c9950c7a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f813bc72-7a86-47dd-b619-d20ef86a30ea", "name": "network-vif-deleted", "tag": "dd224896-3e3e-4304-8c16-ebdc412f2f7f"}]} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:28:14.123601 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-e85e3a16-23cd-4ee3-9ebd-4e64d1812073 req-b5ab5b99-b4e1-42bb-b901-7c8c9950c7a5 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:14.124278 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-e85e3a16-23cd-4ee3-9ebd-4e64d1812073 req-b5ab5b99-b4e1-42bb-b901-7c8c9950c7a5 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:14.137315 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.compute.server_external_events [req-e85e3a16-23cd-4ee3-9ebd-4e64d1812073 req-b5ab5b99-b4e1-42bb-b901-7c8c9950c7a5 service nova] Creating event network-vif-deleted:dd224896-3e3e-4304-8c16-ebdc412f2f7f for instance f813bc72-7a86-47dd-b619-d20ef86a30ea on hv-cinder-83009 Mar 08 15:28:14.143705 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [req-e85e3a16-23cd-4ee3-9ebd-4e64d1812073 req-b5ab5b99-b4e1-42bb-b901-7c8c9950c7a5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035352 Mar 08 15:28:14.144422 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1413/2607] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 15:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:28:14.900068 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-3b7f23b7-c14c-4f4c-8986-babefe78f95a tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:14.900671 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-3b7f23b7-c14c-4f4c-8986-babefe78f95a tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: f813bc72-7a86-47dd-b619-d20ef86a30ea] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:28:14.907549 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3b7f23b7-c14c-4f4c-8986-babefe78f95a tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:14.908007 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3b7f23b7-c14c-4f4c-8986-babefe78f95a tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:14.908789 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3b7f23b7-c14c-4f4c-8986-babefe78f95a tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:14.909226 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-3b7f23b7-c14c-4f4c-8986-babefe78f95a tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:14.927454 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.wsgi [None req-3b7f23b7-c14c-4f4c-8986-babefe78f95a tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] HTTP exception thrown: Instance f813bc72-7a86-47dd-b619-d20ef86a30ea could not be found. Mar 08 15:28:14.928070 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-3b7f23b7-c14c-4f4c-8986-babefe78f95a tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Returning 404 to user: Instance f813bc72-7a86-47dd-b619-d20ef86a30ea could not be found. {{(pid=128351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:28:14.928901 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-3b7f23b7-c14c-4f4c-8986-babefe78f95a tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/f813bc72-7a86-47dd-b619-d20ef86a30ea" status: 404 len: 111 microversion: 2.1 time: 0.032787 Mar 08 15:28:14.929466 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1195/2608] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:28:14 2022] GET /compute/v2.1/servers/f813bc72-7a86-47dd-b619-d20ef86a30ea => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 15:28:14.939390 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-85b5bda4-95f2-464c-b924-7de56a78078e tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '.version_select at 0x7ff361ba9d30>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:14.959263 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-85b5bda4-95f2-464c-b924-7de56a78078e tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2123463880" status: 202 len: 0 microversion: 2.1 time: 0.024698 Mar 08 15:28:14.959843 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1414/2609] 10.222.0.30 () {58 vars in 1220 bytes} [Tue Mar 8 15:28:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2123463880 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 08 15:28:15.696574 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-73d43e8c-6cb9-4a66-876f-556932d489d2 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:15.697069 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-73d43e8c-6cb9-4a66-876f-556932d489d2 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 56ade7e6-35ae-4f5b-81ff-9221d246720c] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:28:15.703089 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-73d43e8c-6cb9-4a66-876f-556932d489d2 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:15.703547 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-73d43e8c-6cb9-4a66-876f-556932d489d2 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:15.704583 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-73d43e8c-6cb9-4a66-876f-556932d489d2 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:15.705020 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-73d43e8c-6cb9-4a66-876f-556932d489d2 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:15.784118 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.objects.instance [None req-73d43e8c-6cb9-4a66-876f-556932d489d2 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lazy-loading 'services' on Instance uuid 56ade7e6-35ae-4f5b-81ff-9221d246720c {{(pid=128351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 15:28:15.858986 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-73d43e8c-6cb9-4a66-876f-556932d489d2 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "DELETE /compute/v2.1/servers/56ade7e6-35ae-4f5b-81ff-9221d246720c/os-volume_attachments/7007cf64-dd25-43f2-9821-8f8f60954502" status: 202 len: 0 microversion: 2.1 time: 0.166203 Mar 08 15:28:15.859923 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1196/2610] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Mar 8 15:28:15 2022] DELETE /compute/v2.1/servers/56ade7e6-35ae-4f5b-81ff-9221d246720c/os-volume_attachments/7007cf64-dd25-43f2-9821-8f8f60954502 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 15:28:15.869767 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3f33f27f-84e2-4aba-a828-beb54b57b2fc tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:15.870846 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-3f33f27f-84e2-4aba-a828-beb54b57b2fc tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 56ade7e6-35ae-4f5b-81ff-9221d246720c] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:28:15.877814 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3f33f27f-84e2-4aba-a828-beb54b57b2fc tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:15.878419 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3f33f27f-84e2-4aba-a828-beb54b57b2fc tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:15.879557 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3f33f27f-84e2-4aba-a828-beb54b57b2fc tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:15.879995 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3f33f27f-84e2-4aba-a828-beb54b57b2fc tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:15.910800 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-3f33f27f-84e2-4aba-a828-beb54b57b2fc tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/56ade7e6-35ae-4f5b-81ff-9221d246720c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045403 Mar 08 15:28:15.911350 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1415/2611] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:28:15 2022] GET /compute/v2.1/servers/56ade7e6-35ae-4f5b-81ff-9221d246720c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:28:16.923249 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-16198fa7-c738-426c-b442-224090f3da5b tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:16.924327 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-16198fa7-c738-426c-b442-224090f3da5b tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 56ade7e6-35ae-4f5b-81ff-9221d246720c] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:28:16.930857 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-16198fa7-c738-426c-b442-224090f3da5b tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:16.931303 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-16198fa7-c738-426c-b442-224090f3da5b tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:16.932058 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-16198fa7-c738-426c-b442-224090f3da5b tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:16.932490 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-16198fa7-c738-426c-b442-224090f3da5b tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:16.961733 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-16198fa7-c738-426c-b442-224090f3da5b tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/56ade7e6-35ae-4f5b-81ff-9221d246720c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042788 Mar 08 15:28:16.962308 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1197/2612] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:28:16 2022] GET /compute/v2.1/servers/56ade7e6-35ae-4f5b-81ff-9221d246720c/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 08 15:28:17.018800 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-6d41d427-ed6d-40b0-b2e9-018da17eb729 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:17.019315 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-6d41d427-ed6d-40b0-b2e9-018da17eb729 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 56ade7e6-35ae-4f5b-81ff-9221d246720c] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:28:17.025704 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6d41d427-ed6d-40b0-b2e9-018da17eb729 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:17.026198 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6d41d427-ed6d-40b0-b2e9-018da17eb729 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:17.026961 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6d41d427-ed6d-40b0-b2e9-018da17eb729 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:17.027749 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-6d41d427-ed6d-40b0-b2e9-018da17eb729 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:17.056176 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-6d41d427-ed6d-40b0-b2e9-018da17eb729 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 56ade7e6-35ae-4f5b-81ff-9221d246720c] Going to try to terminate instance {{(pid=128352) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 15:28:17.127864 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-6d41d427-ed6d-40b0-b2e9-018da17eb729 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "DELETE /compute/v2.1/servers/56ade7e6-35ae-4f5b-81ff-9221d246720c" status: 204 len: 0 microversion: 2.1 time: 0.113325 Mar 08 15:28:17.128446 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1416/2613] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 15:28:17 2022] DELETE /compute/v2.1/servers/56ade7e6-35ae-4f5b-81ff-9221d246720c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 15:28:17.137188 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-ad048ce2-a337-466f-be98-7fd91fa3e120 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:17.138293 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-ad048ce2-a337-466f-be98-7fd91fa3e120 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 56ade7e6-35ae-4f5b-81ff-9221d246720c] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:28:17.144225 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ad048ce2-a337-466f-be98-7fd91fa3e120 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:17.144674 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ad048ce2-a337-466f-be98-7fd91fa3e120 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:17.145434 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ad048ce2-a337-466f-be98-7fd91fa3e120 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:17.145883 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ad048ce2-a337-466f-be98-7fd91fa3e120 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:17.284316 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-ad048ce2-a337-466f-be98-7fd91fa3e120 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282b16dbcb1648c39afa0f7ed2d5dbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf1dc206f041ca91a40149aab30dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:28:17.291513 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-ad048ce2-a337-466f-be98-7fd91fa3e120 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/56ade7e6-35ae-4f5b-81ff-9221d246720c" status: 200 len: 1681 microversion: 2.1 time: 0.158843 Mar 08 15:28:17.292068 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1198/2614] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:28:17 2022] GET /compute/v2.1/servers/56ade7e6-35ae-4f5b-81ff-9221d246720c => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:28:18.309675 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d3add530-b54b-4152-aa02-ee0df02fe305 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:18.310405 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d3add530-b54b-4152-aa02-ee0df02fe305 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 56ade7e6-35ae-4f5b-81ff-9221d246720c] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:28:18.317744 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d3add530-b54b-4152-aa02-ee0df02fe305 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:18.318237 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d3add530-b54b-4152-aa02-ee0df02fe305 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:18.319004 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d3add530-b54b-4152-aa02-ee0df02fe305 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:18.319450 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d3add530-b54b-4152-aa02-ee0df02fe305 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:18.460053 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-d3add530-b54b-4152-aa02-ee0df02fe305 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282b16dbcb1648c39afa0f7ed2d5dbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf1dc206f041ca91a40149aab30dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:28:18.467548 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d3add530-b54b-4152-aa02-ee0df02fe305 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/56ade7e6-35ae-4f5b-81ff-9221d246720c" status: 200 len: 1681 microversion: 2.1 time: 0.162258 Mar 08 15:28:18.468113 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1417/2615] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:28:18 2022] GET /compute/v2.1/servers/56ade7e6-35ae-4f5b-81ff-9221d246720c => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:28:19.484592 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-74e61d18-b4fa-49c8-a891-0a91564cf807 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:19.485890 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-74e61d18-b4fa-49c8-a891-0a91564cf807 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 56ade7e6-35ae-4f5b-81ff-9221d246720c] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:28:19.492241 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-74e61d18-b4fa-49c8-a891-0a91564cf807 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:19.492692 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-74e61d18-b4fa-49c8-a891-0a91564cf807 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:19.493452 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-74e61d18-b4fa-49c8-a891-0a91564cf807 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:19.493957 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-74e61d18-b4fa-49c8-a891-0a91564cf807 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:19.580329 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-74e61d18-b4fa-49c8-a891-0a91564cf807 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282b16dbcb1648c39afa0f7ed2d5dbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf1dc206f041ca91a40149aab30dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:28:19.587751 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-74e61d18-b4fa-49c8-a891-0a91564cf807 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/56ade7e6-35ae-4f5b-81ff-9221d246720c" status: 200 len: 1614 microversion: 2.1 time: 0.107039 Mar 08 15:28:19.588329 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1199/2616] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:28:19 2022] GET /compute/v2.1/servers/56ade7e6-35ae-4f5b-81ff-9221d246720c => generated 1614 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:28:19.773456 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [req-05153042-edc0-4004-b8f6-72c80ecae231 req-acd7e2ec-f2cd-43b3-8f5e-9416b9a36d23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56ade7e6-35ae-4f5b-81ff-9221d246720c", "name": "network-vif-deleted", "tag": "30e29d09-ca25-468f-80d0-324480c29ab1"}]} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:28:19.783029 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-05153042-edc0-4004-b8f6-72c80ecae231 req-acd7e2ec-f2cd-43b3-8f5e-9416b9a36d23 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:19.783983 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-05153042-edc0-4004-b8f6-72c80ecae231 req-acd7e2ec-f2cd-43b3-8f5e-9416b9a36d23 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:19.796879 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.compute.server_external_events [req-05153042-edc0-4004-b8f6-72c80ecae231 req-acd7e2ec-f2cd-43b3-8f5e-9416b9a36d23 service nova] Creating event network-vif-deleted:30e29d09-ca25-468f-80d0-324480c29ab1 for instance 56ade7e6-35ae-4f5b-81ff-9221d246720c on hv-cinder-83009 Mar 08 15:28:19.802014 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [req-05153042-edc0-4004-b8f6-72c80ecae231 req-acd7e2ec-f2cd-43b3-8f5e-9416b9a36d23 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032037 Mar 08 15:28:19.802677 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1418/2617] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 15:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:28:20.605096 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-0eab5e52-84cf-40df-9653-6c725de8c37f tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:20.606242 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-0eab5e52-84cf-40df-9653-6c725de8c37f tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 56ade7e6-35ae-4f5b-81ff-9221d246720c] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:28:20.613137 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0eab5e52-84cf-40df-9653-6c725de8c37f tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:20.613617 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0eab5e52-84cf-40df-9653-6c725de8c37f tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:20.614423 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0eab5e52-84cf-40df-9653-6c725de8c37f tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:20.614863 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0eab5e52-84cf-40df-9653-6c725de8c37f tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:20.629347 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.wsgi [None req-0eab5e52-84cf-40df-9653-6c725de8c37f tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] HTTP exception thrown: Instance 56ade7e6-35ae-4f5b-81ff-9221d246720c could not be found. Mar 08 15:28:20.629973 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-0eab5e52-84cf-40df-9653-6c725de8c37f tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Returning 404 to user: Instance 56ade7e6-35ae-4f5b-81ff-9221d246720c could not be found. {{(pid=128351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:28:20.630795 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-0eab5e52-84cf-40df-9653-6c725de8c37f tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/56ade7e6-35ae-4f5b-81ff-9221d246720c" status: 404 len: 111 microversion: 2.1 time: 0.030189 Mar 08 15:28:20.631341 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1200/2618] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:28:20 2022] GET /compute/v2.1/servers/56ade7e6-35ae-4f5b-81ff-9221d246720c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 15:28:20.640528 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-2185a051-f772-4f3c-bdf4-476445ad8d85 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '.version_select at 0x7ff35d00a3a0>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:20.659353 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-2185a051-f772-4f3c-bdf4-476445ad8d85 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1015656366" status: 202 len: 0 microversion: 2.1 time: 0.022893 Mar 08 15:28:20.659948 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1419/2619] 10.222.0.30 () {58 vars in 1220 bytes} [Tue Mar 8 15:28:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1015656366 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 08 15:28:21.286483 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-22028c46-d484-4c5f-9524-d313f6f3244c tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Action: 'create', calling method: .version_select at 0x7ff35d2c7940>, body: {"keypair": {"name": "tempest-keypair-1138614188"}} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:28:21.300882 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.quota [None req-22028c46-d484-4c5f-9524-d313f6f3244c tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Getting quotas for project e4bf1dc206f041ca91a40149aab30dee. Resources: {'key_pairs'} {{(pid=128351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 15:28:21.304677 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.quota [None req-22028c46-d484-4c5f-9524-d313f6f3244c tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Getting quotas for user 282b16dbcb1648c39afa0f7ed2d5dbda and project e4bf1dc206f041ca91a40149aab30dee. Resources: {'key_pairs'} {{(pid=128351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 15:28:21.554663 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.quota [None req-22028c46-d484-4c5f-9524-d313f6f3244c tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Getting quotas for project e4bf1dc206f041ca91a40149aab30dee. Resources: {'key_pairs'} {{(pid=128351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 15:28:21.558179 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.quota [None req-22028c46-d484-4c5f-9524-d313f6f3244c tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Getting quotas for user 282b16dbcb1648c39afa0f7ed2d5dbda and project e4bf1dc206f041ca91a40149aab30dee. Resources: {'key_pairs'} {{(pid=128351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 15:28:21.571396 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-22028c46-d484-4c5f-9524-d313f6f3244c tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.289292 Mar 08 15:28:21.571988 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1201/2620] 10.222.0.30 () {60 vars in 1157 bytes} [Tue Mar 8 15:28:21 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:28:22.799841 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-586ebec5-c2df-45da-8822-32feaaae94b7 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-56351431", "imageRef": "7541d53b-003d-4f1a-8d76-fc5f4bd8dabf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fd27055d-8ae6-4d4d-a095-42195ed67196"}], "security_groups": [{"name": "tempest-securitygroup--2072326092"}], "key_name": "tempest-keypair-1138614188", "user_data": "}} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:28:22.898186 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.network.neutron [None req-586ebec5-c2df-45da-8822-32feaaae94b7 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] validate_networks() for [('fd27055d-8ae6-4d4d-a095-42195ed67196', None, None, None, None, None)] {{(pid=128352) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 15:28:23.270543 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.virt.hardware [None req-586ebec5-c2df-45da-8822-32feaaae94b7 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Flavor limits 0:0:0 {{(pid=128352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 15:28:23.270998 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.virt.hardware [None req-586ebec5-c2df-45da-8822-32feaaae94b7 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Image limits 0:0:0 {{(pid=128352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 15:28:23.271473 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.virt.hardware [None req-586ebec5-c2df-45da-8822-32feaaae94b7 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Flavor pref 0:0:0 {{(pid=128352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 15:28:23.271884 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.virt.hardware [None req-586ebec5-c2df-45da-8822-32feaaae94b7 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Image pref 0:0:0 {{(pid=128352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 15:28:23.272295 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.virt.hardware [None req-586ebec5-c2df-45da-8822-32feaaae94b7 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 15:28:23.281046 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-586ebec5-c2df-45da-8822-32feaaae94b7 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:23.281491 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-586ebec5-c2df-45da-8822-32feaaae94b7 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:23.282897 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-586ebec5-c2df-45da-8822-32feaaae94b7 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:23.283338 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-586ebec5-c2df-45da-8822-32feaaae94b7 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:23.299554 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.quota [None req-586ebec5-c2df-45da-8822-32feaaae94b7 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Getting quotas for project e4bf1dc206f041ca91a40149aab30dee. Resources: {'instances', 'ram', 'cores'} {{(pid=128352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 15:28:23.303418 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.quota [None req-586ebec5-c2df-45da-8822-32feaaae94b7 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Getting quotas for user 282b16dbcb1648c39afa0f7ed2d5dbda and project e4bf1dc206f041ca91a40149aab30dee. Resources: {'instances', 'ram', 'cores'} {{(pid=128352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 15:28:23.314965 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-586ebec5-c2df-45da-8822-32feaaae94b7 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Going to run 1 instances... {{(pid=128352) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 15:28:23.317276 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-586ebec5-c2df-45da-8822-32feaaae94b7 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 822595cd-b7f3-4d21-b8d4-c1f6da86d104] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7541d53b-003d-4f1a-8d76-fc5f4bd8dabf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 15:28:23.362167 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-586ebec5-c2df-45da-8822-32feaaae94b7 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.567101 Mar 08 15:28:23.362806 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1420/2621] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Mar 8 15:28:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 15:28:23.372962 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-3a17e15f-587f-4acc-9bdb-5cde80dcbab7 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:23.373652 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-3a17e15f-587f-4acc-9bdb-5cde80dcbab7 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 822595cd-b7f3-4d21-b8d4-c1f6da86d104] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:28:23.431226 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-3a17e15f-587f-4acc-9bdb-5cde80dcbab7 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282b16dbcb1648c39afa0f7ed2d5dbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf1dc206f041ca91a40149aab30dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:28:23.439706 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-3a17e15f-587f-4acc-9bdb-5cde80dcbab7 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/822595cd-b7f3-4d21-b8d4-c1f6da86d104" status: 200 len: 1240 microversion: 2.1 time: 0.070100 Mar 08 15:28:23.440493 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1202/2622] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:28:23 2022] GET /compute/v2.1/servers/822595cd-b7f3-4d21-b8d4-c1f6da86d104 => generated 1240 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:28:24.457156 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b1bb5ed2-bc5f-4cb3-af58-c99e3e187741 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:24.457774 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b1bb5ed2-bc5f-4cb3-af58-c99e3e187741 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 822595cd-b7f3-4d21-b8d4-c1f6da86d104] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:28:24.464897 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b1bb5ed2-bc5f-4cb3-af58-c99e3e187741 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:24.465278 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b1bb5ed2-bc5f-4cb3-af58-c99e3e187741 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:24.466107 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b1bb5ed2-bc5f-4cb3-af58-c99e3e187741 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:24.466584 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b1bb5ed2-bc5f-4cb3-af58-c99e3e187741 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:24.581181 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b1bb5ed2-bc5f-4cb3-af58-c99e3e187741 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282b16dbcb1648c39afa0f7ed2d5dbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf1dc206f041ca91a40149aab30dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:28:24.588439 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b1bb5ed2-bc5f-4cb3-af58-c99e3e187741 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/822595cd-b7f3-4d21-b8d4-c1f6da86d104" status: 200 len: 1298 microversion: 2.1 time: 0.135969 Mar 08 15:28:24.589005 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1421/2623] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:28:24 2022] GET /compute/v2.1/servers/822595cd-b7f3-4d21-b8d4-c1f6da86d104 => generated 1298 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:28:25.607498 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-4d48ab95-45f1-4399-8a00-4e666a6f077d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:25.609533 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-4d48ab95-45f1-4399-8a00-4e666a6f077d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 822595cd-b7f3-4d21-b8d4-c1f6da86d104] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:28:25.619123 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4d48ab95-45f1-4399-8a00-4e666a6f077d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:25.620046 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4d48ab95-45f1-4399-8a00-4e666a6f077d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:25.621122 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4d48ab95-45f1-4399-8a00-4e666a6f077d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:25.621783 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4d48ab95-45f1-4399-8a00-4e666a6f077d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:25.622536 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [req-396b57a5-67fe-4ebe-a912-527c1072a5e9 req-409e8c6a-a3ac-4629-a003-238f58a14b49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "822595cd-b7f3-4d21-b8d4-c1f6da86d104", "tag": "e3413d7d-8b88-44d7-9cad-6491e5f02c51"}]} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:28:25.646738 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-396b57a5-67fe-4ebe-a912-527c1072a5e9 req-409e8c6a-a3ac-4629-a003-238f58a14b49 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:25.647467 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-396b57a5-67fe-4ebe-a912-527c1072a5e9 req-409e8c6a-a3ac-4629-a003-238f58a14b49 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:25.665220 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.compute.server_external_events [req-396b57a5-67fe-4ebe-a912-527c1072a5e9 req-409e8c6a-a3ac-4629-a003-238f58a14b49 service nova] Creating event network-changed:e3413d7d-8b88-44d7-9cad-6491e5f02c51 for instance 822595cd-b7f3-4d21-b8d4-c1f6da86d104 on hv-cinder-83009 Mar 08 15:28:25.671014 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [req-396b57a5-67fe-4ebe-a912-527c1072a5e9 req-409e8c6a-a3ac-4629-a003-238f58a14b49 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052091 Mar 08 15:28:25.672178 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1422/2624] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 15:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 15:28:25.944226 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-4d48ab95-45f1-4399-8a00-4e666a6f077d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282b16dbcb1648c39afa0f7ed2d5dbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf1dc206f041ca91a40149aab30dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:28:25.951575 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-4d48ab95-45f1-4399-8a00-4e666a6f077d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/822595cd-b7f3-4d21-b8d4-c1f6da86d104" status: 200 len: 1366 microversion: 2.1 time: 0.349410 Mar 08 15:28:25.952148 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1203/2625] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:28:25 2022] GET /compute/v2.1/servers/822595cd-b7f3-4d21-b8d4-c1f6da86d104 => generated 1366 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:28:26.968373 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-dc8a7f5e-8f01-4dda-9fb6-c5701c2aec59 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:26.969070 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-dc8a7f5e-8f01-4dda-9fb6-c5701c2aec59 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 822595cd-b7f3-4d21-b8d4-c1f6da86d104] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:28:26.976538 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dc8a7f5e-8f01-4dda-9fb6-c5701c2aec59 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:26.976988 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dc8a7f5e-8f01-4dda-9fb6-c5701c2aec59 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:26.977756 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dc8a7f5e-8f01-4dda-9fb6-c5701c2aec59 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:26.978225 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-dc8a7f5e-8f01-4dda-9fb6-c5701c2aec59 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:27.109244 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-dc8a7f5e-8f01-4dda-9fb6-c5701c2aec59 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282b16dbcb1648c39afa0f7ed2d5dbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf1dc206f041ca91a40149aab30dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:28:27.118090 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-dc8a7f5e-8f01-4dda-9fb6-c5701c2aec59 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/822595cd-b7f3-4d21-b8d4-c1f6da86d104" status: 200 len: 1366 microversion: 2.1 time: 0.153849 Mar 08 15:28:27.118663 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1423/2626] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:28:26 2022] GET /compute/v2.1/servers/822595cd-b7f3-4d21-b8d4-c1f6da86d104 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:28:28.135281 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-05929262-917c-4fb0-86c1-624159417285 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:28.135896 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-05929262-917c-4fb0-86c1-624159417285 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 822595cd-b7f3-4d21-b8d4-c1f6da86d104] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:28:28.142413 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-05929262-917c-4fb0-86c1-624159417285 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:28.142870 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-05929262-917c-4fb0-86c1-624159417285 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:28.143634 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-05929262-917c-4fb0-86c1-624159417285 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:28.144072 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-05929262-917c-4fb0-86c1-624159417285 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:28.275087 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-05929262-917c-4fb0-86c1-624159417285 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282b16dbcb1648c39afa0f7ed2d5dbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf1dc206f041ca91a40149aab30dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:28:28.282806 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-05929262-917c-4fb0-86c1-624159417285 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/822595cd-b7f3-4d21-b8d4-c1f6da86d104" status: 200 len: 1366 microversion: 2.1 time: 0.151241 Mar 08 15:28:28.283353 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1204/2627] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:28:28 2022] GET /compute/v2.1/servers/822595cd-b7f3-4d21-b8d4-c1f6da86d104 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:28:29.299062 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-345a461e-1d58-49aa-a66f-b0979ebd0198 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:29.299682 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-345a461e-1d58-49aa-a66f-b0979ebd0198 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 822595cd-b7f3-4d21-b8d4-c1f6da86d104] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:28:29.306043 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-345a461e-1d58-49aa-a66f-b0979ebd0198 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:29.306502 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-345a461e-1d58-49aa-a66f-b0979ebd0198 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:29.307273 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-345a461e-1d58-49aa-a66f-b0979ebd0198 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:29.307718 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-345a461e-1d58-49aa-a66f-b0979ebd0198 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:29.442556 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-345a461e-1d58-49aa-a66f-b0979ebd0198 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282b16dbcb1648c39afa0f7ed2d5dbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf1dc206f041ca91a40149aab30dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:28:29.449647 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-345a461e-1d58-49aa-a66f-b0979ebd0198 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/822595cd-b7f3-4d21-b8d4-c1f6da86d104" status: 200 len: 1366 microversion: 2.1 time: 0.154435 Mar 08 15:28:29.450334 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1424/2628] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:28:29 2022] GET /compute/v2.1/servers/822595cd-b7f3-4d21-b8d4-c1f6da86d104 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:28:30.466756 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-e93b8486-dd7b-4120-86c2-7e9a27093cbb tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:30.467368 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-e93b8486-dd7b-4120-86c2-7e9a27093cbb tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 822595cd-b7f3-4d21-b8d4-c1f6da86d104] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:28:30.474220 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e93b8486-dd7b-4120-86c2-7e9a27093cbb tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:30.474556 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e93b8486-dd7b-4120-86c2-7e9a27093cbb tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:30.475316 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e93b8486-dd7b-4120-86c2-7e9a27093cbb tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:30.475735 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-e93b8486-dd7b-4120-86c2-7e9a27093cbb tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:30.610233 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-e93b8486-dd7b-4120-86c2-7e9a27093cbb tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282b16dbcb1648c39afa0f7ed2d5dbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf1dc206f041ca91a40149aab30dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:28:30.617464 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-e93b8486-dd7b-4120-86c2-7e9a27093cbb tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/822595cd-b7f3-4d21-b8d4-c1f6da86d104" status: 200 len: 1366 microversion: 2.1 time: 0.154561 Mar 08 15:28:30.618050 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1205/2629] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:28:30 2022] GET /compute/v2.1/servers/822595cd-b7f3-4d21-b8d4-c1f6da86d104 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:28:31.229157 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f6587c4b-646f-4bcd-bbf6-e65300804970 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:31.230100 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-f6587c4b-646f-4bcd-bbf6-e65300804970 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:28:31.236835 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f6587c4b-646f-4bcd-bbf6-e65300804970 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:31.237282 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f6587c4b-646f-4bcd-bbf6-e65300804970 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:31.238073 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f6587c4b-646f-4bcd-bbf6-e65300804970 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:31.238511 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-f6587c4b-646f-4bcd-bbf6-e65300804970 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:31.265634 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f6587c4b-646f-4bcd-bbf6-e65300804970 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.040414 Mar 08 15:28:31.266315 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1425/2630] 10.222.0.30 () {60 vars in 1342 bytes} [Tue Mar 8 15:28:31 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:28:31.323767 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-96918c0d-5678-4ab2-8f64-e38136fb5399 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:31.324293 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-96918c0d-5678-4ab2-8f64-e38136fb5399 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:28:31.330398 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-96918c0d-5678-4ab2-8f64-e38136fb5399 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:31.330853 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-96918c0d-5678-4ab2-8f64-e38136fb5399 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:31.331617 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-96918c0d-5678-4ab2-8f64-e38136fb5399 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:31.332058 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-96918c0d-5678-4ab2-8f64-e38136fb5399 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:31.356596 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-96918c0d-5678-4ab2-8f64-e38136fb5399 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Going to try to terminate instance {{(pid=128351) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 15:28:31.437320 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-96918c0d-5678-4ab2-8f64-e38136fb5399 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 204 len: 0 microversion: 2.20 time: 0.116975 Mar 08 15:28:31.439069 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1206/2631] 10.222.0.30 () {60 vars in 1279 bytes} [Tue Mar 8 15:28:31 2022] DELETE /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 08 15:28:31.447068 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-e3dc5a2d-5310-4eae-9fea-5c58d8a263de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:31.447783 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-e3dc5a2d-5310-4eae-9fea-5c58d8a263de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:28:31.453840 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e3dc5a2d-5310-4eae-9fea-5c58d8a263de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:31.454251 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e3dc5a2d-5310-4eae-9fea-5c58d8a263de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:31.455152 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e3dc5a2d-5310-4eae-9fea-5c58d8a263de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:31.455663 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-e3dc5a2d-5310-4eae-9fea-5c58d8a263de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:31.534922 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [req-373abbdf-50b5-416a-90dd-30b3cad340eb req-fd793b7d-1b10-4641-97e4-269f813723ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "822595cd-b7f3-4d21-b8d4-c1f6da86d104", "name": "network-vif-plugged", "status": "completed", "tag": "e3413d7d-8b88-44d7-9cad-6491e5f02c51"}]} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:28:31.543155 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-373abbdf-50b5-416a-90dd-30b3cad340eb req-fd793b7d-1b10-4641-97e4-269f813723ce service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:31.543860 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-373abbdf-50b5-416a-90dd-30b3cad340eb req-fd793b7d-1b10-4641-97e4-269f813723ce service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:31.556018 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.compute.server_external_events [req-373abbdf-50b5-416a-90dd-30b3cad340eb req-fd793b7d-1b10-4641-97e4-269f813723ce service nova] Creating event network-vif-plugged:e3413d7d-8b88-44d7-9cad-6491e5f02c51 for instance 822595cd-b7f3-4d21-b8d4-c1f6da86d104 on hv-cinder-83009 Mar 08 15:28:31.560972 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [req-373abbdf-50b5-416a-90dd-30b3cad340eb req-fd793b7d-1b10-4641-97e4-269f813723ce service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031332 Mar 08 15:28:31.561738 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1207/2632] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 15:28:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 15:28:31.602072 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-e3dc5a2d-5310-4eae-9fea-5c58d8a263de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:28:31.612031 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-e3dc5a2d-5310-4eae-9fea-5c58d8a263de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:28:31.613590 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-e3dc5a2d-5310-4eae-9fea-5c58d8a263de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:28:31.614802 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-e3dc5a2d-5310-4eae-9fea-5c58d8a263de tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1724 microversion: 2.20 time: 0.171669 Mar 08 15:28:31.615361 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1426/2633] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:28:31 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:28:31.635736 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-2b476dd8-79dc-40a5-924e-f14e4f42ed6e tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:31.636434 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-2b476dd8-79dc-40a5-924e-f14e4f42ed6e tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 822595cd-b7f3-4d21-b8d4-c1f6da86d104] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:28:31.643166 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2b476dd8-79dc-40a5-924e-f14e4f42ed6e tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:31.643624 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2b476dd8-79dc-40a5-924e-f14e4f42ed6e tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:31.644426 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2b476dd8-79dc-40a5-924e-f14e4f42ed6e tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:31.644870 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-2b476dd8-79dc-40a5-924e-f14e4f42ed6e tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:31.842891 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-2b476dd8-79dc-40a5-924e-f14e4f42ed6e tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282b16dbcb1648c39afa0f7ed2d5dbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf1dc206f041ca91a40149aab30dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:28:31.850790 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-2b476dd8-79dc-40a5-924e-f14e4f42ed6e tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/822595cd-b7f3-4d21-b8d4-c1f6da86d104" status: 200 len: 1366 microversion: 2.1 time: 0.219270 Mar 08 15:28:31.851354 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1208/2634] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:28:31 2022] GET /compute/v2.1/servers/822595cd-b7f3-4d21-b8d4-c1f6da86d104 => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:28:32.634474 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-09825bff-acc9-4bc7-8d96-ab64ed83b035 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:32.635018 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-09825bff-acc9-4bc7-8d96-ab64ed83b035 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:28:32.642480 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-09825bff-acc9-4bc7-8d96-ab64ed83b035 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:32.642936 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-09825bff-acc9-4bc7-8d96-ab64ed83b035 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:32.643727 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-09825bff-acc9-4bc7-8d96-ab64ed83b035 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:32.644171 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-09825bff-acc9-4bc7-8d96-ab64ed83b035 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:32.777974 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-09825bff-acc9-4bc7-8d96-ab64ed83b035 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:28:32.786799 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-09825bff-acc9-4bc7-8d96-ab64ed83b035 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:28:32.788306 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-09825bff-acc9-4bc7-8d96-ab64ed83b035 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:28:32.789456 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-09825bff-acc9-4bc7-8d96-ab64ed83b035 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1724 microversion: 2.20 time: 0.159020 Mar 08 15:28:32.790045 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1427/2635] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:28:32 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:28:32.867336 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-9dfac210-7092-4879-a997-7d8b608e3e99 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:32.867955 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-9dfac210-7092-4879-a997-7d8b608e3e99 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 822595cd-b7f3-4d21-b8d4-c1f6da86d104] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:28:32.874203 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9dfac210-7092-4879-a997-7d8b608e3e99 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:32.874662 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9dfac210-7092-4879-a997-7d8b608e3e99 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:32.876042 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9dfac210-7092-4879-a997-7d8b608e3e99 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:32.876582 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-9dfac210-7092-4879-a997-7d8b608e3e99 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:33.020110 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-9dfac210-7092-4879-a997-7d8b608e3e99 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282b16dbcb1648c39afa0f7ed2d5dbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf1dc206f041ca91a40149aab30dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:28:33.027835 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-9dfac210-7092-4879-a997-7d8b608e3e99 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/822595cd-b7f3-4d21-b8d4-c1f6da86d104" status: 200 len: 1366 microversion: 2.1 time: 0.164346 Mar 08 15:28:33.028394 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1209/2636] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:28:32 2022] GET /compute/v2.1/servers/822595cd-b7f3-4d21-b8d4-c1f6da86d104 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:28:33.808722 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-3a677179-6dff-428c-b40f-f830777c58df tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:33.809342 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-3a677179-6dff-428c-b40f-f830777c58df tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:28:33.816216 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3a677179-6dff-428c-b40f-f830777c58df tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:33.816678 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3a677179-6dff-428c-b40f-f830777c58df tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:33.817466 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3a677179-6dff-428c-b40f-f830777c58df tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:33.817934 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-3a677179-6dff-428c-b40f-f830777c58df tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:33.879980 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-3a677179-6dff-428c-b40f-f830777c58df tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:28:33.887797 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-3a677179-6dff-428c-b40f-f830777c58df tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:28:33.889320 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-3a677179-6dff-428c-b40f-f830777c58df tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1775260bd3f947ea85d14b3a1aa80b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdd8e70c5dc4d1a8f531591dbd9216f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:28:33.890520 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-3a677179-6dff-428c-b40f-f830777c58df tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 200 len: 1656 microversion: 2.20 time: 0.085744 Mar 08 15:28:33.892104 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1428/2637] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:28:33 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 1656 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 15:28:34.045151 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [req-0ffefbbe-92c8-4373-ba6c-1eb26b211c4e req-ae53e333-fe49-472b-97b6-7453c3b802db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c051cc3d-ac34-4fe1-8b55-010166d2cb64", "name": "network-vif-deleted", "tag": "7068a3ed-1414-4ab7-8c70-a96a7135062c"}]} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:28:34.049846 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b236e490-77cf-4864-bed3-2b5dc5006207 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:34.054535 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b236e490-77cf-4864-bed3-2b5dc5006207 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 822595cd-b7f3-4d21-b8d4-c1f6da86d104] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:28:34.054724 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-0ffefbbe-92c8-4373-ba6c-1eb26b211c4e req-ae53e333-fe49-472b-97b6-7453c3b802db service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:34.055003 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-0ffefbbe-92c8-4373-ba6c-1eb26b211c4e req-ae53e333-fe49-472b-97b6-7453c3b802db service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:34.063815 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b236e490-77cf-4864-bed3-2b5dc5006207 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:34.065194 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b236e490-77cf-4864-bed3-2b5dc5006207 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:34.066180 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b236e490-77cf-4864-bed3-2b5dc5006207 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:34.066737 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b236e490-77cf-4864-bed3-2b5dc5006207 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:34.069189 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.compute.server_external_events [req-0ffefbbe-92c8-4373-ba6c-1eb26b211c4e req-ae53e333-fe49-472b-97b6-7453c3b802db service nova] Creating event network-vif-deleted:7068a3ed-1414-4ab7-8c70-a96a7135062c for instance c051cc3d-ac34-4fe1-8b55-010166d2cb64 on hv-cinder-83009 Mar 08 15:28:34.076887 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [req-0ffefbbe-92c8-4373-ba6c-1eb26b211c4e req-ae53e333-fe49-472b-97b6-7453c3b802db service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035289 Mar 08 15:28:34.077613 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1210/2638] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 15:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:28:34.248358 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b236e490-77cf-4864-bed3-2b5dc5006207 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282b16dbcb1648c39afa0f7ed2d5dbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf1dc206f041ca91a40149aab30dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:28:34.257461 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b236e490-77cf-4864-bed3-2b5dc5006207 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/822595cd-b7f3-4d21-b8d4-c1f6da86d104" status: 200 len: 1556 microversion: 2.1 time: 0.214607 Mar 08 15:28:34.258373 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1429/2639] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:28:34 2022] GET /compute/v2.1/servers/822595cd-b7f3-4d21-b8d4-c1f6da86d104 => generated 1556 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:28:34.274771 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-50de70b6-36ae-4507-85c2-53185c06c1d1 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:34.275373 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-50de70b6-36ae-4507-85c2-53185c06c1d1 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 822595cd-b7f3-4d21-b8d4-c1f6da86d104] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:28:34.282782 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-50de70b6-36ae-4507-85c2-53185c06c1d1 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:34.283404 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-50de70b6-36ae-4507-85c2-53185c06c1d1 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:34.284265 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-50de70b6-36ae-4507-85c2-53185c06c1d1 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:34.284715 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-50de70b6-36ae-4507-85c2-53185c06c1d1 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:34.379902 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-50de70b6-36ae-4507-85c2-53185c06c1d1 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/822595cd-b7f3-4d21-b8d4-c1f6da86d104/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.109176 Mar 08 15:28:34.380649 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1211/2640] 10.222.0.30 () {58 vars in 1274 bytes} [Tue Mar 8 15:28:34 2022] GET /compute/v2.1/servers/822595cd-b7f3-4d21-b8d4-c1f6da86d104/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:28:34.910450 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-a68d037f-d5e8-4b1e-a8ce-9281eba59bfb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:34.911169 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-a68d037f-d5e8-4b1e-a8ce-9281eba59bfb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:28:34.917823 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a68d037f-d5e8-4b1e-a8ce-9281eba59bfb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:34.918394 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a68d037f-d5e8-4b1e-a8ce-9281eba59bfb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:34.919257 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a68d037f-d5e8-4b1e-a8ce-9281eba59bfb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:34.919760 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a68d037f-d5e8-4b1e-a8ce-9281eba59bfb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:34.934236 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-a68d037f-d5e8-4b1e-a8ce-9281eba59bfb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] HTTP exception thrown: Instance c051cc3d-ac34-4fe1-8b55-010166d2cb64 could not be found. Mar 08 15:28:34.935646 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-a68d037f-d5e8-4b1e-a8ce-9281eba59bfb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Returning 404 to user: Instance c051cc3d-ac34-4fe1-8b55-010166d2cb64 could not be found. {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:28:34.936774 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-a68d037f-d5e8-4b1e-a8ce-9281eba59bfb tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 404 len: 111 microversion: 2.20 time: 0.031309 Mar 08 15:28:34.941228 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1430/2641] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:28:34 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Mar 08 15:28:34.948195 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-74b9538b-2a5c-4f0d-999b-3e4e253a9650 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '.version_select at 0x7ff35cfe6ca0>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:34.979198 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-74b9538b-2a5c-4f0d-999b-3e4e253a9650 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-794236627" status: 204 len: 0 microversion: 2.20 time: 0.036398 Mar 08 15:28:34.983372 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1212/2642] 10.222.0.30 () {60 vars in 1258 bytes} [Tue Mar 8 15:28:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-794236627 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 08 15:28:35.796638 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [req-cbe6648c-4dd1-4a85-8b83-75b4dd5883b6 req-c0f129b3-37f0-4d6d-87d7-6de5415388a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "822595cd-b7f3-4d21-b8d4-c1f6da86d104", "tag": "e3413d7d-8b88-44d7-9cad-6491e5f02c51"}]} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:28:35.807494 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-cbe6648c-4dd1-4a85-8b83-75b4dd5883b6 req-c0f129b3-37f0-4d6d-87d7-6de5415388a4 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:35.807952 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-cbe6648c-4dd1-4a85-8b83-75b4dd5883b6 req-c0f129b3-37f0-4d6d-87d7-6de5415388a4 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:35.819754 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.compute.server_external_events [req-cbe6648c-4dd1-4a85-8b83-75b4dd5883b6 req-c0f129b3-37f0-4d6d-87d7-6de5415388a4 service nova] Creating event network-changed:e3413d7d-8b88-44d7-9cad-6491e5f02c51 for instance 822595cd-b7f3-4d21-b8d4-c1f6da86d104 on hv-cinder-83009 Mar 08 15:28:35.825426 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [req-cbe6648c-4dd1-4a85-8b83-75b4dd5883b6 req-c0f129b3-37f0-4d6d-87d7-6de5415388a4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035027 Mar 08 15:28:35.826065 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1431/2643] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 15:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:28:37.670264 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-969b8ffc-204e-4705-8438-a866dc3c5da3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:37.670792 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-969b8ffc-204e-4705-8438-a866dc3c5da3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:28:37.678255 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-969b8ffc-204e-4705-8438-a866dc3c5da3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:37.678743 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-969b8ffc-204e-4705-8438-a866dc3c5da3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:37.679514 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-969b8ffc-204e-4705-8438-a866dc3c5da3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:37.679954 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-969b8ffc-204e-4705-8438-a866dc3c5da3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:37.693449 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.wsgi [None req-969b8ffc-204e-4705-8438-a866dc3c5da3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] HTTP exception thrown: Instance c051cc3d-ac34-4fe1-8b55-010166d2cb64 could not be found. Mar 08 15:28:37.694069 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-969b8ffc-204e-4705-8438-a866dc3c5da3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Returning 404 to user: Instance c051cc3d-ac34-4fe1-8b55-010166d2cb64 could not be found. {{(pid=128351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:28:37.694885 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-969b8ffc-204e-4705-8438-a866dc3c5da3 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 404 len: 111 microversion: 2.20 time: 0.035043 Mar 08 15:28:37.695411 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1213/2644] 10.222.0.30 () {60 vars in 1279 bytes} [Tue Mar 8 15:28:37 2022] DELETE /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 08 15:28:37.704836 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-49879eaa-8120-4fc2-b03c-7cb1b103b9fa tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:37.705561 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-49879eaa-8120-4fc2-b03c-7cb1b103b9fa tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: c051cc3d-ac34-4fe1-8b55-010166d2cb64] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:28:37.711709 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-49879eaa-8120-4fc2-b03c-7cb1b103b9fa tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:37.712162 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-49879eaa-8120-4fc2-b03c-7cb1b103b9fa tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:37.712927 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-49879eaa-8120-4fc2-b03c-7cb1b103b9fa tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:37.713366 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-49879eaa-8120-4fc2-b03c-7cb1b103b9fa tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:37.727053 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-49879eaa-8120-4fc2-b03c-7cb1b103b9fa tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] HTTP exception thrown: Instance c051cc3d-ac34-4fe1-8b55-010166d2cb64 could not be found. Mar 08 15:28:37.727689 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-49879eaa-8120-4fc2-b03c-7cb1b103b9fa tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Returning 404 to user: Instance c051cc3d-ac34-4fe1-8b55-010166d2cb64 could not be found. {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:28:37.728504 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-49879eaa-8120-4fc2-b03c-7cb1b103b9fa tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64" status: 404 len: 111 microversion: 2.20 time: 0.028869 Mar 08 15:28:37.729029 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1432/2645] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:28:37 2022] GET /compute/v2.1/servers/c051cc3d-ac34-4fe1-8b55-010166d2cb64 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Mar 08 15:28:38.861283 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-01cd2150-ff6b-4ab6-99a7-3f006358e442 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:38.861759 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-01cd2150-ff6b-4ab6-99a7-3f006358e442 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:28:38.867979 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-01cd2150-ff6b-4ab6-99a7-3f006358e442 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:38.868441 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-01cd2150-ff6b-4ab6-99a7-3f006358e442 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:38.869209 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-01cd2150-ff6b-4ab6-99a7-3f006358e442 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:38.869650 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-01cd2150-ff6b-4ab6-99a7-3f006358e442 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:38.883502 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.wsgi [None req-01cd2150-ff6b-4ab6-99a7-3f006358e442 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] HTTP exception thrown: Instance 1b7917ad-8941-400f-ae66-d22e26633416 could not be found. Mar 08 15:28:38.884119 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-01cd2150-ff6b-4ab6-99a7-3f006358e442 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Returning 404 to user: Instance 1b7917ad-8941-400f-ae66-d22e26633416 could not be found. {{(pid=128351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:28:38.884929 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-01cd2150-ff6b-4ab6-99a7-3f006358e442 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 404 len: 111 microversion: 2.20 time: 0.028683 Mar 08 15:28:38.885446 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1214/2646] 10.222.0.30 () {60 vars in 1279 bytes} [Tue Mar 8 15:28:38 2022] DELETE /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 08 15:28:38.893288 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-2dfacbb1-ecc8-44c2-b198-54c61e2c1696 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:38.893957 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-2dfacbb1-ecc8-44c2-b198-54c61e2c1696 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] [instance: 1b7917ad-8941-400f-ae66-d22e26633416] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:28:38.900188 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2dfacbb1-ecc8-44c2-b198-54c61e2c1696 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:38.900660 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2dfacbb1-ecc8-44c2-b198-54c61e2c1696 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:38.901401 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2dfacbb1-ecc8-44c2-b198-54c61e2c1696 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:28:38.901834 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2dfacbb1-ecc8-44c2-b198-54c61e2c1696 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:28:38.915425 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-2dfacbb1-ecc8-44c2-b198-54c61e2c1696 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] HTTP exception thrown: Instance 1b7917ad-8941-400f-ae66-d22e26633416 could not be found. Mar 08 15:28:38.915998 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-2dfacbb1-ecc8-44c2-b198-54c61e2c1696 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] Returning 404 to user: Instance 1b7917ad-8941-400f-ae66-d22e26633416 could not be found. {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:28:38.916800 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-2dfacbb1-ecc8-44c2-b198-54c61e2c1696 tempest-AttachVolumeShelveTestJSON-1327606512 tempest-AttachVolumeShelveTestJSON-1327606512-project] 10.222.0.30 "GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416" status: 404 len: 111 microversion: 2.20 time: 0.027428 Mar 08 15:28:38.917316 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1433/2647] 10.222.0.30 () {60 vars in 1276 bytes} [Tue Mar 8 15:28:38 2022] GET /compute/v2.1/servers/1b7917ad-8941-400f-ae66-d22e26633416 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 08 15:28:43.321028 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-ec521656-9107-4a1a-b59e-c712a2d772fe tempest-VolumesSnapshotsTestJSON-905087968 tempest-VolumesSnapshotsTestJSON-905087968-project] Action: 'create', calling method: .version_select at 0x7ff35d1408b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1661149563"}} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:28:43.595668 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-ec521656-9107-4a1a-b59e-c712a2d772fe tempest-VolumesSnapshotsTestJSON-905087968 tempest-VolumesSnapshotsTestJSON-905087968-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.384758 Mar 08 15:28:43.596289 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1215/2648] 10.222.0.30 () {60 vars in 1154 bytes} [Tue Mar 8 15:28:43 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 386 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Mar 08 15:28:43.606970 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-dbce2604-3e19-4649-9805-7b7cc7da6956 tempest-VolumesSnapshotsTestJSON-905087968 tempest-VolumesSnapshotsTestJSON-905087968-project] Calling method '.version_select at 0x7ff361bc1040>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:43.659888 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-dbce2604-3e19-4649-9805-7b7cc7da6956 tempest-VolumesSnapshotsTestJSON-905087968 tempest-VolumesSnapshotsTestJSON-905087968-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/1945e806-7f49-4d53-8912-66c772d4fa56" status: 200 len: 345 microversion: 2.1 time: 0.056740 Mar 08 15:28:43.660455 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1434/2649] 10.222.0.30 () {58 vars in 1244 bytes} [Tue Mar 8 15:28:43 2022] GET /compute/v2.1/os-volumes/1945e806-7f49-4d53-8912-66c772d4fa56 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:28:44.672752 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-42cadc74-d943-4702-bd65-65e10edda4eb tempest-VolumesSnapshotsTestJSON-905087968 tempest-VolumesSnapshotsTestJSON-905087968-project] Calling method '.version_select at 0x7ff35ce9b790>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:44.719672 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-42cadc74-d943-4702-bd65-65e10edda4eb tempest-VolumesSnapshotsTestJSON-905087968 tempest-VolumesSnapshotsTestJSON-905087968-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/1945e806-7f49-4d53-8912-66c772d4fa56" status: 200 len: 346 microversion: 2.1 time: 0.051054 Mar 08 15:28:44.720240 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1216/2650] 10.222.0.30 () {58 vars in 1244 bytes} [Tue Mar 8 15:28:44 2022] GET /compute/v2.1/os-volumes/1945e806-7f49-4d53-8912-66c772d4fa56 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:28:44.731886 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-2aa4502f-811c-499c-a64a-f38d31337741 tempest-VolumesSnapshotsTestJSON-905087968 tempest-VolumesSnapshotsTestJSON-905087968-project] Action: 'create', calling method: .version_select at 0x7ff35d027b80>, body: {"snapshot": {"volume_id": "1945e806-7f49-4d53-8912-66c772d4fa56", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-821917816"}} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:28:44.875865 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-2aa4502f-811c-499c-a64a-f38d31337741 tempest-VolumesSnapshotsTestJSON-905087968 tempest-VolumesSnapshotsTestJSON-905087968-project] 10.222.0.30 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.148350 Mar 08 15:28:44.876443 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1435/2651] 10.222.0.30 () {60 vars in 1161 bytes} [Tue Mar 8 15:28:44 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:28:44.886741 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-e244a2bd-cc74-47e9-a3a5-3fae75db2038 tempest-VolumesSnapshotsTestJSON-905087968 tempest-VolumesSnapshotsTestJSON-905087968-project] Calling method '.version_select at 0x7ff35ceac940>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:44.920460 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-e244a2bd-cc74-47e9-a3a5-3fae75db2038 tempest-VolumesSnapshotsTestJSON-905087968 tempest-VolumesSnapshotsTestJSON-905087968-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/ab7c41cb-7704-465a-b3b4-05286c992c95" status: 200 len: 286 microversion: 2.1 time: 0.037718 Mar 08 15:28:44.921024 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1217/2652] 10.222.0.30 () {58 vars in 1250 bytes} [Tue Mar 8 15:28:44 2022] GET /compute/v2.1/os-snapshots/ab7c41cb-7704-465a-b3b4-05286c992c95 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:28:44.931447 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-1e72d7ba-5c0b-40a7-93fa-3e3b1a4b4e53 tempest-VolumesSnapshotsTestJSON-905087968 tempest-VolumesSnapshotsTestJSON-905087968-project] Calling method '.version_select at 0x7ff361bc1430>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:44.959675 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-1e72d7ba-5c0b-40a7-93fa-3e3b1a4b4e53 tempest-VolumesSnapshotsTestJSON-905087968 tempest-VolumesSnapshotsTestJSON-905087968-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.031847 Mar 08 15:28:44.960240 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1436/2653] 10.222.0.30 () {58 vars in 1139 bytes} [Tue Mar 8 15:28:44 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:28:44.975001 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b9e84f00-c206-4d52-859f-57ed61b69bf5 tempest-VolumesSnapshotsTestJSON-905087968 tempest-VolumesSnapshotsTestJSON-905087968-project] Calling method '.version_select at 0x7ff361c97280>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:45.003993 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-b9e84f00-c206-4d52-859f-57ed61b69bf5 tempest-VolumesSnapshotsTestJSON-905087968 tempest-VolumesSnapshotsTestJSON-905087968-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/ab7c41cb-7704-465a-b3b4-05286c992c95" status: 200 len: 286 microversion: 2.1 time: 0.037694 Mar 08 15:28:45.004581 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1218/2654] 10.222.0.30 () {58 vars in 1250 bytes} [Tue Mar 8 15:28:44 2022] GET /compute/v2.1/os-snapshots/ab7c41cb-7704-465a-b3b4-05286c992c95 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:28:46.016146 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-20818a62-4b38-4b96-955b-313883197a97 tempest-VolumesSnapshotsTestJSON-905087968 tempest-VolumesSnapshotsTestJSON-905087968-project] Calling method '.version_select at 0x7ff35d0271f0>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:46.044528 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-20818a62-4b38-4b96-955b-313883197a97 tempest-VolumesSnapshotsTestJSON-905087968 tempest-VolumesSnapshotsTestJSON-905087968-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/ab7c41cb-7704-465a-b3b4-05286c992c95" status: 200 len: 286 microversion: 2.1 time: 0.032587 Mar 08 15:28:46.045080 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1437/2655] 10.222.0.30 () {58 vars in 1250 bytes} [Tue Mar 8 15:28:46 2022] GET /compute/v2.1/os-snapshots/ab7c41cb-7704-465a-b3b4-05286c992c95 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:28:47.057463 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b66aa201-d6fb-4ada-a36a-39650296b094 tempest-VolumesSnapshotsTestJSON-905087968 tempest-VolumesSnapshotsTestJSON-905087968-project] Calling method '.version_select at 0x7ff35d023670>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:47.087513 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-b66aa201-d6fb-4ada-a36a-39650296b094 tempest-VolumesSnapshotsTestJSON-905087968 tempest-VolumesSnapshotsTestJSON-905087968-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/ab7c41cb-7704-465a-b3b4-05286c992c95" status: 200 len: 286 microversion: 2.1 time: 0.034683 Mar 08 15:28:47.088068 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1219/2656] 10.222.0.30 () {58 vars in 1250 bytes} [Tue Mar 8 15:28:47 2022] GET /compute/v2.1/os-snapshots/ab7c41cb-7704-465a-b3b4-05286c992c95 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:28:48.100460 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-4a38ac98-6a94-49e8-9898-4855a11df634 tempest-VolumesSnapshotsTestJSON-905087968 tempest-VolumesSnapshotsTestJSON-905087968-project] Calling method '.version_select at 0x7ff35ed49700>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:48.132810 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-4a38ac98-6a94-49e8-9898-4855a11df634 tempest-VolumesSnapshotsTestJSON-905087968 tempest-VolumesSnapshotsTestJSON-905087968-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/ab7c41cb-7704-465a-b3b4-05286c992c95" status: 200 len: 287 microversion: 2.1 time: 0.037225 Mar 08 15:28:48.133357 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1438/2657] 10.222.0.30 () {58 vars in 1250 bytes} [Tue Mar 8 15:28:48 2022] GET /compute/v2.1/os-snapshots/ab7c41cb-7704-465a-b3b4-05286c992c95 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:28:48.143819 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-9f5082db-a26c-4b15-9c7b-a7e544c7bc73 tempest-VolumesSnapshotsTestJSON-905087968 tempest-VolumesSnapshotsTestJSON-905087968-project] Calling method '.version_select at 0x7ff35d16d160>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:48.197989 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-9f5082db-a26c-4b15-9c7b-a7e544c7bc73 tempest-VolumesSnapshotsTestJSON-905087968 tempest-VolumesSnapshotsTestJSON-905087968-project] 10.222.0.30 "DELETE /compute/v2.1/os-snapshots/ab7c41cb-7704-465a-b3b4-05286c992c95" status: 202 len: 0 microversion: 2.1 time: 0.058291 Mar 08 15:28:48.198686 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1220/2658] 10.222.0.30 () {58 vars in 1253 bytes} [Tue Mar 8 15:28:48 2022] DELETE /compute/v2.1/os-snapshots/ab7c41cb-7704-465a-b3b4-05286c992c95 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 15:28:48.208015 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c4743b6e-db6b-4b22-9abd-846d09558465 tempest-VolumesSnapshotsTestJSON-905087968 tempest-VolumesSnapshotsTestJSON-905087968-project] Calling method '.version_select at 0x7ff35d027040>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:48.238253 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-c4743b6e-db6b-4b22-9abd-846d09558465 tempest-VolumesSnapshotsTestJSON-905087968 tempest-VolumesSnapshotsTestJSON-905087968-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/ab7c41cb-7704-465a-b3b4-05286c992c95" status: 200 len: 286 microversion: 2.1 time: 0.034364 Mar 08 15:28:48.238830 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1439/2659] 10.222.0.30 () {58 vars in 1250 bytes} [Tue Mar 8 15:28:48 2022] GET /compute/v2.1/os-snapshots/ab7c41cb-7704-465a-b3b4-05286c992c95 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 15:28:49.249310 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-7c9953f2-156e-4794-8b6c-0b9e233b55e3 tempest-VolumesSnapshotsTestJSON-905087968 tempest-VolumesSnapshotsTestJSON-905087968-project] Calling method '.version_select at 0x7ff35d023700>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:49.273903 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.wsgi [None req-7c9953f2-156e-4794-8b6c-0b9e233b55e3 tempest-VolumesSnapshotsTestJSON-905087968 tempest-VolumesSnapshotsTestJSON-905087968-project] HTTP exception thrown: Snapshot ab7c41cb-7704-465a-b3b4-05286c992c95 could not be found. Mar 08 15:28:49.274626 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-7c9953f2-156e-4794-8b6c-0b9e233b55e3 tempest-VolumesSnapshotsTestJSON-905087968 tempest-VolumesSnapshotsTestJSON-905087968-project] Returning 404 to user: Snapshot ab7c41cb-7704-465a-b3b4-05286c992c95 could not be found. {{(pid=128351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:28:49.275703 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-7c9953f2-156e-4794-8b6c-0b9e233b55e3 tempest-VolumesSnapshotsTestJSON-905087968 tempest-VolumesSnapshotsTestJSON-905087968-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/ab7c41cb-7704-465a-b3b4-05286c992c95" status: 404 len: 111 microversion: 2.1 time: 0.030589 Mar 08 15:28:49.276446 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1221/2660] 10.222.0.30 () {58 vars in 1250 bytes} [Tue Mar 8 15:28:49 2022] GET /compute/v2.1/os-snapshots/ab7c41cb-7704-465a-b3b4-05286c992c95 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 15:28:49.286677 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-fd610f6d-38e7-40a1-88ff-5e7e27d1ecb8 tempest-VolumesSnapshotsTestJSON-905087968 tempest-VolumesSnapshotsTestJSON-905087968-project] Calling method '.version_select at 0x7ff361bc1820>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:49.345332 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-fd610f6d-38e7-40a1-88ff-5e7e27d1ecb8 tempest-VolumesSnapshotsTestJSON-905087968 tempest-VolumesSnapshotsTestJSON-905087968-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/1945e806-7f49-4d53-8912-66c772d4fa56" status: 202 len: 0 microversion: 2.1 time: 0.064172 Mar 08 15:28:49.345995 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1440/2661] 10.222.0.30 () {58 vars in 1247 bytes} [Tue Mar 8 15:28:49 2022] DELETE /compute/v2.1/os-volumes/1945e806-7f49-4d53-8912-66c772d4fa56 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 15:28:49.355980 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-dee8af5f-4fb3-4e19-b57a-6bd7659547fb tempest-VolumesSnapshotsTestJSON-905087968 tempest-VolumesSnapshotsTestJSON-905087968-project] Calling method '.version_select at 0x7ff361c97280>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:49.402114 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-dee8af5f-4fb3-4e19-b57a-6bd7659547fb tempest-VolumesSnapshotsTestJSON-905087968 tempest-VolumesSnapshotsTestJSON-905087968-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/1945e806-7f49-4d53-8912-66c772d4fa56" status: 200 len: 345 microversion: 2.1 time: 0.050630 Mar 08 15:28:49.402669 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1222/2662] 10.222.0.30 () {58 vars in 1244 bytes} [Tue Mar 8 15:28:49 2022] GET /compute/v2.1/os-volumes/1945e806-7f49-4d53-8912-66c772d4fa56 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 15:28:50.415114 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f2266fb3-05df-429f-ae81-9eb2fb135b65 tempest-VolumesSnapshotsTestJSON-905087968 tempest-VolumesSnapshotsTestJSON-905087968-project] Calling method '.version_select at 0x7ff35ed49670>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:50.445145 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-f2266fb3-05df-429f-ae81-9eb2fb135b65 tempest-VolumesSnapshotsTestJSON-905087968 tempest-VolumesSnapshotsTestJSON-905087968-project] HTTP exception thrown: Volume 1945e806-7f49-4d53-8912-66c772d4fa56 could not be found. Mar 08 15:28:50.445743 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-f2266fb3-05df-429f-ae81-9eb2fb135b65 tempest-VolumesSnapshotsTestJSON-905087968 tempest-VolumesSnapshotsTestJSON-905087968-project] Returning 404 to user: Volume 1945e806-7f49-4d53-8912-66c772d4fa56 could not be found. {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:28:50.446853 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-f2266fb3-05df-429f-ae81-9eb2fb135b65 tempest-VolumesSnapshotsTestJSON-905087968 tempest-VolumesSnapshotsTestJSON-905087968-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/1945e806-7f49-4d53-8912-66c772d4fa56" status: 404 len: 109 microversion: 2.1 time: 0.035834 Mar 08 15:28:50.447389 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1441/2663] 10.222.0.30 () {58 vars in 1244 bytes} [Tue Mar 8 15:28:50 2022] GET /compute/v2.1/os-volumes/1945e806-7f49-4d53-8912-66c772d4fa56 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 15:28:50.457062 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-3f7d7b68-084a-40ee-98ee-6d9f900c5062 tempest-VolumesSnapshotsTestJSON-905087968 tempest-VolumesSnapshotsTestJSON-905087968-project] Calling method '.version_select at 0x7ff35cf90a60>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:50.482690 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.wsgi [None req-3f7d7b68-084a-40ee-98ee-6d9f900c5062 tempest-VolumesSnapshotsTestJSON-905087968 tempest-VolumesSnapshotsTestJSON-905087968-project] HTTP exception thrown: Volume 1945e806-7f49-4d53-8912-66c772d4fa56 could not be found. Mar 08 15:28:50.483302 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-3f7d7b68-084a-40ee-98ee-6d9f900c5062 tempest-VolumesSnapshotsTestJSON-905087968 tempest-VolumesSnapshotsTestJSON-905087968-project] Returning 404 to user: Volume 1945e806-7f49-4d53-8912-66c772d4fa56 could not be found. {{(pid=128351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:28:50.484127 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-3f7d7b68-084a-40ee-98ee-6d9f900c5062 tempest-VolumesSnapshotsTestJSON-905087968 tempest-VolumesSnapshotsTestJSON-905087968-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/1945e806-7f49-4d53-8912-66c772d4fa56" status: 404 len: 109 microversion: 2.1 time: 0.031621 Mar 08 15:28:50.484707 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1223/2664] 10.222.0.30 () {58 vars in 1247 bytes} [Tue Mar 8 15:28:50 2022] DELETE /compute/v2.1/os-volumes/1945e806-7f49-4d53-8912-66c772d4fa56 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 15:28:50.493033 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-e22e2c39-4cfc-421b-bde0-8fd3572f6599 tempest-VolumesSnapshotsTestJSON-905087968 tempest-VolumesSnapshotsTestJSON-905087968-project] Calling method '.version_select at 0x7ff361c539d0>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:50.519453 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-e22e2c39-4cfc-421b-bde0-8fd3572f6599 tempest-VolumesSnapshotsTestJSON-905087968 tempest-VolumesSnapshotsTestJSON-905087968-project] HTTP exception thrown: Volume 1945e806-7f49-4d53-8912-66c772d4fa56 could not be found. Mar 08 15:28:50.520044 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-e22e2c39-4cfc-421b-bde0-8fd3572f6599 tempest-VolumesSnapshotsTestJSON-905087968 tempest-VolumesSnapshotsTestJSON-905087968-project] Returning 404 to user: Volume 1945e806-7f49-4d53-8912-66c772d4fa56 could not be found. {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:28:50.520856 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-e22e2c39-4cfc-421b-bde0-8fd3572f6599 tempest-VolumesSnapshotsTestJSON-905087968 tempest-VolumesSnapshotsTestJSON-905087968-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/1945e806-7f49-4d53-8912-66c772d4fa56" status: 404 len: 109 microversion: 2.1 time: 0.031660 Mar 08 15:28:50.521378 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1442/2665] 10.222.0.30 () {58 vars in 1244 bytes} [Tue Mar 8 15:28:50 2022] GET /compute/v2.1/os-volumes/1945e806-7f49-4d53-8912-66c772d4fa56 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 15:28:51.850189 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-6c6b0753-16d4-4343-9ee8-7080b0e42bde tempest-VolumesGetTestJSON-632172892 tempest-VolumesGetTestJSON-632172892-project] Action: 'create', calling method: .version_select at 0x7ff35d1c4b80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1802156760", "metadata": {"Type": "work"}}} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:28:52.126564 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-6c6b0753-16d4-4343-9ee8-7080b0e42bde tempest-VolumesGetTestJSON-632172892 tempest-VolumesGetTestJSON-632172892-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.392815 Mar 08 15:28:52.127293 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1224/2666] 10.222.0.30 () {60 vars in 1155 bytes} [Tue Mar 8 15:28:51 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 394 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Mar 08 15:28:52.139614 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-36d3ac5e-3838-4409-8d11-50c1f8e7baf1 tempest-VolumesGetTestJSON-632172892 tempest-VolumesGetTestJSON-632172892-project] Calling method '.version_select at 0x7ff361ba90d0>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:52.188393 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-36d3ac5e-3838-4409-8d11-50c1f8e7baf1 tempest-VolumesGetTestJSON-632172892 tempest-VolumesGetTestJSON-632172892-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/c5217f1e-dff8-4247-9717-90292abfc769" status: 200 len: 353 microversion: 2.1 time: 0.053478 Mar 08 15:28:52.189092 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1443/2667] 10.222.0.30 () {58 vars in 1244 bytes} [Tue Mar 8 15:28:52 2022] GET /compute/v2.1/os-volumes/c5217f1e-dff8-4247-9717-90292abfc769 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:28:53.201200 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-206fa6d0-f689-4bfd-8e38-f0d529600338 tempest-VolumesGetTestJSON-632172892 tempest-VolumesGetTestJSON-632172892-project] Calling method '.version_select at 0x7ff35d121ca0>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:53.246409 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-206fa6d0-f689-4bfd-8e38-f0d529600338 tempest-VolumesGetTestJSON-632172892 tempest-VolumesGetTestJSON-632172892-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/c5217f1e-dff8-4247-9717-90292abfc769" status: 200 len: 354 microversion: 2.1 time: 0.049415 Mar 08 15:28:53.246972 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1225/2668] 10.222.0.30 () {58 vars in 1244 bytes} [Tue Mar 8 15:28:53 2022] GET /compute/v2.1/os-volumes/c5217f1e-dff8-4247-9717-90292abfc769 => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:28:53.258536 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-37267fc9-b3c4-41cc-ab54-b33de86a6d54 tempest-VolumesGetTestJSON-632172892 tempest-VolumesGetTestJSON-632172892-project] Calling method '.version_select at 0x7ff361c19a60>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:53.302833 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-37267fc9-b3c4-41cc-ab54-b33de86a6d54 tempest-VolumesGetTestJSON-632172892 tempest-VolumesGetTestJSON-632172892-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/c5217f1e-dff8-4247-9717-90292abfc769" status: 200 len: 354 microversion: 2.1 time: 0.048979 Mar 08 15:28:53.303390 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1444/2669] 10.222.0.30 () {58 vars in 1244 bytes} [Tue Mar 8 15:28:53 2022] GET /compute/v2.1/os-volumes/c5217f1e-dff8-4247-9717-90292abfc769 => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:28:53.319644 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-88aae48a-30a3-4254-96b3-f217d8b843d8 tempest-VolumesGetTestJSON-632172892 tempest-VolumesGetTestJSON-632172892-project] Calling method '.version_select at 0x7ff35d140160>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:53.377054 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-88aae48a-30a3-4254-96b3-f217d8b843d8 tempest-VolumesGetTestJSON-632172892 tempest-VolumesGetTestJSON-632172892-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/c5217f1e-dff8-4247-9717-90292abfc769" status: 202 len: 0 microversion: 2.1 time: 0.061781 Mar 08 15:28:53.377679 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1226/2670] 10.222.0.30 () {58 vars in 1247 bytes} [Tue Mar 8 15:28:53 2022] DELETE /compute/v2.1/os-volumes/c5217f1e-dff8-4247-9717-90292abfc769 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 15:28:53.386361 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-03841dcc-e3ac-4e6e-9974-2e1582535b03 tempest-VolumesGetTestJSON-632172892 tempest-VolumesGetTestJSON-632172892-project] Calling method '.version_select at 0x7ff361ba9e50>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:53.433307 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-03841dcc-e3ac-4e6e-9974-2e1582535b03 tempest-VolumesGetTestJSON-632172892 tempest-VolumesGetTestJSON-632172892-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/c5217f1e-dff8-4247-9717-90292abfc769" status: 200 len: 353 microversion: 2.1 time: 0.051224 Mar 08 15:28:53.433889 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1445/2671] 10.222.0.30 () {58 vars in 1244 bytes} [Tue Mar 8 15:28:53 2022] GET /compute/v2.1/os-volumes/c5217f1e-dff8-4247-9717-90292abfc769 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:28:54.446185 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-227052ca-48cf-4a7e-9806-b650ed89dee4 tempest-VolumesGetTestJSON-632172892 tempest-VolumesGetTestJSON-632172892-project] Calling method '.version_select at 0x7ff35cfe6f70>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:28:54.473395 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.wsgi [None req-227052ca-48cf-4a7e-9806-b650ed89dee4 tempest-VolumesGetTestJSON-632172892 tempest-VolumesGetTestJSON-632172892-project] HTTP exception thrown: Volume c5217f1e-dff8-4247-9717-90292abfc769 could not be found. Mar 08 15:28:54.474042 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-227052ca-48cf-4a7e-9806-b650ed89dee4 tempest-VolumesGetTestJSON-632172892 tempest-VolumesGetTestJSON-632172892-project] Returning 404 to user: Volume c5217f1e-dff8-4247-9717-90292abfc769 could not be found. {{(pid=128351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:28:54.474933 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-227052ca-48cf-4a7e-9806-b650ed89dee4 tempest-VolumesGetTestJSON-632172892 tempest-VolumesGetTestJSON-632172892-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/c5217f1e-dff8-4247-9717-90292abfc769" status: 404 len: 109 microversion: 2.1 time: 0.033720 Mar 08 15:28:54.475822 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1227/2672] 10.222.0.30 () {58 vars in 1244 bytes} [Tue Mar 8 15:28:54 2022] GET /compute/v2.1/os-volumes/c5217f1e-dff8-4247-9717-90292abfc769 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 15:29:19.458312 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-d954c59c-724d-440e-ac20-0f5f60ef5ab0 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:29:19.458929 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-d954c59c-724d-440e-ac20-0f5f60ef5ab0 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 822595cd-b7f3-4d21-b8d4-c1f6da86d104] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:29:19.465488 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d954c59c-724d-440e-ac20-0f5f60ef5ab0 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:29:19.465974 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d954c59c-724d-440e-ac20-0f5f60ef5ab0 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:29:19.466753 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d954c59c-724d-440e-ac20-0f5f60ef5ab0 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:29:19.467197 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-d954c59c-724d-440e-ac20-0f5f60ef5ab0 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:29:19.489198 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-d954c59c-724d-440e-ac20-0f5f60ef5ab0 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/822595cd-b7f3-4d21-b8d4-c1f6da86d104/ips" status: 200 len: 150 microversion: 2.1 time: 0.035372 Mar 08 15:29:19.489766 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1446/2673] 10.222.0.30 () {58 vars in 1247 bytes} [Tue Mar 8 15:29:19 2022] GET /compute/v2.1/servers/822595cd-b7f3-4d21-b8d4-c1f6da86d104/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:29:21.846067 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-ddf0de29-642d-4af8-95f5-98487eacc9be tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7874c212-0a29-4807-ad5a-02174e7e373d"}} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:29:21.847051 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-ddf0de29-642d-4af8-95f5-98487eacc9be tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 822595cd-b7f3-4d21-b8d4-c1f6da86d104] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:29:21.853541 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ddf0de29-642d-4af8-95f5-98487eacc9be tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:29:21.854044 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ddf0de29-642d-4af8-95f5-98487eacc9be tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:29:21.854961 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ddf0de29-642d-4af8-95f5-98487eacc9be tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:29:21.856010 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ddf0de29-642d-4af8-95f5-98487eacc9be tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:29:22.095206 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-ddf0de29-642d-4af8-95f5-98487eacc9be tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "POST /compute/v2.1/servers/822595cd-b7f3-4d21-b8d4-c1f6da86d104/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255143 Mar 08 15:29:22.095807 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1228/2674] 10.222.0.30 () {60 vars in 1322 bytes} [Tue Mar 8 15:29:21 2022] POST /compute/v2.1/servers/822595cd-b7f3-4d21-b8d4-c1f6da86d104/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:29:28.524308 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-fcf582f1-2854-44ae-9514-88041cf1fae7 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7874c212-0a29-4807-ad5a-02174e7e373d"}} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:29:28.525377 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-fcf582f1-2854-44ae-9514-88041cf1fae7 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 822595cd-b7f3-4d21-b8d4-c1f6da86d104] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:29:28.532310 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fcf582f1-2854-44ae-9514-88041cf1fae7 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:29:28.532790 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fcf582f1-2854-44ae-9514-88041cf1fae7 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:29:28.533555 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fcf582f1-2854-44ae-9514-88041cf1fae7 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:29:28.534024 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fcf582f1-2854-44ae-9514-88041cf1fae7 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:29:28.608886 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-fcf582f1-2854-44ae-9514-88041cf1fae7 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] HTTP exception thrown: Invalid volume: volume 7874c212-0a29-4807-ad5a-02174e7e373d is already attached to instances: 822595cd-b7f3-4d21-b8d4-c1f6da86d104 Mar 08 15:29:28.609492 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-fcf582f1-2854-44ae-9514-88041cf1fae7 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Returning 400 to user: Invalid volume: volume 7874c212-0a29-4807-ad5a-02174e7e373d is already attached to instances: 822595cd-b7f3-4d21-b8d4-c1f6da86d104 {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:29:28.610369 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-fcf582f1-2854-44ae-9514-88041cf1fae7 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "POST /compute/v2.1/servers/822595cd-b7f3-4d21-b8d4-c1f6da86d104/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.090191 Mar 08 15:29:28.610912 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1447/2675] 10.222.0.30 () {60 vars in 1322 bytes} [Tue Mar 8 15:29:28 2022] POST /compute/v2.1/servers/822595cd-b7f3-4d21-b8d4-c1f6da86d104/os-volume_attachments => generated 174 bytes in 91 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 08 15:29:28.672973 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-f04ab997-d03c-43b7-a1ff-e24301825172 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:29:28.673600 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-f04ab997-d03c-43b7-a1ff-e24301825172 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 822595cd-b7f3-4d21-b8d4-c1f6da86d104] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:29:28.679687 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f04ab997-d03c-43b7-a1ff-e24301825172 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:29:28.680141 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f04ab997-d03c-43b7-a1ff-e24301825172 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:29:28.680898 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f04ab997-d03c-43b7-a1ff-e24301825172 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:29:28.681334 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-f04ab997-d03c-43b7-a1ff-e24301825172 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:29:28.757973 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.objects.instance [None req-f04ab997-d03c-43b7-a1ff-e24301825172 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lazy-loading 'services' on Instance uuid 822595cd-b7f3-4d21-b8d4-c1f6da86d104 {{(pid=128351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 15:29:28.828535 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-f04ab997-d03c-43b7-a1ff-e24301825172 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "DELETE /compute/v2.1/servers/822595cd-b7f3-4d21-b8d4-c1f6da86d104/os-volume_attachments/7874c212-0a29-4807-ad5a-02174e7e373d" status: 202 len: 0 microversion: 2.1 time: 0.161197 Mar 08 15:29:28.829110 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1229/2676] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Mar 8 15:29:28 2022] DELETE /compute/v2.1/servers/822595cd-b7f3-4d21-b8d4-c1f6da86d104/os-volume_attachments/7874c212-0a29-4807-ad5a-02174e7e373d => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 15:29:28.837307 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-9f3b5d81-02a2-4a2e-9c2c-4e89cd64aa61 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:29:28.838314 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-9f3b5d81-02a2-4a2e-9c2c-4e89cd64aa61 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 822595cd-b7f3-4d21-b8d4-c1f6da86d104] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:29:28.844932 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9f3b5d81-02a2-4a2e-9c2c-4e89cd64aa61 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:29:28.845474 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9f3b5d81-02a2-4a2e-9c2c-4e89cd64aa61 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:29:28.846429 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9f3b5d81-02a2-4a2e-9c2c-4e89cd64aa61 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:29:28.846993 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9f3b5d81-02a2-4a2e-9c2c-4e89cd64aa61 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:29:28.876997 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-9f3b5d81-02a2-4a2e-9c2c-4e89cd64aa61 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/822595cd-b7f3-4d21-b8d4-c1f6da86d104/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043516 Mar 08 15:29:28.877559 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1448/2677] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:29:28 2022] GET /compute/v2.1/servers/822595cd-b7f3-4d21-b8d4-c1f6da86d104/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:29:29.889755 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-4631b7c2-5242-46f5-89a7-454298cdd51d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:29:29.890830 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-4631b7c2-5242-46f5-89a7-454298cdd51d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 822595cd-b7f3-4d21-b8d4-c1f6da86d104] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:29:29.896973 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4631b7c2-5242-46f5-89a7-454298cdd51d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:29:29.897584 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4631b7c2-5242-46f5-89a7-454298cdd51d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:29:29.898389 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4631b7c2-5242-46f5-89a7-454298cdd51d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:29:29.898833 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4631b7c2-5242-46f5-89a7-454298cdd51d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:29:29.928226 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-4631b7c2-5242-46f5-89a7-454298cdd51d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/822595cd-b7f3-4d21-b8d4-c1f6da86d104/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043220 Mar 08 15:29:29.934348 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1230/2678] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:29:29 2022] GET /compute/v2.1/servers/822595cd-b7f3-4d21-b8d4-c1f6da86d104/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 08 15:29:29.986733 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-86906664-9172-4ca2-b9b9-59e3dc0cf744 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:29:29.987396 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-86906664-9172-4ca2-b9b9-59e3dc0cf744 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 822595cd-b7f3-4d21-b8d4-c1f6da86d104] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:29:29.993603 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-86906664-9172-4ca2-b9b9-59e3dc0cf744 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:29:29.994105 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-86906664-9172-4ca2-b9b9-59e3dc0cf744 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:29:29.994874 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-86906664-9172-4ca2-b9b9-59e3dc0cf744 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:29:29.995320 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-86906664-9172-4ca2-b9b9-59e3dc0cf744 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:29:30.019630 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-86906664-9172-4ca2-b9b9-59e3dc0cf744 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 822595cd-b7f3-4d21-b8d4-c1f6da86d104] Going to try to terminate instance {{(pid=128352) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 15:29:30.102174 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-86906664-9172-4ca2-b9b9-59e3dc0cf744 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "DELETE /compute/v2.1/servers/822595cd-b7f3-4d21-b8d4-c1f6da86d104" status: 204 len: 0 microversion: 2.1 time: 0.118730 Mar 08 15:29:30.103045 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1449/2679] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 15:29:29 2022] DELETE /compute/v2.1/servers/822595cd-b7f3-4d21-b8d4-c1f6da86d104 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 15:29:30.111817 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-d8c3b584-cb1b-4352-a3eb-8f3931cf9a7f tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:29:30.112437 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-d8c3b584-cb1b-4352-a3eb-8f3931cf9a7f tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 822595cd-b7f3-4d21-b8d4-c1f6da86d104] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:29:30.118218 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d8c3b584-cb1b-4352-a3eb-8f3931cf9a7f tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:29:30.118677 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d8c3b584-cb1b-4352-a3eb-8f3931cf9a7f tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:29:30.119444 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d8c3b584-cb1b-4352-a3eb-8f3931cf9a7f tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:29:30.119975 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d8c3b584-cb1b-4352-a3eb-8f3931cf9a7f tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:29:30.259372 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-d8c3b584-cb1b-4352-a3eb-8f3931cf9a7f tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282b16dbcb1648c39afa0f7ed2d5dbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf1dc206f041ca91a40149aab30dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:29:30.266770 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-d8c3b584-cb1b-4352-a3eb-8f3931cf9a7f tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/822595cd-b7f3-4d21-b8d4-c1f6da86d104" status: 200 len: 1681 microversion: 2.1 time: 0.158703 Mar 08 15:29:30.267375 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1231/2680] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:29:30 2022] GET /compute/v2.1/servers/822595cd-b7f3-4d21-b8d4-c1f6da86d104 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:29:31.286267 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-b49f16ab-02dc-4e27-a367-14116eaa527a tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:29:31.286267 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-b49f16ab-02dc-4e27-a367-14116eaa527a tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 822595cd-b7f3-4d21-b8d4-c1f6da86d104] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:29:31.292101 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b49f16ab-02dc-4e27-a367-14116eaa527a tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:29:31.292687 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b49f16ab-02dc-4e27-a367-14116eaa527a tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:29:31.293474 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b49f16ab-02dc-4e27-a367-14116eaa527a tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:29:31.293917 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-b49f16ab-02dc-4e27-a367-14116eaa527a tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:29:31.432494 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-b49f16ab-02dc-4e27-a367-14116eaa527a tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282b16dbcb1648c39afa0f7ed2d5dbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf1dc206f041ca91a40149aab30dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:29:31.440581 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-b49f16ab-02dc-4e27-a367-14116eaa527a tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/822595cd-b7f3-4d21-b8d4-c1f6da86d104" status: 200 len: 1681 microversion: 2.1 time: 0.159705 Mar 08 15:29:31.441153 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1450/2681] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:29:31 2022] GET /compute/v2.1/servers/822595cd-b7f3-4d21-b8d4-c1f6da86d104 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:29:32.459808 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-c02c9da0-c221-44a5-9d68-57e4fb96f3e2 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:29:32.460538 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-c02c9da0-c221-44a5-9d68-57e4fb96f3e2 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 822595cd-b7f3-4d21-b8d4-c1f6da86d104] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:29:32.471004 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c02c9da0-c221-44a5-9d68-57e4fb96f3e2 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:29:32.473553 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c02c9da0-c221-44a5-9d68-57e4fb96f3e2 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:29:32.475620 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c02c9da0-c221-44a5-9d68-57e4fb96f3e2 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:29:32.477119 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-c02c9da0-c221-44a5-9d68-57e4fb96f3e2 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:29:32.565355 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-c02c9da0-c221-44a5-9d68-57e4fb96f3e2 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282b16dbcb1648c39afa0f7ed2d5dbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf1dc206f041ca91a40149aab30dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:29:32.575514 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-c02c9da0-c221-44a5-9d68-57e4fb96f3e2 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/822595cd-b7f3-4d21-b8d4-c1f6da86d104" status: 200 len: 1613 microversion: 2.1 time: 0.120311 Mar 08 15:29:32.576783 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1232/2682] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:29:32 2022] GET /compute/v2.1/servers/822595cd-b7f3-4d21-b8d4-c1f6da86d104 => generated 1613 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:29:32.848432 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [req-00dbf709-a88e-4711-bba7-39468ddf9a57 req-ed056232-4273-4601-8d49-2fac352c1fed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "822595cd-b7f3-4d21-b8d4-c1f6da86d104", "name": "network-vif-deleted", "tag": "e3413d7d-8b88-44d7-9cad-6491e5f02c51"}]} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:29:32.857545 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-00dbf709-a88e-4711-bba7-39468ddf9a57 req-ed056232-4273-4601-8d49-2fac352c1fed service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:29:32.858117 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-00dbf709-a88e-4711-bba7-39468ddf9a57 req-ed056232-4273-4601-8d49-2fac352c1fed service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:29:32.872115 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.compute.server_external_events [req-00dbf709-a88e-4711-bba7-39468ddf9a57 req-ed056232-4273-4601-8d49-2fac352c1fed service nova] Creating event network-vif-deleted:e3413d7d-8b88-44d7-9cad-6491e5f02c51 for instance 822595cd-b7f3-4d21-b8d4-c1f6da86d104 on hv-cinder-83009 Mar 08 15:29:32.878054 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [req-00dbf709-a88e-4711-bba7-39468ddf9a57 req-ed056232-4273-4601-8d49-2fac352c1fed service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032920 Mar 08 15:29:32.878918 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1451/2683] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 15:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:29:33.595276 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-ec2ce642-5a4c-4ee2-942b-c4f367f71caf tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:29:33.596474 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-ec2ce642-5a4c-4ee2-942b-c4f367f71caf tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 822595cd-b7f3-4d21-b8d4-c1f6da86d104] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:29:33.614415 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ec2ce642-5a4c-4ee2-942b-c4f367f71caf tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:29:33.614869 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ec2ce642-5a4c-4ee2-942b-c4f367f71caf tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:29:33.615717 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ec2ce642-5a4c-4ee2-942b-c4f367f71caf tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:29:33.616479 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ec2ce642-5a4c-4ee2-942b-c4f367f71caf tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:29:33.659965 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ec2ce642-5a4c-4ee2-942b-c4f367f71caf tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:29:33.661533 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-ec2ce642-5a4c-4ee2-942b-c4f367f71caf tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:29:33.662092 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.objects.instance [None req-ec2ce642-5a4c-4ee2-942b-c4f367f71caf tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lazy-loading 'fault' on Instance uuid 822595cd-b7f3-4d21-b8d4-c1f6da86d104 {{(pid=128351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 15:29:33.723362 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-ec2ce642-5a4c-4ee2-942b-c4f367f71caf tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282b16dbcb1648c39afa0f7ed2d5dbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf1dc206f041ca91a40149aab30dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:29:33.730827 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-ec2ce642-5a4c-4ee2-942b-c4f367f71caf tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/822595cd-b7f3-4d21-b8d4-c1f6da86d104" status: 200 len: 1330 microversion: 2.1 time: 0.141559 Mar 08 15:29:33.731607 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1233/2684] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:29:33 2022] GET /compute/v2.1/servers/822595cd-b7f3-4d21-b8d4-c1f6da86d104 => generated 1330 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:29:34.749786 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c11b9da4-5fce-4e53-926c-5d5429f8fb6f tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:29:34.750507 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-c11b9da4-5fce-4e53-926c-5d5429f8fb6f tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 822595cd-b7f3-4d21-b8d4-c1f6da86d104] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:29:34.757323 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c11b9da4-5fce-4e53-926c-5d5429f8fb6f tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:29:34.757777 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c11b9da4-5fce-4e53-926c-5d5429f8fb6f tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:29:34.758603 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c11b9da4-5fce-4e53-926c-5d5429f8fb6f tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:29:34.759120 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-c11b9da4-5fce-4e53-926c-5d5429f8fb6f tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:29:34.773366 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-c11b9da4-5fce-4e53-926c-5d5429f8fb6f tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] HTTP exception thrown: Instance 822595cd-b7f3-4d21-b8d4-c1f6da86d104 could not be found. Mar 08 15:29:34.774080 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-c11b9da4-5fce-4e53-926c-5d5429f8fb6f tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Returning 404 to user: Instance 822595cd-b7f3-4d21-b8d4-c1f6da86d104 could not be found. {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:29:34.775013 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-c11b9da4-5fce-4e53-926c-5d5429f8fb6f tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/822595cd-b7f3-4d21-b8d4-c1f6da86d104" status: 404 len: 111 microversion: 2.1 time: 0.030371 Mar 08 15:29:34.775577 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1452/2685] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:29:34 2022] GET /compute/v2.1/servers/822595cd-b7f3-4d21-b8d4-c1f6da86d104 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 15:29:34.784797 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-3afc2fb4-ffec-460a-8803-385a76c682ce tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '.version_select at 0x7ff35ce9b1f0>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:29:34.805144 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-3afc2fb4-ffec-460a-8803-385a76c682ce tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1138614188" status: 202 len: 0 microversion: 2.1 time: 0.024058 Mar 08 15:29:34.805708 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1234/2686] 10.222.0.30 () {58 vars in 1220 bytes} [Tue Mar 8 15:29:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1138614188 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 15:29:35.623540 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-cae5d632-2b13-4b4e-8774-a174d0874236 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Action: 'create', calling method: .version_select at 0x7ff35d02cf70>, body: {"keypair": {"name": "tempest-keypair-1188948034"}} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:29:35.638970 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.quota [None req-cae5d632-2b13-4b4e-8774-a174d0874236 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Getting quotas for project e4bf1dc206f041ca91a40149aab30dee. Resources: {'key_pairs'} {{(pid=128352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 15:29:35.642894 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.quota [None req-cae5d632-2b13-4b4e-8774-a174d0874236 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Getting quotas for user 282b16dbcb1648c39afa0f7ed2d5dbda and project e4bf1dc206f041ca91a40149aab30dee. Resources: {'key_pairs'} {{(pid=128352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 15:29:36.065996 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.quota [None req-cae5d632-2b13-4b4e-8774-a174d0874236 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Getting quotas for project e4bf1dc206f041ca91a40149aab30dee. Resources: {'key_pairs'} {{(pid=128352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 15:29:36.069841 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.quota [None req-cae5d632-2b13-4b4e-8774-a174d0874236 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Getting quotas for user 282b16dbcb1648c39afa0f7ed2d5dbda and project e4bf1dc206f041ca91a40149aab30dee. Resources: {'key_pairs'} {{(pid=128352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 15:29:36.082921 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-cae5d632-2b13-4b4e-8774-a174d0874236 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.463496 Mar 08 15:29:36.083490 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1453/2687] 10.222.0.30 () {60 vars in 1157 bytes} [Tue Mar 8 15:29:35 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:29:37.373994 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-311ded11-d71f-403f-a61d-3575d4d4875d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-163891951", "imageRef": "7541d53b-003d-4f1a-8d76-fc5f4bd8dabf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fd27055d-8ae6-4d4d-a095-42195ed67196"}], "security_groups": [{"name": "tempest-securitygroup--1155145303"}], "key_name": "tempest-keypair-1188948034", "user_data": "}} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:29:37.475497 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.network.neutron [None req-311ded11-d71f-403f-a61d-3575d4d4875d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] validate_networks() for [('fd27055d-8ae6-4d4d-a095-42195ed67196', None, None, None, None, None)] {{(pid=128351) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 15:29:37.837919 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-311ded11-d71f-403f-a61d-3575d4d4875d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Flavor limits 0:0:0 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 15:29:37.838381 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-311ded11-d71f-403f-a61d-3575d4d4875d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Image limits 0:0:0 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 15:29:37.839453 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-311ded11-d71f-403f-a61d-3575d4d4875d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Flavor pref 0:0:0 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 15:29:37.840393 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-311ded11-d71f-403f-a61d-3575d4d4875d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Image pref 0:0:0 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 15:29:37.840806 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.virt.hardware [None req-311ded11-d71f-403f-a61d-3575d4d4875d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 15:29:37.849275 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-311ded11-d71f-403f-a61d-3575d4d4875d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:29:37.849725 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-311ded11-d71f-403f-a61d-3575d4d4875d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:29:37.850561 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-311ded11-d71f-403f-a61d-3575d4d4875d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:29:37.850999 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-311ded11-d71f-403f-a61d-3575d4d4875d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:29:37.867214 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.quota [None req-311ded11-d71f-403f-a61d-3575d4d4875d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Getting quotas for project e4bf1dc206f041ca91a40149aab30dee. Resources: {'instances', 'ram', 'cores'} {{(pid=128351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 15:29:37.871479 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.quota [None req-311ded11-d71f-403f-a61d-3575d4d4875d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Getting quotas for user 282b16dbcb1648c39afa0f7ed2d5dbda and project e4bf1dc206f041ca91a40149aab30dee. Resources: {'instances', 'ram', 'cores'} {{(pid=128351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 15:29:37.882336 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-311ded11-d71f-403f-a61d-3575d4d4875d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Going to run 1 instances... {{(pid=128351) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 15:29:37.884584 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-311ded11-d71f-403f-a61d-3575d4d4875d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 6aeba28c-90ca-4475-9627-5ddf12c128ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7541d53b-003d-4f1a-8d76-fc5f4bd8dabf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 15:29:37.933158 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-311ded11-d71f-403f-a61d-3575d4d4875d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.564385 Mar 08 15:29:37.934138 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1235/2688] 10.222.0.30 () {60 vars in 1146 bytes} [Tue Mar 8 15:29:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 15:29:37.947924 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-1850164a-acfb-4180-b3f4-767da173f3cc tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:29:37.950291 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-1850164a-acfb-4180-b3f4-767da173f3cc tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 6aeba28c-90ca-4475-9627-5ddf12c128ed] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:29:38.004252 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-1850164a-acfb-4180-b3f4-767da173f3cc tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282b16dbcb1648c39afa0f7ed2d5dbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf1dc206f041ca91a40149aab30dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:29:38.011689 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-1850164a-acfb-4180-b3f4-767da173f3cc tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/6aeba28c-90ca-4475-9627-5ddf12c128ed" status: 200 len: 1241 microversion: 2.1 time: 0.067584 Mar 08 15:29:38.012240 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1454/2689] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:29:37 2022] GET /compute/v2.1/servers/6aeba28c-90ca-4475-9627-5ddf12c128ed => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:29:39.029540 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b3ec8afe-ad72-4778-a8c0-807907e341ca tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:29:39.030195 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-b3ec8afe-ad72-4778-a8c0-807907e341ca tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 6aeba28c-90ca-4475-9627-5ddf12c128ed] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:29:39.036817 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b3ec8afe-ad72-4778-a8c0-807907e341ca tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:29:39.037313 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b3ec8afe-ad72-4778-a8c0-807907e341ca tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:29:39.038106 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b3ec8afe-ad72-4778-a8c0-807907e341ca tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:29:39.038543 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b3ec8afe-ad72-4778-a8c0-807907e341ca tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:29:39.128050 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-b3ec8afe-ad72-4778-a8c0-807907e341ca tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282b16dbcb1648c39afa0f7ed2d5dbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf1dc206f041ca91a40149aab30dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:29:39.135231 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-b3ec8afe-ad72-4778-a8c0-807907e341ca tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/6aeba28c-90ca-4475-9627-5ddf12c128ed" status: 200 len: 1299 microversion: 2.1 time: 0.110949 Mar 08 15:29:39.135835 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1236/2690] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:29:39 2022] GET /compute/v2.1/servers/6aeba28c-90ca-4475-9627-5ddf12c128ed => generated 1299 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:29:40.152966 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-da02fce8-d60e-4d41-9c59-3a5078767b6a tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:29:40.153579 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-da02fce8-d60e-4d41-9c59-3a5078767b6a tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 6aeba28c-90ca-4475-9627-5ddf12c128ed] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:29:40.159885 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-da02fce8-d60e-4d41-9c59-3a5078767b6a tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:29:40.160586 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-da02fce8-d60e-4d41-9c59-3a5078767b6a tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:29:40.161375 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-da02fce8-d60e-4d41-9c59-3a5078767b6a tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:29:40.161810 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-da02fce8-d60e-4d41-9c59-3a5078767b6a tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:29:40.253007 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [req-deffe826-f7ef-481f-a6f8-8b5467125fdd req-9f1b0e0b-412e-4d43-8ceb-fa358b5fe9e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6aeba28c-90ca-4475-9627-5ddf12c128ed", "tag": "3c27839d-6186-4f30-be86-38593b916a68"}]} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:29:40.262815 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-deffe826-f7ef-481f-a6f8-8b5467125fdd req-9f1b0e0b-412e-4d43-8ceb-fa358b5fe9e1 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:29:40.263267 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-deffe826-f7ef-481f-a6f8-8b5467125fdd req-9f1b0e0b-412e-4d43-8ceb-fa358b5fe9e1 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:29:40.278137 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.compute.server_external_events [req-deffe826-f7ef-481f-a6f8-8b5467125fdd req-9f1b0e0b-412e-4d43-8ceb-fa358b5fe9e1 service nova] Creating event network-changed:3c27839d-6186-4f30-be86-38593b916a68 for instance 6aeba28c-90ca-4475-9627-5ddf12c128ed on hv-cinder-83009 Mar 08 15:29:40.283338 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [req-deffe826-f7ef-481f-a6f8-8b5467125fdd req-9f1b0e0b-412e-4d43-8ceb-fa358b5fe9e1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033932 Mar 08 15:29:40.284012 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1237/2691] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 15:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 15:29:40.332414 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-da02fce8-d60e-4d41-9c59-3a5078767b6a tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282b16dbcb1648c39afa0f7ed2d5dbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf1dc206f041ca91a40149aab30dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:29:40.341961 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-da02fce8-d60e-4d41-9c59-3a5078767b6a tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/6aeba28c-90ca-4475-9627-5ddf12c128ed" status: 200 len: 1367 microversion: 2.1 time: 0.193526 Mar 08 15:29:40.342743 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1455/2692] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:29:40 2022] GET /compute/v2.1/servers/6aeba28c-90ca-4475-9627-5ddf12c128ed => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:29:41.360388 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-4138e5dc-c517-438f-a243-331598cbae7f tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:29:41.361090 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-4138e5dc-c517-438f-a243-331598cbae7f tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 6aeba28c-90ca-4475-9627-5ddf12c128ed] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:29:41.367028 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4138e5dc-c517-438f-a243-331598cbae7f tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:29:41.367480 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4138e5dc-c517-438f-a243-331598cbae7f tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:29:41.368245 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4138e5dc-c517-438f-a243-331598cbae7f tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:29:41.368677 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4138e5dc-c517-438f-a243-331598cbae7f tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:29:41.585506 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-4138e5dc-c517-438f-a243-331598cbae7f tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282b16dbcb1648c39afa0f7ed2d5dbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf1dc206f041ca91a40149aab30dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:29:41.592868 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-4138e5dc-c517-438f-a243-331598cbae7f tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/6aeba28c-90ca-4475-9627-5ddf12c128ed" status: 200 len: 1367 microversion: 2.1 time: 0.237174 Mar 08 15:29:41.593463 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1238/2693] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:29:41 2022] GET /compute/v2.1/servers/6aeba28c-90ca-4475-9627-5ddf12c128ed => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:29:42.610230 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-108b436c-27d8-464e-ac8e-c50021e9b4be tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:29:42.610843 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-108b436c-27d8-464e-ac8e-c50021e9b4be tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 6aeba28c-90ca-4475-9627-5ddf12c128ed] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:29:42.617381 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-108b436c-27d8-464e-ac8e-c50021e9b4be tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:29:42.617828 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-108b436c-27d8-464e-ac8e-c50021e9b4be tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:29:42.618614 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-108b436c-27d8-464e-ac8e-c50021e9b4be tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:29:42.619048 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-108b436c-27d8-464e-ac8e-c50021e9b4be tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:29:42.754927 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-108b436c-27d8-464e-ac8e-c50021e9b4be tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282b16dbcb1648c39afa0f7ed2d5dbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf1dc206f041ca91a40149aab30dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:29:42.762487 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-108b436c-27d8-464e-ac8e-c50021e9b4be tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/6aeba28c-90ca-4475-9627-5ddf12c128ed" status: 200 len: 1367 microversion: 2.1 time: 0.156020 Mar 08 15:29:42.763014 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1456/2694] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:29:42 2022] GET /compute/v2.1/servers/6aeba28c-90ca-4475-9627-5ddf12c128ed => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:29:43.779658 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-983442d9-f094-4475-a97e-565c0a2f92b5 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:29:43.780236 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-983442d9-f094-4475-a97e-565c0a2f92b5 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 6aeba28c-90ca-4475-9627-5ddf12c128ed] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:29:43.786159 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-983442d9-f094-4475-a97e-565c0a2f92b5 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:29:43.786609 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-983442d9-f094-4475-a97e-565c0a2f92b5 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:29:43.787375 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-983442d9-f094-4475-a97e-565c0a2f92b5 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:29:43.787809 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-983442d9-f094-4475-a97e-565c0a2f92b5 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:29:43.927958 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-983442d9-f094-4475-a97e-565c0a2f92b5 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282b16dbcb1648c39afa0f7ed2d5dbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf1dc206f041ca91a40149aab30dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:29:43.936099 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-983442d9-f094-4475-a97e-565c0a2f92b5 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/6aeba28c-90ca-4475-9627-5ddf12c128ed" status: 200 len: 1367 microversion: 2.1 time: 0.160664 Mar 08 15:29:43.944197 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1239/2695] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:29:43 2022] GET /compute/v2.1/servers/6aeba28c-90ca-4475-9627-5ddf12c128ed => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:29:44.953976 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-da8fd66f-0641-4dfe-93e6-4910e541a4da tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:29:44.954617 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-da8fd66f-0641-4dfe-93e6-4910e541a4da tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 6aeba28c-90ca-4475-9627-5ddf12c128ed] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:29:44.960455 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-da8fd66f-0641-4dfe-93e6-4910e541a4da tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:29:44.960902 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-da8fd66f-0641-4dfe-93e6-4910e541a4da tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:29:44.961665 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-da8fd66f-0641-4dfe-93e6-4910e541a4da tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:29:44.962133 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-da8fd66f-0641-4dfe-93e6-4910e541a4da tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:29:45.096305 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-da8fd66f-0641-4dfe-93e6-4910e541a4da tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282b16dbcb1648c39afa0f7ed2d5dbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf1dc206f041ca91a40149aab30dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:29:45.103551 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-da8fd66f-0641-4dfe-93e6-4910e541a4da tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/6aeba28c-90ca-4475-9627-5ddf12c128ed" status: 200 len: 1367 microversion: 2.1 time: 0.154758 Mar 08 15:29:45.104114 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1457/2696] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:29:44 2022] GET /compute/v2.1/servers/6aeba28c-90ca-4475-9627-5ddf12c128ed => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:29:45.938323 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [req-3175b7f8-2ae0-41c9-a36a-579387f889d8 req-e3185b84-380b-4830-b87e-0bad1a65fee1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aeba28c-90ca-4475-9627-5ddf12c128ed", "name": "network-vif-plugged", "status": "completed", "tag": "3c27839d-6186-4f30-be86-38593b916a68"}]} {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:29:45.952701 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-3175b7f8-2ae0-41c9-a36a-579387f889d8 req-e3185b84-380b-4830-b87e-0bad1a65fee1 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:29:45.953813 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [req-3175b7f8-2ae0-41c9-a36a-579387f889d8 req-e3185b84-380b-4830-b87e-0bad1a65fee1 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:29:45.966671 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.compute.server_external_events [req-3175b7f8-2ae0-41c9-a36a-579387f889d8 req-e3185b84-380b-4830-b87e-0bad1a65fee1 service nova] Creating event network-vif-plugged:3c27839d-6186-4f30-be86-38593b916a68 for instance 6aeba28c-90ca-4475-9627-5ddf12c128ed on hv-cinder-83009 Mar 08 15:29:45.972624 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [req-3175b7f8-2ae0-41c9-a36a-579387f889d8 req-e3185b84-380b-4830-b87e-0bad1a65fee1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038224 Mar 08 15:29:45.973549 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1240/2697] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 15:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:29:46.122909 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-cd675bb2-10e2-45af-a011-f9598e2a5433 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:29:46.123604 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-cd675bb2-10e2-45af-a011-f9598e2a5433 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 6aeba28c-90ca-4475-9627-5ddf12c128ed] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:29:46.130307 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cd675bb2-10e2-45af-a011-f9598e2a5433 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:29:46.130759 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cd675bb2-10e2-45af-a011-f9598e2a5433 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:29:46.131538 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cd675bb2-10e2-45af-a011-f9598e2a5433 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:29:46.131989 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-cd675bb2-10e2-45af-a011-f9598e2a5433 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:29:46.269422 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-cd675bb2-10e2-45af-a011-f9598e2a5433 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282b16dbcb1648c39afa0f7ed2d5dbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf1dc206f041ca91a40149aab30dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:29:46.276900 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-cd675bb2-10e2-45af-a011-f9598e2a5433 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/6aeba28c-90ca-4475-9627-5ddf12c128ed" status: 200 len: 1367 microversion: 2.1 time: 0.159992 Mar 08 15:29:46.278075 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1458/2698] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:29:46 2022] GET /compute/v2.1/servers/6aeba28c-90ca-4475-9627-5ddf12c128ed => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:29:47.294862 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-6a505ab5-c3b8-499f-85aa-73f54d815015 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:29:47.295560 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-6a505ab5-c3b8-499f-85aa-73f54d815015 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 6aeba28c-90ca-4475-9627-5ddf12c128ed] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:29:47.302196 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6a505ab5-c3b8-499f-85aa-73f54d815015 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:29:47.302717 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6a505ab5-c3b8-499f-85aa-73f54d815015 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:29:47.303549 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6a505ab5-c3b8-499f-85aa-73f54d815015 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:29:47.304068 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6a505ab5-c3b8-499f-85aa-73f54d815015 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:29:47.461391 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-6a505ab5-c3b8-499f-85aa-73f54d815015 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282b16dbcb1648c39afa0f7ed2d5dbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf1dc206f041ca91a40149aab30dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:29:47.470393 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-6a505ab5-c3b8-499f-85aa-73f54d815015 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/6aeba28c-90ca-4475-9627-5ddf12c128ed" status: 200 len: 1367 microversion: 2.1 time: 0.179852 Mar 08 15:29:47.471142 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1241/2699] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:29:47 2022] GET /compute/v2.1/servers/6aeba28c-90ca-4475-9627-5ddf12c128ed => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:29:48.487415 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-9fb84c88-28b6-4f3b-be16-72c494d9545d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:29:48.488037 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-9fb84c88-28b6-4f3b-be16-72c494d9545d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 6aeba28c-90ca-4475-9627-5ddf12c128ed] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:29:48.494721 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9fb84c88-28b6-4f3b-be16-72c494d9545d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:29:48.495241 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9fb84c88-28b6-4f3b-be16-72c494d9545d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:29:48.496684 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9fb84c88-28b6-4f3b-be16-72c494d9545d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:29:48.497157 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-9fb84c88-28b6-4f3b-be16-72c494d9545d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:29:48.631672 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-9fb84c88-28b6-4f3b-be16-72c494d9545d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282b16dbcb1648c39afa0f7ed2d5dbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf1dc206f041ca91a40149aab30dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:29:48.639283 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-9fb84c88-28b6-4f3b-be16-72c494d9545d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/6aeba28c-90ca-4475-9627-5ddf12c128ed" status: 200 len: 1557 microversion: 2.1 time: 0.155815 Mar 08 15:29:48.639856 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1459/2700] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:29:48 2022] GET /compute/v2.1/servers/6aeba28c-90ca-4475-9627-5ddf12c128ed => generated 1557 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:29:48.656287 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-23bfd12b-25d7-40c7-9867-3907b4aafd4d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:29:48.656783 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-23bfd12b-25d7-40c7-9867-3907b4aafd4d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 6aeba28c-90ca-4475-9627-5ddf12c128ed] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:29:48.662914 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-23bfd12b-25d7-40c7-9867-3907b4aafd4d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:29:48.663364 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-23bfd12b-25d7-40c7-9867-3907b4aafd4d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:29:48.664113 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-23bfd12b-25d7-40c7-9867-3907b4aafd4d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:29:48.664551 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-23bfd12b-25d7-40c7-9867-3907b4aafd4d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:29:48.748442 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-23bfd12b-25d7-40c7-9867-3907b4aafd4d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/6aeba28c-90ca-4475-9627-5ddf12c128ed/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096431 Mar 08 15:29:48.749029 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1242/2701] 10.222.0.30 () {58 vars in 1274 bytes} [Tue Mar 8 15:29:48 2022] GET /compute/v2.1/servers/6aeba28c-90ca-4475-9627-5ddf12c128ed/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 15:29:49.968728 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [req-c6ff4280-e716-456a-8117-3078828f0f1a req-26ebd96f-8b70-4852-9019-a36114cfd721 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6aeba28c-90ca-4475-9627-5ddf12c128ed", "tag": "3c27839d-6186-4f30-be86-38593b916a68"}]} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:29:49.976783 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-c6ff4280-e716-456a-8117-3078828f0f1a req-26ebd96f-8b70-4852-9019-a36114cfd721 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:29:49.977232 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-c6ff4280-e716-456a-8117-3078828f0f1a req-26ebd96f-8b70-4852-9019-a36114cfd721 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:29:49.988532 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.compute.server_external_events [req-c6ff4280-e716-456a-8117-3078828f0f1a req-26ebd96f-8b70-4852-9019-a36114cfd721 service nova] Creating event network-changed:3c27839d-6186-4f30-be86-38593b916a68 for instance 6aeba28c-90ca-4475-9627-5ddf12c128ed on hv-cinder-83009 Mar 08 15:29:49.993518 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [req-c6ff4280-e716-456a-8117-3078828f0f1a req-26ebd96f-8b70-4852-9019-a36114cfd721 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029171 Mar 08 15:29:49.994339 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1460/2702] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 15:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:30:34.859140 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-d8ca044b-2405-4a38-8396-73b468cf82be tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:30:34.859725 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-d8ca044b-2405-4a38-8396-73b468cf82be tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 6aeba28c-90ca-4475-9627-5ddf12c128ed] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:30:34.866069 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d8ca044b-2405-4a38-8396-73b468cf82be tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:30:34.866519 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d8ca044b-2405-4a38-8396-73b468cf82be tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:30:34.867406 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d8ca044b-2405-4a38-8396-73b468cf82be tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:30:34.867853 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-d8ca044b-2405-4a38-8396-73b468cf82be tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:30:34.891031 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-d8ca044b-2405-4a38-8396-73b468cf82be tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/6aeba28c-90ca-4475-9627-5ddf12c128ed/ips" status: 200 len: 149 microversion: 2.1 time: 0.036498 Mar 08 15:30:34.891610 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1243/2703] 10.222.0.30 () {58 vars in 1247 bytes} [Tue Mar 8 15:30:34 2022] GET /compute/v2.1/servers/6aeba28c-90ca-4475-9627-5ddf12c128ed/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:30:36.204258 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-747a8cd1-ce32-4ffc-a0db-29c4185f46c4 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cfbdad04-4500-4dc4-b71f-024f9a2f6f8e"}} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:30:36.205326 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-747a8cd1-ce32-4ffc-a0db-29c4185f46c4 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 6aeba28c-90ca-4475-9627-5ddf12c128ed] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:30:36.211623 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-747a8cd1-ce32-4ffc-a0db-29c4185f46c4 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:30:36.212081 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-747a8cd1-ce32-4ffc-a0db-29c4185f46c4 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:30:36.212851 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-747a8cd1-ce32-4ffc-a0db-29c4185f46c4 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:30:36.213290 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-747a8cd1-ce32-4ffc-a0db-29c4185f46c4 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:30:36.460478 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-747a8cd1-ce32-4ffc-a0db-29c4185f46c4 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "POST /compute/v2.1/servers/6aeba28c-90ca-4475-9627-5ddf12c128ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260955 Mar 08 15:30:36.461001 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1461/2704] 10.222.0.30 () {60 vars in 1322 bytes} [Tue Mar 8 15:30:36 2022] POST /compute/v2.1/servers/6aeba28c-90ca-4475-9627-5ddf12c128ed/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:30:44.024964 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-b4d445e6-3a8a-4318-aea0-6ee731c36435 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:30:44.025519 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-b4d445e6-3a8a-4318-aea0-6ee731c36435 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 6aeba28c-90ca-4475-9627-5ddf12c128ed] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:30:44.031285 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b4d445e6-3a8a-4318-aea0-6ee731c36435 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:30:44.031736 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b4d445e6-3a8a-4318-aea0-6ee731c36435 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:30:44.032500 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b4d445e6-3a8a-4318-aea0-6ee731c36435 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:30:44.032943 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-b4d445e6-3a8a-4318-aea0-6ee731c36435 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:30:44.109259 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.objects.instance [None req-b4d445e6-3a8a-4318-aea0-6ee731c36435 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lazy-loading 'services' on Instance uuid 6aeba28c-90ca-4475-9627-5ddf12c128ed {{(pid=128351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 15:30:44.183817 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-b4d445e6-3a8a-4318-aea0-6ee731c36435 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6aeba28c-90ca-4475-9627-5ddf12c128ed/os-volume_attachments/cfbdad04-4500-4dc4-b71f-024f9a2f6f8e" status: 202 len: 0 microversion: 2.1 time: 0.163486 Mar 08 15:30:44.184431 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1244/2705] 10.222.0.30 () {58 vars in 1415 bytes} [Tue Mar 8 15:30:44 2022] DELETE /compute/v2.1/servers/6aeba28c-90ca-4475-9627-5ddf12c128ed/os-volume_attachments/cfbdad04-4500-4dc4-b71f-024f9a2f6f8e => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 15:30:44.194425 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-742c06cf-46b3-4102-930b-7bd11002cf1d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:30:44.195612 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-742c06cf-46b3-4102-930b-7bd11002cf1d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 6aeba28c-90ca-4475-9627-5ddf12c128ed] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:30:44.201802 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-742c06cf-46b3-4102-930b-7bd11002cf1d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:30:44.202377 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-742c06cf-46b3-4102-930b-7bd11002cf1d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:30:44.204267 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-742c06cf-46b3-4102-930b-7bd11002cf1d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:30:44.204712 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-742c06cf-46b3-4102-930b-7bd11002cf1d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:30:44.236763 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-742c06cf-46b3-4102-930b-7bd11002cf1d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/6aeba28c-90ca-4475-9627-5ddf12c128ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047651 Mar 08 15:30:44.237325 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1462/2706] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:30:44 2022] GET /compute/v2.1/servers/6aeba28c-90ca-4475-9627-5ddf12c128ed/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 15:30:45.249653 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-4be6d2bc-5d86-4c3a-bc6d-882706937dbc tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:30:45.250707 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-4be6d2bc-5d86-4c3a-bc6d-882706937dbc tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 6aeba28c-90ca-4475-9627-5ddf12c128ed] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:30:45.257485 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4be6d2bc-5d86-4c3a-bc6d-882706937dbc tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:30:45.257975 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4be6d2bc-5d86-4c3a-bc6d-882706937dbc tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:30:45.258747 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4be6d2bc-5d86-4c3a-bc6d-882706937dbc tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:30:45.259190 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-4be6d2bc-5d86-4c3a-bc6d-882706937dbc tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:30:45.287377 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-4be6d2bc-5d86-4c3a-bc6d-882706937dbc tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/6aeba28c-90ca-4475-9627-5ddf12c128ed/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042449 Mar 08 15:30:45.287922 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1245/2707] 10.222.0.30 () {58 vars in 1301 bytes} [Tue Mar 8 15:30:45 2022] GET /compute/v2.1/servers/6aeba28c-90ca-4475-9627-5ddf12c128ed/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 08 15:30:45.344255 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-fa3d8dff-d4b5-4c30-bfa1-6104aa0b6928 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:30:45.344774 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-fa3d8dff-d4b5-4c30-bfa1-6104aa0b6928 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 6aeba28c-90ca-4475-9627-5ddf12c128ed] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:30:45.351125 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fa3d8dff-d4b5-4c30-bfa1-6104aa0b6928 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:30:45.351577 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fa3d8dff-d4b5-4c30-bfa1-6104aa0b6928 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:30:45.352330 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fa3d8dff-d4b5-4c30-bfa1-6104aa0b6928 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:30:45.352761 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-fa3d8dff-d4b5-4c30-bfa1-6104aa0b6928 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:30:45.375785 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-fa3d8dff-d4b5-4c30-bfa1-6104aa0b6928 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 6aeba28c-90ca-4475-9627-5ddf12c128ed] Going to try to terminate instance {{(pid=128352) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 15:30:45.448261 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-fa3d8dff-d4b5-4c30-bfa1-6104aa0b6928 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6aeba28c-90ca-4475-9627-5ddf12c128ed" status: 204 len: 0 microversion: 2.1 time: 0.107557 Mar 08 15:30:45.448831 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1463/2708] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 15:30:45 2022] DELETE /compute/v2.1/servers/6aeba28c-90ca-4475-9627-5ddf12c128ed => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 15:30:45.456927 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-0dd90740-d834-422d-bb01-14a14a53610a tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:30:45.457608 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-0dd90740-d834-422d-bb01-14a14a53610a tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 6aeba28c-90ca-4475-9627-5ddf12c128ed] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:30:45.463505 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0dd90740-d834-422d-bb01-14a14a53610a tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:30:45.463956 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0dd90740-d834-422d-bb01-14a14a53610a tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:30:45.464712 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0dd90740-d834-422d-bb01-14a14a53610a tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:30:45.465144 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-0dd90740-d834-422d-bb01-14a14a53610a tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:30:45.606855 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-0dd90740-d834-422d-bb01-14a14a53610a tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282b16dbcb1648c39afa0f7ed2d5dbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf1dc206f041ca91a40149aab30dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:30:45.614677 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-0dd90740-d834-422d-bb01-14a14a53610a tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/6aeba28c-90ca-4475-9627-5ddf12c128ed" status: 200 len: 1681 microversion: 2.1 time: 0.161658 Mar 08 15:30:45.615234 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1246/2709] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:30:45 2022] GET /compute/v2.1/servers/6aeba28c-90ca-4475-9627-5ddf12c128ed => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 15:30:46.632096 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-2f8ce979-0f16-4a26-a5b7-43f6a6ea5f7d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:30:46.632806 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-2f8ce979-0f16-4a26-a5b7-43f6a6ea5f7d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 6aeba28c-90ca-4475-9627-5ddf12c128ed] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:30:46.639306 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2f8ce979-0f16-4a26-a5b7-43f6a6ea5f7d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:30:46.639768 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2f8ce979-0f16-4a26-a5b7-43f6a6ea5f7d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:30:46.640544 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2f8ce979-0f16-4a26-a5b7-43f6a6ea5f7d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:30:46.640984 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-2f8ce979-0f16-4a26-a5b7-43f6a6ea5f7d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:30:46.777700 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.policy [None req-2f8ce979-0f16-4a26-a5b7-43f6a6ea5f7d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282b16dbcb1648c39afa0f7ed2d5dbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf1dc206f041ca91a40149aab30dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128352) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:30:46.785013 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-2f8ce979-0f16-4a26-a5b7-43f6a6ea5f7d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/6aeba28c-90ca-4475-9627-5ddf12c128ed" status: 200 len: 1681 microversion: 2.1 time: 0.157200 Mar 08 15:30:46.786655 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1464/2710] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:30:46 2022] GET /compute/v2.1/servers/6aeba28c-90ca-4475-9627-5ddf12c128ed => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:30:47.803240 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-76ea9c93-decb-4cb1-88c0-0b3753705114 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:30:47.803853 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-76ea9c93-decb-4cb1-88c0-0b3753705114 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 6aeba28c-90ca-4475-9627-5ddf12c128ed] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:30:47.810610 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-76ea9c93-decb-4cb1-88c0-0b3753705114 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:30:47.811065 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-76ea9c93-decb-4cb1-88c0-0b3753705114 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:30:47.811830 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-76ea9c93-decb-4cb1-88c0-0b3753705114 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:30:47.812280 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-76ea9c93-decb-4cb1-88c0-0b3753705114 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:30:47.893905 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.policy [None req-76ea9c93-decb-4cb1-88c0-0b3753705114 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282b16dbcb1648c39afa0f7ed2d5dbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf1dc206f041ca91a40149aab30dee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128351) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 15:30:47.902113 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-76ea9c93-decb-4cb1-88c0-0b3753705114 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/6aeba28c-90ca-4475-9627-5ddf12c128ed" status: 200 len: 1613 microversion: 2.1 time: 0.103034 Mar 08 15:30:47.902679 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1247/2711] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:30:47 2022] GET /compute/v2.1/servers/6aeba28c-90ca-4475-9627-5ddf12c128ed => generated 1613 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 15:30:48.358721 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [req-3e32a3db-bec6-4984-a029-b76b1f805f8f req-2a36fab1-8549-49d2-9c32-234e47b4e182 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aeba28c-90ca-4475-9627-5ddf12c128ed", "name": "network-vif-deleted", "tag": "3c27839d-6186-4f30-be86-38593b916a68"}]} {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 15:30:48.368807 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-3e32a3db-bec6-4984-a029-b76b1f805f8f req-2a36fab1-8549-49d2-9c32-234e47b4e182 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:30:48.369253 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [req-3e32a3db-bec6-4984-a029-b76b1f805f8f req-2a36fab1-8549-49d2-9c32-234e47b4e182 service nova] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:30:48.386459 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.compute.server_external_events [req-3e32a3db-bec6-4984-a029-b76b1f805f8f req-2a36fab1-8549-49d2-9c32-234e47b4e182 service nova] Creating event network-vif-deleted:3c27839d-6186-4f30-be86-38593b916a68 for instance 6aeba28c-90ca-4475-9627-5ddf12c128ed on hv-cinder-83009 Mar 08 15:30:48.391378 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [req-3e32a3db-bec6-4984-a029-b76b1f805f8f req-2a36fab1-8549-49d2-9c32-234e47b4e182 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036401 Mar 08 15:30:48.392004 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1465/2712] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Mar 8 15:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 15:30:48.919874 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-250a955e-93fc-4e2d-839e-f7e4ef02d925 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:30:48.920478 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-250a955e-93fc-4e2d-839e-f7e4ef02d925 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 6aeba28c-90ca-4475-9627-5ddf12c128ed] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:30:48.927854 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-250a955e-93fc-4e2d-839e-f7e4ef02d925 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:30:48.928312 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-250a955e-93fc-4e2d-839e-f7e4ef02d925 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:30:48.929084 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-250a955e-93fc-4e2d-839e-f7e4ef02d925 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:30:48.929528 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-250a955e-93fc-4e2d-839e-f7e4ef02d925 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:30:48.942873 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.wsgi [None req-250a955e-93fc-4e2d-839e-f7e4ef02d925 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] HTTP exception thrown: Instance 6aeba28c-90ca-4475-9627-5ddf12c128ed could not be found. Mar 08 15:30:48.943479 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-250a955e-93fc-4e2d-839e-f7e4ef02d925 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Returning 404 to user: Instance 6aeba28c-90ca-4475-9627-5ddf12c128ed could not be found. {{(pid=128351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:30:48.944312 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-250a955e-93fc-4e2d-839e-f7e4ef02d925 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/6aeba28c-90ca-4475-9627-5ddf12c128ed" status: 404 len: 111 microversion: 2.1 time: 0.028598 Mar 08 15:30:48.945053 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1248/2713] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:30:48 2022] GET /compute/v2.1/servers/6aeba28c-90ca-4475-9627-5ddf12c128ed => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 15:30:48.953729 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-00d5a205-8bd1-4c8a-bc59-7e5d6e47c0af tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '.version_select at 0x7ff35d02cf70>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:30:48.971466 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-00d5a205-8bd1-4c8a-bc59-7e5d6e47c0af tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1188948034" status: 202 len: 0 microversion: 2.1 time: 0.021798 Mar 08 15:30:48.973390 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1466/2714] 10.222.0.30 () {58 vars in 1220 bytes} [Tue Mar 8 15:30:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1188948034 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 15:30:50.737400 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-6ff8458b-e6da-4fbb-a783-fc5cde149ed3 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:30:50.737903 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-6ff8458b-e6da-4fbb-a783-fc5cde149ed3 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 6aeba28c-90ca-4475-9627-5ddf12c128ed] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:30:50.744983 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6ff8458b-e6da-4fbb-a783-fc5cde149ed3 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:30:50.745432 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6ff8458b-e6da-4fbb-a783-fc5cde149ed3 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:30:50.746219 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6ff8458b-e6da-4fbb-a783-fc5cde149ed3 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:30:50.746650 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-6ff8458b-e6da-4fbb-a783-fc5cde149ed3 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:30:50.760121 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.wsgi [None req-6ff8458b-e6da-4fbb-a783-fc5cde149ed3 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] HTTP exception thrown: Instance 6aeba28c-90ca-4475-9627-5ddf12c128ed could not be found. Mar 08 15:30:50.760691 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-6ff8458b-e6da-4fbb-a783-fc5cde149ed3 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Returning 404 to user: Instance 6aeba28c-90ca-4475-9627-5ddf12c128ed could not be found. {{(pid=128351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:30:50.761489 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-6ff8458b-e6da-4fbb-a783-fc5cde149ed3 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6aeba28c-90ca-4475-9627-5ddf12c128ed" status: 404 len: 111 microversion: 2.1 time: 0.027923 Mar 08 15:30:50.762030 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1249/2715] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 15:30:50 2022] DELETE /compute/v2.1/servers/6aeba28c-90ca-4475-9627-5ddf12c128ed => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 15:30:50.770383 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-248fbb5a-c1d2-496d-ba32-07142b83c24d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:30:50.771147 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-248fbb5a-c1d2-496d-ba32-07142b83c24d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 6aeba28c-90ca-4475-9627-5ddf12c128ed] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:30:50.777413 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-248fbb5a-c1d2-496d-ba32-07142b83c24d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:30:50.777885 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-248fbb5a-c1d2-496d-ba32-07142b83c24d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:30:50.778643 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-248fbb5a-c1d2-496d-ba32-07142b83c24d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:30:50.779083 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-248fbb5a-c1d2-496d-ba32-07142b83c24d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:30:50.792011 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-248fbb5a-c1d2-496d-ba32-07142b83c24d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] HTTP exception thrown: Instance 6aeba28c-90ca-4475-9627-5ddf12c128ed could not be found. Mar 08 15:30:50.792651 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-248fbb5a-c1d2-496d-ba32-07142b83c24d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Returning 404 to user: Instance 6aeba28c-90ca-4475-9627-5ddf12c128ed could not be found. {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:30:50.793407 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-248fbb5a-c1d2-496d-ba32-07142b83c24d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/6aeba28c-90ca-4475-9627-5ddf12c128ed" status: 404 len: 111 microversion: 2.1 time: 0.027516 Mar 08 15:30:50.793951 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1467/2716] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:30:50 2022] GET /compute/v2.1/servers/6aeba28c-90ca-4475-9627-5ddf12c128ed => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 15:30:51.922063 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-527526c6-4ebe-40fb-8ceb-2baaee4dd780 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:30:51.922570 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-527526c6-4ebe-40fb-8ceb-2baaee4dd780 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 822595cd-b7f3-4d21-b8d4-c1f6da86d104] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:30:51.928817 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-527526c6-4ebe-40fb-8ceb-2baaee4dd780 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:30:51.929273 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-527526c6-4ebe-40fb-8ceb-2baaee4dd780 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:30:51.930079 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-527526c6-4ebe-40fb-8ceb-2baaee4dd780 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:30:51.930523 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-527526c6-4ebe-40fb-8ceb-2baaee4dd780 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:30:51.944087 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.wsgi [None req-527526c6-4ebe-40fb-8ceb-2baaee4dd780 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] HTTP exception thrown: Instance 822595cd-b7f3-4d21-b8d4-c1f6da86d104 could not be found. Mar 08 15:30:51.944678 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-527526c6-4ebe-40fb-8ceb-2baaee4dd780 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Returning 404 to user: Instance 822595cd-b7f3-4d21-b8d4-c1f6da86d104 could not be found. {{(pid=128351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:30:51.945504 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-527526c6-4ebe-40fb-8ceb-2baaee4dd780 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "DELETE /compute/v2.1/servers/822595cd-b7f3-4d21-b8d4-c1f6da86d104" status: 404 len: 111 microversion: 2.1 time: 0.027328 Mar 08 15:30:51.946082 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1250/2717] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 15:30:51 2022] DELETE /compute/v2.1/servers/822595cd-b7f3-4d21-b8d4-c1f6da86d104 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 15:30:51.953915 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-99685f0e-0184-4969-8733-6eebf0607023 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:30:51.954555 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-99685f0e-0184-4969-8733-6eebf0607023 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 822595cd-b7f3-4d21-b8d4-c1f6da86d104] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:30:51.961383 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-99685f0e-0184-4969-8733-6eebf0607023 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:30:51.961833 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-99685f0e-0184-4969-8733-6eebf0607023 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:30:51.962623 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-99685f0e-0184-4969-8733-6eebf0607023 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:30:51.963062 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-99685f0e-0184-4969-8733-6eebf0607023 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:30:51.977687 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-99685f0e-0184-4969-8733-6eebf0607023 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] HTTP exception thrown: Instance 822595cd-b7f3-4d21-b8d4-c1f6da86d104 could not be found. Mar 08 15:30:51.978292 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-99685f0e-0184-4969-8733-6eebf0607023 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Returning 404 to user: Instance 822595cd-b7f3-4d21-b8d4-c1f6da86d104 could not be found. {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:30:51.979099 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-99685f0e-0184-4969-8733-6eebf0607023 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/822595cd-b7f3-4d21-b8d4-c1f6da86d104" status: 404 len: 111 microversion: 2.1 time: 0.029056 Mar 08 15:30:51.979612 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1468/2718] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:30:51 2022] GET /compute/v2.1/servers/822595cd-b7f3-4d21-b8d4-c1f6da86d104 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 15:30:51.987477 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-685a07ae-cd2d-425f-91b5-f5a3dc212b15 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:30:51.987974 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-685a07ae-cd2d-425f-91b5-f5a3dc212b15 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: f813bc72-7a86-47dd-b619-d20ef86a30ea] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:30:51.993687 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-685a07ae-cd2d-425f-91b5-f5a3dc212b15 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:30:51.994181 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-685a07ae-cd2d-425f-91b5-f5a3dc212b15 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:30:51.994934 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-685a07ae-cd2d-425f-91b5-f5a3dc212b15 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:30:51.995372 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-685a07ae-cd2d-425f-91b5-f5a3dc212b15 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:30:52.010138 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.wsgi [None req-685a07ae-cd2d-425f-91b5-f5a3dc212b15 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] HTTP exception thrown: Instance f813bc72-7a86-47dd-b619-d20ef86a30ea could not be found. Mar 08 15:30:52.010711 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-685a07ae-cd2d-425f-91b5-f5a3dc212b15 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Returning 404 to user: Instance f813bc72-7a86-47dd-b619-d20ef86a30ea could not be found. {{(pid=128351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:30:52.011511 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-685a07ae-cd2d-425f-91b5-f5a3dc212b15 tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f813bc72-7a86-47dd-b619-d20ef86a30ea" status: 404 len: 111 microversion: 2.1 time: 0.027958 Mar 08 15:30:52.012021 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1251/2719] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 15:30:51 2022] DELETE /compute/v2.1/servers/f813bc72-7a86-47dd-b619-d20ef86a30ea => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 15:30:52.020400 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5d0bfdec-bedc-4706-bb4d-bc085cb60bed tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:30:52.021018 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-5d0bfdec-bedc-4706-bb4d-bc085cb60bed tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: f813bc72-7a86-47dd-b619-d20ef86a30ea] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:30:52.027115 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5d0bfdec-bedc-4706-bb4d-bc085cb60bed tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:30:52.027567 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5d0bfdec-bedc-4706-bb4d-bc085cb60bed tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:30:52.028329 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5d0bfdec-bedc-4706-bb4d-bc085cb60bed tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:30:52.028769 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-5d0bfdec-bedc-4706-bb4d-bc085cb60bed tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:30:52.041594 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-5d0bfdec-bedc-4706-bb4d-bc085cb60bed tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] HTTP exception thrown: Instance f813bc72-7a86-47dd-b619-d20ef86a30ea could not be found. Mar 08 15:30:52.042219 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-5d0bfdec-bedc-4706-bb4d-bc085cb60bed tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Returning 404 to user: Instance f813bc72-7a86-47dd-b619-d20ef86a30ea could not be found. {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:30:52.043023 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-5d0bfdec-bedc-4706-bb4d-bc085cb60bed tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/f813bc72-7a86-47dd-b619-d20ef86a30ea" status: 404 len: 111 microversion: 2.1 time: 0.027176 Mar 08 15:30:52.043531 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1469/2720] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:30:52 2022] GET /compute/v2.1/servers/f813bc72-7a86-47dd-b619-d20ef86a30ea => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 15:30:53.172654 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-a85960cd-ecb4-4afb-a501-7c923aba354d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:30:53.173144 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.compute.api [None req-a85960cd-ecb4-4afb-a501-7c923aba354d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 56ade7e6-35ae-4f5b-81ff-9221d246720c] Fetching instance by UUID {{(pid=128351) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:30:53.179544 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a85960cd-ecb4-4afb-a501-7c923aba354d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:30:53.179994 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a85960cd-ecb4-4afb-a501-7c923aba354d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:30:53.180749 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a85960cd-ecb4-4afb-a501-7c923aba354d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:30:53.181187 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG oslo_concurrency.lockutils [None req-a85960cd-ecb4-4afb-a501-7c923aba354d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:30:53.194050 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.wsgi [None req-a85960cd-ecb4-4afb-a501-7c923aba354d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] HTTP exception thrown: Instance 56ade7e6-35ae-4f5b-81ff-9221d246720c could not be found. Mar 08 15:30:53.194561 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: DEBUG nova.api.openstack.wsgi [None req-a85960cd-ecb4-4afb-a501-7c923aba354d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Returning 404 to user: Instance 56ade7e6-35ae-4f5b-81ff-9221d246720c could not be found. {{(pid=128351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:30:53.195359 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO nova.api.openstack.requestlog [None req-a85960cd-ecb4-4afb-a501-7c923aba354d tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "DELETE /compute/v2.1/servers/56ade7e6-35ae-4f5b-81ff-9221d246720c" status: 404 len: 111 microversion: 2.1 time: 0.026529 Mar 08 15:30:53.195868 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: [pid: 128351|app: 0|req: 1252/2721] 10.222.0.30 () {58 vars in 1238 bytes} [Tue Mar 8 15:30:53 2022] DELETE /compute/v2.1/servers/56ade7e6-35ae-4f5b-81ff-9221d246720c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 15:30:53.203578 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-a91c6dad-7973-4a7f-9b85-ff24d16c1fae tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Calling method '>' {{(pid=128352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 15:30:53.204189 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.compute.api [None req-a91c6dad-7973-4a7f-9b85-ff24d16c1fae tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] [instance: 56ade7e6-35ae-4f5b-81ff-9221d246720c] Fetching instance by UUID {{(pid=128352) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 15:30:53.211253 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a91c6dad-7973-4a7f-9b85-ff24d16c1fae tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:30:53.211699 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a91c6dad-7973-4a7f-9b85-ff24d16c1fae tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:30:53.212455 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a91c6dad-7973-4a7f-9b85-ff24d16c1fae tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 15:30:53.212893 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG oslo_concurrency.lockutils [None req-a91c6dad-7973-4a7f-9b85-ff24d16c1fae tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Lock "8d394eb1-87fe-4527-b2a1-ae44ca505941" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 15:30:53.226260 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.wsgi [None req-a91c6dad-7973-4a7f-9b85-ff24d16c1fae tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] HTTP exception thrown: Instance 56ade7e6-35ae-4f5b-81ff-9221d246720c could not be found. Mar 08 15:30:53.226836 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: DEBUG nova.api.openstack.wsgi [None req-a91c6dad-7973-4a7f-9b85-ff24d16c1fae tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] Returning 404 to user: Instance 56ade7e6-35ae-4f5b-81ff-9221d246720c could not be found. {{(pid=128352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 15:30:53.227642 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO nova.api.openstack.requestlog [None req-a91c6dad-7973-4a7f-9b85-ff24d16c1fae tempest-AttachVolumeNegativeTest-586553183 tempest-AttachVolumeNegativeTest-586553183-project] 10.222.0.30 "GET /compute/v2.1/servers/56ade7e6-35ae-4f5b-81ff-9221d246720c" status: 404 len: 111 microversion: 2.1 time: 0.027890 Mar 08 15:30:53.228162 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: [pid: 128352|app: 0|req: 1470/2722] 10.222.0.30 () {58 vars in 1235 bytes} [Tue Mar 8 15:30:53 2022] GET /compute/v2.1/servers/56ade7e6-35ae-4f5b-81ff-9221d246720c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 15:31:05.542222 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 15:31:05.542935 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: Tue Mar 8 15:31:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 15:32:18.812990 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 15:32:18.813622 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: Tue Mar 8 15:32:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 15:34:25.551428 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 15:34:25.552152 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: Tue Mar 8 15:34:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 15:34:45.037094 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 15:34:45.037634 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: Tue Mar 8 15:34:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 15:35:38.822511 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 15:35:38.823260 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: Tue Mar 8 15:35:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 15:36:20.295152 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 15:36:20.295771 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: Tue Mar 8 15:36:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 15:36:21.004720 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 15:36:21.004880 dv-cinder-830095-2-iscsi devstack@n-api.service[128352]: Tue Mar 8 15:36:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 15:36:33.482222 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 15:36:33.482857 dv-cinder-830095-2-iscsi devstack@n-api.service[128351]: Tue Mar 8 15:36:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!